Software Development Engineer II
Physics Wallah (Hybrid)
Apr 2024 - Current (2 years 2 months)
• Implemented Apache Kafka for real-time user data processing of live analytics calculations. Reduced consumer lag from 250K-300K to <1K, while introducing a fallback mechanism to minimize event loss. • Developed an internal service caching mechanism using Redis and implemented write and update operations through Kafka, impacting over APIs having 380+ Rps for a user base of 2M+. • As the owner of services, leveraged DataDog to monitor performance of latency-prone APIs and HTTP calls, driving scalability improvements for major pods and enhancing the experience for 1M+ users. • Generated weekly on-call reports and analyzed service metrics used by cross-functional teams to identify bottlenecks. Utilized Datadog and ELK Stack to optimize th