Assistant Manager – Data Engineer
KPMG India
Apr 2023 - Current (3 years 4 months)
• Involved in discussions with the leadership team for understanding the Business Objective and to set up the architecture and providing best-suited cloud solution by applying best practices of Data Engineering. • Built Cloud Native Data Warehouse(with Distributed Compute Principles) for the apps on GCP Cloud which helped Business to decommission on-prem Data warehouse and migrate fully onto Cloud resulting in Reduced cost, Fully-managed and solved storage constraints by Auto-scaling of Storage thus solving the technology challenges. • Designed, implemented and Orchestrated the data pipeline to process structured data by ingesting raw records from multiple sources/formats using PySpark and Apache Airflow. • Responsible for Migrating Par