Ssr. Data Engineer
PI CONSULTING
Jan 2024 - Current (2 years 7 months)
Designed and implemented Azure and Microsoft Fabric data architectures (Lakehouse / Medallion: Bronze, Silver, Gold) with ADF, Databricks, and PySpark.
Led migrations from on-premise databases to cloud environments.
Integrated structured sources (SAP, APIs, Share-Point, on-prem DBs) ensuring standardized, analytics-ready data.
Implemented Data Governance with Unity Catalog and CI/CD using Git and Azure DevOps.
Worked across Azure and Cloudera ecosystems (NiFi, Airflow, Hive), including monitoring and alerting via Microsoft Teams Webhooks.
Translated business requirements into scalable data solutions in collaboration with stakeholders.