Lead Data Engineer
CorroHealth
Dec 2021 - Current (4 years 11 months)
Architected and deployed an Azure, Snowflake, and Databricks platform, improving analytics performance and significantly reducing platform costs. Developed a lakehouse using dbt and Airflow, enabling governed self-service analytics for the finance domain. Migrated legacy ETL processes to ELT with Kafka and Spark, resulting in reduced dashboard latency and improved system availability. Scaled enterprise-level dimensional models to support machine learning, reporting, and analytics across asset and supply chain operations. Designed and integrated a Microsoft Fabric architecture with Power BI, OneLake, and Azure for a unified operational modeling environment. Created a feature store and ML datasets to optimize MLOps and enhance experimentation