data engineer
Syndigo
Mar 2021 - Current (5 years 4 months)
• Contributed to the Digital Shelf team by supporting big data ETL processes in Azure Data Factory (ADF, a fully managed, serverless data integration service), reporting, and optimizing data flow and delivery. • Design, optimize, and ensure daily availability of scalable data pipelines across cloud platforms. • Enhanced ETL processes using advanced SQL and cloud-based data warehousing solutions to support cross-functional data initiatives. • Developed a new UAT ETL environment in ADF, designing associated tables and views in Databricks to support scalable data pipelines. • Refactored and tuned ETL processes and advanced SQL queries to maximize performance and runtime efficiency (for example, refactored content health pipeline, saved bo