Data Engineer public Remote experience
Summan
Apr 2024 - Oct 2024 (7 months)
• Managed the comprehensive administration of the Databricks workspace, implementing enterprise data governance through Unity Catalog and External Locations.
• Designed high-performance ingestion architectures using Databricks Autoloader to process massive files in JSON, Parquet, and HTML formats.
• Ensured seamless data integration with Azure Synapse Serverless SQL to optimize query capabilities.
• Contributed to the design of the Medallion ETL architecture, enabling secure and efficient data democratization across company analytics layers.