DATA ENGINEER public Remote experience
Netlandish Inc
Feb 2023 - Dec 2023 (11 months)
• Designed and optimized ELT pipelines in Databricks to process large-scale marketing datasets using Spark and Delta Lake, implementing Medallion architecture patterns to structure raw, curated, and analytics-ready data layers. • Implemented automated data ingestion and transformation workflows using APIs and Python within Databricks
to support scalable marketing analytics pipelines and downstream visualization in Tableau. • Optimized Spark job performance through tuning strategies, including partition management, query optimization, and efficient data processing patterns to reduce execution time and compute costs. • Managed Databricks clusters and AWS infrastructure to ensure system reliability, monitor workloads, and support timely update