Data Engineer
Adroit Innovative Solutions
Jan 2023 - Nov 2024 (1 year 11 months)
Designed and maintained scalable ETL pipelines using AWS Glue, Lambda, and Step Functions, enabling automated ingestion from multiple data sources. Monitored and optimized Amazon Redshift clusters; identified and refactored inefficient SQL queries, reducing CPU utilization by 30% and improving query latency by 40%. Built CloudWatch-based data quality alerts to detect and resolve incomplete or delayed data loads in real time. Collaborated with analysts and business stakeholders to ensure accuracy and accessibility of core analytics datasets. Supported migration of data pipelines from on-prem to Redshift with zero downtime during deployment. Leveraged Spark on AWS EMR for distributed data processing and performance optimization. Familiar with