Senior AWS Data Engineer
Pfizer
Aug 2020 - Apr 2023 (2 years 9 months)
Designed and developed end-to-end ETL and ELT pipelines on AWS using Glue, Lambda, Step Functions, and Redshift to ingest, transform, and load structured and semi-structured clinical and R&D datasets.Architected a HIPAA-compliant AWS Data Lake on S3 with Raw, Staging, and Curated zones, implementing encryption, version control, and lifecycle management policies to ensure scalability and cost optimization.Developed and optimized PySpark transformation jobs on EMR for high-volume genomic and patient data; leveraged partitioning, bucketing, and caching techniques to reduce data-processing runtime by 40%.Built data-validation and schema-enforcement frameworks in AWS Glue using Python and DynamicFrames to guarantee accuracy, consistency, and com