Bharathi S

Jobs 0% verified

A

Data Engineer

AMEX

Apr 2021 - Apr 2023 (2 years 1 month)

Designed and implemented scalable data pipelines and robust ETL solutions using PySpark and T-SQL, aligning with modern data architecture best practices and enhancing analytical capabilities. Migrated a 10TB on-premise data warehouse to Snowflake and an AWS S3-based Data Lake, optimizing data transfer from on-prem host to cloud and improving query performance while reducing annual infrastructure costs by 35%. Developed and deployed 15+ high-volume ETL/ELT pipelines using Apache Airflow and PySpark on AWS EMR to ingest over 500 million records daily, implementing buffering, compression, and backpressure strategies to prevent data loss and ensure reliability for business analytics and operational reporting. Established a robust data governanc
Data Engineer

Wells Fargo

Mar 2019 - Mar 2021 (2 years 1 month)

Developed scalable data pipelines and cloud-based data warehouses using ETL methodologies, PySpark, and T-SQL to drive business intelligence solutions with a strong focus on data modeling and schema management. Engineered and maintained real-time streaming data pipelines using Apache Kafka and Spark Streaming to process clickstream data, debugging distributed systems issues to ensure resilience and enable immediate operational insights for agile decision making. Enhanced financial reporting efficiency by optimizing SQL procedures on a PostgreSQL data warehouse, reducing query runtimes by 35% while ensuring reliable and scalable data storage. Ensured data quality and security throughout the data lifecycle by applying rigorous data analysis p

Education 0% verified

About

Detail

Timeline

Résumé