S
Srikanth Reddy Vangala
Srikanth Reddy Vangala
About
Detail
Big Data Engineer/Sr. Etl Lead
Plano, Texas, United States
A Senior Data Engineer with over 17 years of experience in architecting and implementing scalable data warehousing and integration solutions on Microsoft Fabric, Azure, and AWS. Expertise spans the full data lifecycle, from end-to-end data pipelines and modeling to performance tuning, enabling business intelligence and advanced analytics.
Proficient with Big Data technologies including Apache Spark, Databricks, and the Hadoop Ecosystem (EMR, Glue, S3, HDFS), along with traditional ETL tools like MSBI (SSIS/SSRS) and Informatica PowerCenter. Extensive experience in cloud-native data warehousing with Snowflake and Amazon Redshift, managing complex data ingestion from various sources, including nested JSON/CSV from AWS S3 and Azure Blob.
Technical proficiencies include:
• Cloud Data Engineering: Designing and implementing robust data pipelines using Microsoft Fabric's Data Factory and Spark notebooks, Azure Databricks, and AWS Glue.
• Data Migration & Warehousing: Leading data migration projects from on-premise to Amazon Redshift, RDS, and S3, and utilizing advanced features like Snowflake's Time Travel and Clone.
• ETL & Performance Tuning: Optimizing PySpark jobs for large-scale datasets, troubleshooting performance bottlenecks in ETL processes, and implementing techniques like indexing and partitioning.
• Databases & Scripting: Working with traditional RDBMS such as Oracle, SQL Server, and Teradata, and automating solutions with UNIX Shell scripting.
Adept at Agile/Scrum methodologies and committed to transforming raw data into curated, reliable, and actionable insights that drive strategic business decisions. Focus on data quality, reliability, and security to support a data-driven culture.
Proficient with Big Data technologies including Apache Spark, Databricks, and the Hadoop Ecosystem (EMR, Glue, S3, HDFS), along with traditional ETL tools like MSBI (SSIS/SSRS) and Informatica PowerCenter. Extensive experience in cloud-native data warehousing with Snowflake and Amazon Redshift, managing complex data ingestion from various sources, including nested JSON/CSV from AWS S3 and Azure Blob.
Technical proficiencies include:
• Cloud Data Engineering: Designing and implementing robust data pipelines using Microsoft Fabric's Data Factory and Spark notebooks, Azure Databricks, and AWS Glue.
• Data Migration & Warehousing: Leading data migration projects from on-premise to Amazon Redshift, RDS, and S3, and utilizing advanced features like Snowflake's Time Travel and Clone.
• ETL & Performance Tuning: Optimizing PySpark jobs for large-scale datasets, troubleshooting performance bottlenecks in ETL processes, and implementing techniques like indexing and partitioning.
• Databases & Scripting: Working with traditional RDBMS such as Oracle, SQL Server, and Teradata, and automating solutions with UNIX Shell scripting.
Adept at Agile/Scrum methodologies and committed to transforming raw data into curated, reliable, and actionable insights that drive strategic business decisions. Focus on data quality, reliability, and security to support a data-driven culture.
Contact Srikanth regarding:
work
Full-time jobs