JAGADEESH REDDY SURAPAREDDY

JAGADEESH REDDY SURAPAREDDY

About

Detail

Azure Snowflake Data Engineer at TIAA | Azure Data Bricks | Azure Data Factory | Azure Data Lake | Data Engineer
Texas, United States
Contact JAGADEESH regarding: 
work
Full-time jobs

Timeline

work
Job
school
Education

Résumé

Jobs verified_user 0% verified
  • TIAA
    Azure Snowflake Data Engineer
    TIAA
    May 2022 - Current (4 years 3 months)
    "Led the translation of the Data Science team's data requirements into actionable insights, designing and implementing a versatile Azure Data Factory/Databricks pipeline for efficient data ingestion. Spearheaded controlled database access, migrating on-premise databases to Azure Data Lake Store via Azure Data Factory. Engineered a CI/CD framework using Jenkins, collaborating with DevOps experts to automate pipelines and implement test-driven development, aligned with client specifications. Successfully deployed and tested pipelines/notebooks in production using Azure DevOps. Ensured effective collaboration by managing collaboration and master branches for ongoing developments. Developed robust ETL processes utilizing Snowpark to transform a
  • Deloitte
    Data Engineer
    Deloitte
    Dec 2021 - Apr 2022 (5 months)
    "In the capacity of a Data Engineer, I orchestrated the design and construction of a comprehensive data ingestion framework using Azure Data Factory. This facilitated seamless integration from diverse sources into Azure Data Lake and Synapse Analytics, specifically to fuel marketing dashboards. Employing Azure Databricks alongside Python, I executed impactful data profiling on substantial datasets, rectifying anomalies and reinvigorating data for Azure Data Lake. Furthermore, I orchestrated the migration of existing on-premises applications to AWS, leveraging services including EC2, EMR, and S3 to process and store small datasets efficiently. I adeptly managed AWS S3 buckets for Cloud Formation Templates and contributed to the creation of E
  • Accenture
    BIG DATA INTERN
    Accenture
    Jan 2018 - Jun 2021 (3 years 6 months)
    "As part of my responsibilities, I conceived and constructed a robust data ingestion framework. This involved seamless data movement from Oracle Golden Gate to Kafka and subsequently to the Data Warehouse via Apache Nifi. To enhance data quality and applicability, I crafted Nifi Data Ingestion pipelines that efficiently consumed Kafka data and applied pertinent business logic before loading into the Data Warehouse. Utilizing a combination of Azure Data Factory, Spark SQL, Azure Data Lake, and Analytics, I adeptly Extracted, Transformed, and Loaded data from Source Systems to Azure Data Storage services. Moreover, I was instrumental in developing tailored ETL solutions, encompassing batch processing and real-time data ingestion pipelines, dr
Education verified_user 0% verified
  • University of North Texas
    Master's degree, Computer Science
    University of North Texas
    Aug 2021 - May 2023 (1 year 10 months)
    Skills: Data Engineering · Analytical Skills · R (Programming Language)