V
Vishnu Teja Yerrapragada
About
Detail
Bihar, India
Contact Vishnu regarding:
work
Full-time jobs
Résumé
Jobs
verified_user
0% verified
Data EngineerSagentAug 2024 - Current (2 years 1 month)Designed and implemented Azure Data Factory (ADF) pipelines for batch and incremental data ingestion from multiple source systems into cloud data platforms. Built end-to-end Azure data pipelines using watermarking, high-water-mark (HWM), and late-arriving data handling to support scalable incremental loads. Developed Python-based transformation and validation logic, enabling Spark-style distributed processing patterns for large-scale datasets. Modeled analytical datasets using star and snowflake schemas, optimizing data for downstream analytics and reporting. Implemented SCD Type 1 and Type 2 logic to maintain historical accuracy and current-state reporting in cloud data warehouses. Converted highly normalized OLTP source systems into analy- Data EngineerTech MahindraJan 2019 - Aug 2022 (3 years 8 months)Led the migration of historical and incremental transactional data from OLTP systems (postgress, SQL Server) into a Snowflake-based OLAP data warehouse, enabling scalable analytics and reporting. Designed and implemented ELT pipelines using Matillion, orchestrating data ingestion, transformations, and load processes optimized for Snowflake's cloud-native architecture. Developed Snowflake stored procedures to handle complex transformation logic, including data standardization, cleansing, deduplication, and business rule enforcement. Implemented incremental loading strategies using audit columns, watermarks (HWM/LWM), and change detection logic to support efficient delta processing. Built dimensional data models (star and snowflake schemas) t
- DData EngineerJan 2019 - Jul 2020 (1 year 7 months)Established an automated daily data load process from Salesforce CRM and Oracle Financials into a centralized staging area using Talend ETL tool for initial data capture. Designed the conceptual, logical, and physical data models for the Sales and Marketing Data Mart, primarily utilizing the bus matrix and dimensional modeling techniques. Wrote optimized PostgreSQL functions and complex SQL queries to clean, transform, and integrate sales metrics, including opportunity stages, lead conversion rates, and revenue forecasts. Developed robust incremental data loading strategies within Talend, leveraging watermarks and audit columns to process only new or changed records efficiently and reduce load times. Configured Talend jobs to handle various
Education
verified_user
0% verified
- Master of Science, Data ScienceThe University of MemphisAug 2022 - May 2024 (1 year 10 months)Course work: Database Systems, Data Mining, Machine Learning(Predictive Analysis), Advanced Statistical Learning, Biostats