S

Sai Venkatesh A

About

Detail

Senior Data Engineer at TBC Corp
Devon, Pennsylvania, United States
Contact Sai regarding: 
work
Full-time jobs
Starting at USD150k/year

Timeline

work
Job
school
Education

Résumé

Jobs verified_user 0% verified
  • T
    Senior Data Engineer
    TBC Corp
    Jan 2022 - Current (4 years 9 months)
    · Ensured scalability and performance by leading the design and implementation of solid data structures for Hadoop-based applications utilizing Cloudera Manager (CDH5).
    · Implemented efficient data storage solutions using AWS DynamoDB for NoSQL operations and leveraged PartiQL to extract insights from diverse semi-structured data sources.
    · To extract, process, and load data from diverse sources into data lakes and warehouses, complicated ETL pipelines were designed, created, and optimized utilizing PySpark, HDFS NiFi.
    · Managed and optimized big data processing tasks by leveraging AWS EMR (Elastic MapReduce) using lambdas, step functions for scalable data transformation.
    · Optimized query performance by leveraging Athen
  • Toyota Financial Services Corporation
    Senior Data Engineer
    Toyota Financial Services Corporation
    Jan 2020 - Nov 2021 (1 year 11 months)
    · led efforts to integrate and ingest data into Azure DataLake Storage using Azure Data Factory (ADF), which collects and combines data from various sources.
    · Designed, created, and maintained ADF pipelines to effectively coordinate data transfer and transformations.
    · played a vital role in the design and implementation of data warehousing systems using Azure Synapse Analytics (formerly SQL Data Warehouse) and Azure Synapse Workspace.
    · Designed data models and schemas in collaboration for the best possible data storage and retrieval.
    · Utilized Azure DataBricks for sophisticated data transformation and analytics, carrying out operations including data aggregation, data cleaning, and feature engineering.
    · Scalabl
  • Banner Health
    Data Engineer
    Banner Health
    Apr 2017 - Oct 2019 (2 years 7 months)
    · Evaluated business requirements, prepared detailed specifications, and led Big Data initiatives, including analysis, brainstorming, POC, and architecture.
    · Developed and maintained Apache Hadoop clusters, configured Hive, and utilized Hive UDFs and Pig Latin for data processing.
    · Designed data pipelines using Pig and Sqoop to ingest and transform diverse data sets in HDFS.
    · Migrated on-premises code to AWS EMR clusters and configured Hadoop Ecosystem components using CDH distribution.
    · Applied machine learning libraries and algorithms to optimize data and participated in Agile SDLC with daily scrum meetings.
    · Created automated pipelines in AWS Code Pipeline for deploying Docker containers in AWS ECS.
    · L
  • Tata Consultancy Services
    Data Engineer/Analyst
    Tata Consultancy Services
    Jun 2015 - Mar 2017 (1 year 10 months)
    · Worked in an Agile environment, managing Scrum stories and sprints, with a focus on Python-based data analytics and Excel data extraction.
    · Developed Python programs to manipulate data from various Teradata sources and convert them into CSV files.
    · Designed normalized Logical and Physical database models for OLTP applications.
    · Conducted statistical data analysis and data visualization using Python, identifying trends and patterns through techniques like exploratory data analysis and clustering.
    · Performed data cleaning, feature scaling, and feature engineering using Python packages such as Pandas, NumPy, Matplotlib, and Sci-kit Learn.
    · Implemented Machine Learning techniques with Python Pandas and Scikit-lea
  • Tata Consultancy Services
    Data Engineer Intern
    Tata Consultancy Services
    Nov 2014 - May 2015 (7 months)
    • Conducted exploratory data analysis to uncover insights and trends in datasets, helping the team understand data patterns and anomalies.
    • Created clear and compelling data visualizations using tools like Matplotlib or Tableau to effectively communicate findings to stakeholders.
    • Developed Python scripts for data manipulation and wrote SQL queries to extract and transform data for various analytics and reporting purposes.
    • Assisted in defining, monitoring, and reporting on key performance indicators (KPIs) to assess the effectiveness of data-driven initiatives and provided actionable insights.
    • Applied market basket analysis techniques to identify product associations and customer purchase patterns, and generated re
Education verified_user 0% verified
  • RVR JC College of Engineering
    Bachelor's degree, Electrical, Electronics and Communications Engineering
    RVR JC College of Engineering
    Jul 2011 - Apr 2015 (3 years 10 months)