V

Venkatesh Ikkurthi

About

Detail

Senior Data Engineer | ETL | Data Warehouse | Databricks | AWS | Spark | SQL | Python | Data| Azure | Power BI | Machine Learning | GCP | Hadoop ||
Texas, United States

Timeline


work
Job
school
Education

Résumé


Jobs verified_user 0% verified
  • Quadrant Technologies
    Senior Data Engineer
    Quadrant Technologies
    May 2024 - Current (2 years 2 months)
    Built real-time data ingestion pipelines using AWS Kinesis and Lambda, streaming live payment transactions into S3, followed by transformation and sync with GCP BigQuery for downstream analytics. Designed and developed end-to-end ETL/ELT pipelines using Python, Pyspark, and Spark SQL to process high-volume financial data from structured and semi-structured sources. Leveraged Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Cloud Functions to store, transform, and analyze transaction-level and customer profile data.
  • C
    Lead Software Developer
    Cognefi Info Solutions Pvt Ltd
    Apr 2024 - Current (2 years 3 months)
  • Persistent Systems
    Lead Software Engineer
    Persistent Systems
    Jul 2021 - Mar 2024 (2 years 9 months)
  • Persistent Systems
    Senior Data Engineer
    Persistent Systems
    Jun 2021 - Mar 2024 (2 years 10 months)
    Hero Housing Finance Limited:- Built real-time pipelines using Apache Kafka and Spark Streaming (Scala) to process credit card transactions and trigger fraud alerts based on dynamic thresholds. Developed batch ETL pipelines on AWS EMR to load investment portfolio data from Amazon S3 into partitioned Hive tables using Spark SQL, supporting nightly reporting. Ingested customer demographic and transaction data from on-prem Oracle systems into HDFS using Sqoop, maintaining data accuracy through incremental updates. Bajaj Finance Limited:- Developed batch ETL pipelines on AWS EMR to load investment portfolio data from Amazon S3 into partitioned Hive tables using Spark SQL, supporting nightly reporting. Ingested customer demographic and transacti
  • Appmajix Technologies
    Software Engineer
    Appmajix Technologies
    Sep 2017 - Jun 2021 (3 years 10 months)
  • Appmajix Technologies
    Data Engineer
    Appmajix Technologies
    May 2017 - Jun 2021 (4 years 2 months)
    Wrote complex SQL queries including joins, aggregations, and subqueries for data transformation, reporting, and ad hoc analysis on relational databases such as Oracle and MySQL. Performed file-based data ingestion by importing raw files (CSV, Excel) from shared drives or FTP servers into staging databases using tools like SQL Loader or custom Python scripts. Created and maintained database objects such as tables, views, indexes, constraints, and stored procedures to support ETL workflows and ensure optimal performance.
Education verified_user 0% verified
  • Jawaharlal Nehru Technological University Kakinada JNTUK
    Bachelor's degree, Electrical and Electronics Engineering
    Jawaharlal Nehru Technological University Kakinada JNTUK
    Jan 2013 - Dec 2017 (5 years)
  • Jawaharlal Nehru Technological University Kakinada JNTUK
    Bachelor's degree, Computer Science
    Jawaharlal Nehru Technological University Kakinada JNTUK
    Jan 2013 - Jan 2017 (4 years 1 month)