Kiran Kumar kukudala
About
Detail
GCP Data Engineer
Berlin, Connecticut, United States
Contact Kiran regarding:
work
Full-time jobs
Résumé
Jobs
verified_user
0% verified
GCP Data EngineerFord ProMar 2023 - Current (3 years 8 months)Served as the Subject Matter Expert (SME) for Salesforce Customer Data Platform (CDP).
Designed data model schema and wrote complex SQL queries (Apache Hive and Spark) for data transformation, combining and processing multiple data sources according to business requirements.
Responsible for building and architecting multiple Data pipelines, end to end ETL and ELT process for Data ingestion and transformation in GCP and coordinate task among the team.
Processed and loaded bound and unbound data from Google pub/subtopic to big query using cloud Dataflow with Python.
Migrated previously written cron jobs to airflow/composer in GCP.
Created GCP Big Query authorized views for row level security or exposing the data t- GCP Data EngineerASK ITJul 2019 - Jul 2021 (2 years 1 month)• Involved in developing building pipeline in GCP cloud platform involving but not limited to Data Lake, cloud Storage, cloud SQL, Big Query, GCP Databricks, GCP Secrets, GCP Data Proc.
• Created data integration and solutions for GCP Data Lake Analytics, GCP cloud Storage, databricks SQL, BigQuery, and snowflake Data Warehouse for providing analytics.
• Used Spark streaming to receive real-time data from Kafka and store the stream data to HDFS using Scala and NoSQL databases such as HBase and Cassandra.
• Developed NiFi workflow to pick up the data from the rest API server, from data lake as well as from SFTP server and send that to Kafka broker.
• Written Templates for GCP Infrastructure as code using Terraform to - GCP Data EngineerASK ITJul 2019 - Jul 2021 (2 years 1 month)• Involved in developing building pipeline in GCP cloud platform involving but not limited to Data Lake, cloud Storage, cloud SQL, Big Query, GCP Databricks, GCP Secrets, GCP Data Proc.
• Created data integration and solutions for GCP Data Lake Analytics, GCP cloud Storage, databricks SQL, BigQuery, and snowflake Data Warehouse for providing analytics.
• Used Spark streaming to receive real-time data from Kafka and store the stream data to HDFS using Scala and NoSQL databases such as HBase and Cassandra.
• Developed NiFi workflow to pick up the data from the rest API server, from data lake as well as from SFTP server and send that to Kafka broker.
• Written Templates for GCP Infrastructure as code using Terraform to - LData Engineer / Python DeveloperLatitude36 IncJul 2017 - Jun 2019 (2 years)Played a key role as a Python Developer/Data Engineer in a dynamic Azure cloud environment, contributing to the successful execution of data engineering tasks.
Used Synapse analytics to implement multiple transformations on data and created a pipeline in Azure Data factory to trigger daily jobs for the applications.
Developed Spark scripts, UDF using both Spark DSL and Spark SQL query for data aggregation, querying, and writing data back into RDBMS through Sqoop.
Performed end-to-end delivery of Pyspark ETL pipelines on Azure-Data Bricks to perform the transformation of data orchestrated via Azure Data Factory (ADF) scheduled through ADF triggers.
Managed data storage and retrieval using Azure Blob Storage and Azure
Education
verified_user
0% verified
- Master of Science - MS, Computer ScienceSacred Heart UniversitySep 2021 - Dec 2022 (1 year 4 months)Skills: Amazon Web Services (AWS) · Data Analysis · Problem Solving · Data Architecture · Communication · Data Science · Data Quality · Databases · Data Modeling · Data Analytics · Apache Spark
- ABachelor's degree, Electronics and Communications EngineeringAuroras Technological and Research Institute ATRIJan 2013 - Dec 2017 (5 years)Skills: Problem Solving · Communication
Projects (professional or personal)
verified_user
0% verified
- AASK IT