S
Samyuktha Potla
About
Detail
Data Engineer at PNC Financial Services
United States
Contact Samyuktha regarding:
work
Full-time jobs
Timeline
work
Job
Résumé
Jobs
verified_user
0% verified
- PData EngineerPNC Financial ServicesJan 2023 - Current (2 years 7 months)• Optimized Sparkjobs using partitioning and caching techniques, achieving a 3x performance improvement for complex data aggregations and feature engineering tasks. • Orchestrated data pipelines using Airflow to automate data ingestion, transformation, and loading tasks between data sources (Kafka, HDFS) and data warehouses, ensuring reliable and scheduled data delivery for BI dashboards. • Developed and deployed serverless Lambda functions for data processing tasks, reducing infrastructure costs by 20%. • Improved Snowflake data ingestion pipelines' efficiency by 25% through clustering and partitioning techniques. • Implemented Kafka for real-time data streaming across applications, enhancing data accessibility and application respons
- XData EngineerX-Logic Technologies|Jan 2020 - Nov 2021 (1 year 11 months)• Automated daily data ingestion pipelines using Airflow, ensuring timely data availability for machine learning models, resulting in a 10% improvement in model accuracy. • Enhanced Azure Data Factory pipelines for automating data ingestion, transformation, and loading processes, reducing processing time by 30%. • Developed HiveQL queries to extract, transform, and load (ETL) data into the data warehouse. • Utilized Apache Spark and Python (Pandas, NumPy, BeautifulSoup) for ETL workflows, improving data processing efficiency and accuracy. • Leveraged Databricks for data visualization and model deployment, streamlining the transition from data processing to model production. • Conducted data quality checks and cleansing routines within
Education
verified_user
0% verified
- NMaster of ScienceNorthwest Missouri State University
- BBachelor of TechnologyBVRIT Hyderabad College of Engineering for Women