Sowmya Janardhan Prakash

Data Engineer

Barclays

Jan 2023 - Current (3 years 8 months)

Designed and automated high-volume ETL pipelines in Azure Databricks using PySpark, improving processing speeds by 30% through optimized cluster configurations and Spark tuning.Built integrated pipelines in Azure Data Factory that consolidated data across Azure SQL, ADLS, Synapse, and Blob storage, increasing data reliability and lowering ingestion failures.Implemented Delta Lake architecture, enabling time-travel, ACID compliance, and improved auditability for financial datasets.Reduced compute costs by 15% by rewriting inefficient SQL queries and optimizing Spark job execution.Ingested data using AWS S3, Spark, Kafka, and Airflow for both batch and real-time pipelines.Implemented data validation and schema enforcement during ingestion to

Data Engineer

Absolute Software

Nov 2022 - Dec 2022 (2 months)

Engineered cross-cloud data pipelines in Azure and AWS to process large JSON and Parquet datasets for analytics.Integrated Databricks to Snowflake ETL workflows, improving data delivery SLAS.Designed and implemented scalable data pipelines (batch and streaming) across diverse data sources including operational databases.Optimized Azure resource usage and storage architecture, reducing costs.

Python Developer

Prudential Financial

Sep 2021 - Sep 2022 (1 year 1 month)

Built foundational data models for analytics, ML, and product intelligence workflows.Collaborated with AI/ML, Product, and Software Engineering teams to enable data-driven decision-making and real-time intelligence.Implemented frameworks for data quality, observability, lineage, and governance.Evaluated and integrated modern data technologies (e.g., Redshift, S3, Spark, Airflow, dbt, Kafka, Databricks, Snowflake) to evolve the platform's capabilities.Loaded data into the raw zone, pre-raw zone, and landing zone through the execution of the ingestion script.Developed and deployed application code using Python, Pyspark, SQL, Boto3 and stored it in the tooling bucket.Implemented data pipelines to ingest batch files and stream data.Worked on de

Python Developer

Vanguard

Oct 2019 - Aug 2021 (1 year 11 months)

Worked on the implementation of an Agile-based web application that uses Python on the Django web framework to deliver datasets to the Ul dashboard.Built, enabled, and expanded new Databricks platform capabilities.Developed data model to handle the task module, created Python code and Django rest web services to deliver JSON data for CRUD operations for user activity from the Task-Notes module.Designed and developed MySQL-based database objects and Python code to interact with DB Objects using PyMySQL module.Worked on building the S3 bucket and managed policies for S3 bucket for storage and backup.Created and maintained ETL jobs to support business intelligence and analytics.

Python Developer

NIIT Technologies

Sep 2016 - May 2019 (2 years 9 months)

Developed Python scripts to consolidate data from Operational Data Store (ODS) system.Assisted the development team in sending the correct data via query strings using MySQL as the backend for storing data.Designed and developed MySQL-based database objects and Python code to interact with DB Objects using PyMySQL module.Handled potential points of failure (database, communication points, and file system errors) through error handling.Developed and executed Unit test procedures for software components.Involved in capturing the requirements for serial functional interface and other software requirements specification document.Followed waterfall and Agile/Scrum methodologies for software development.

Sowmya Janardhan Prakash

About

Detail

Timeline

Résumé