Soubhagya Panda

Senior Data Engineer

Mindera

Apr 2023 - Current (3 years 7 months)

At Mindera, I work with Trainline’s Data & AI division to modernize large-scale data ecosystems across AWS, dbt, Airflow, and Spark — enabling domain teams to innovate faster with governed, self-serve data platforms. 🚄 Key Highlights Led the development of Trainline’s “Pay-As-You-Go” Signal Mart, a dbt-powered analytical platform supporting the UK Government’s contactless ticketing trial — powering 40+ KPIs across product, commercial, and fraud domains. Built Network Mart, a Lakehouse platform processing 500GB+ daily, providing corridor-level visibility across UK & EU rail networks for coverage analytics and disruption prediction. Designed and implemented a self-serve metrics framework (dbt + Airflow Cosmos) adopted by 4 cross-functional t

V

Senior Technical Engineer

VIPApplicant

Sep 2021 - Feb 2023 (1 year 6 months)

Company: VIPApplicant - Kimyo Learning Pvt. Ltd. - Developed and deployed a Python application utilizing Spark to efficiently source and process PDF files stored in an AWS S3 bucket. - Leveraged a parser API to extract structured data from PDF files, saving them into JSON format for easier analysis and integration into downstream systems. - Monitored Spark jobs using Spark Web UI, History Server, and application logs to identify inconsistencies and debug any issues in the pipeline. - Developed and implemented an automated job notification system using Kafka, enabling seamless and timely delivery of new job openings to relevant candidates via email notification, resulting in a significant increase in application submissions. - Architected an

a

Sr. Associate (Big Data & Analytics)

altraSys Technologies

Jan 2018 - Aug 2021 (3 years 8 months)

At AltraSys, I worked as part of a small data engineering team designing and delivering scalable data platforms across healthcare and retail domains. My focus was on building reliable data pipelines, improving query performance, and migrating traditional systems to cloud-based architectures in AWS and Azure. Key Contributions: Designed and implemented end-to-end data pipelines integrating multiple structured and unstructured sources into unified analytical layers. Built Spark-based ML workflows for customer segmentation and demand forecasting, improving marketing and sales insights. Optimized Hive and Spark workloads through caching, partitioning, and query tuning, reducing execution time and improving resource utilization. Led the migratio

I

IT Consultant

Mar 2017 - Jul 2017 (5 months)

W

Web Developer

Oct 2015 - Jan 2017 (1 year 4 months)

About

Detail

Timeline

Résumé

Soubhagya Panda

About

Detail

Behavioral traits