R
Rupesh Yadav
About
Detail
India
Contact Rupesh regarding:
work
Full-time jobs
Flexible work
Résumé
Jobs
verified_user
0% verified
Software Engineer 2 (Data / Forward Deployed)AtlanApr 2024 - Jun 2026 (2 years 3 months)• Architected and executed end-to-end enterprise metadata migrations from Alation to Atlan for key Fortune 500 clients (including P&G and Cargill), reliably managing and validating millions of core data assets.
• Engineered a highly resilient, distributed migration workflow framework utilizing Python, FastAPI, and Temporal to manage long-running integration tasks with built-in idempotent state processing.
• Designed and implemented a real-time metadata reverse-sync pipeline using Numaflow, enabling instant synchronization from Atlan to Google Cloud Dataplex via secure gRPC channels.
• Developed a Model Context Protocol (MCP) server and an AI-driven chatbot powered by the latest Claude models to automate internal observability- DData EngineerDatagrokr AnalyticsJul 2021 - Apr 2024 (2 years 10 months)• Led the technical execution of a multi-stage migration platform on GCP, successfully transitioning petabyte-scale operational and analytical datasets from Snowflake and Salesforce over to BigQuery.
• Engineered incremental, high-availability ETL/ELT data pipelines using Cloud Composer (Apache Airflow), Google Cloud Dataflow, and BigQuery to sustain high-volume ingestion streams.
• Implemented structured Change Data Capture (CDC) architectures on AWS using DMS and Glue, reducing data replication latency and producing analytics-ready tables for downstream teams.
• Designed multi-layered corporate data models and optimized BigQuery stored procedures to empower cross-functional business reporting and interactive Power BI dashbo
Education
verified_user
0% verified
- Professional Data EngineerGoogle CloudJan 2023 - Jan 2025 (2 years 1 month)Initial Validity: 2023 – 2025
- B.Tech in Computer Science (Minor: Machine Learning)Lovely Professional UniversityJan 2018 - Jan 2022 (4 years 1 month)