Neel Shah

S

Senior Data Engineer

Stripe, Inc.

Jan 2023 - Current (3 years 8 months)

• Designed and implemented a scalable, cloud-native data architecture on AWS and Snowflake using Medallion Architecture, streamlining raw-to-insight data flow to support real-time financial analytics and risk modeling. • Built end-to-end ELT pipelines using Python, SQL, and dbt to power Stripe's internal data products, ensuring accurate reconciliation of transaction and payment data across services. • Developed and optimized high-performance ELT workflows in Snowflake and Databricks, applying advanced query tuning to cut financial query latency by over 50%. • Led the integration of behavioral and transactional datasets from diverse platforms using Kafka, Spark, and Airflow, enabling customer-level analytics, fraud detection, and credit

Lead Data Engineer

Reddit, Inc.

Dec 2021 - Jan 2023 (1 year 2 months)

• Led Reddit's data platform modernization by rebuilding legacy pipelines into scalable, modular ELT frameworks using dbt, Airflow, and Snowflake. • Designed and managed real-time streaming systems with Kafka and Spark Structured Streaming to support feed ranking, content tagging, and user activity tracking. • Developed event-driven data models supporting Reddit's ads platform, personalized recommendations, and trust & safety dashboards. • Spearheaded CI/CD automation for data pipelines, integrating build, quality checks, security scans, and deployment using GitHub Actions and internal tools. • Advised teams on data governance, including PII handling, column-level access policies, and lineage documentation using tools like Amundsen and

Senior Data Engineer

Reddit, Inc.

Jun 2017 - Dec 2021 (4 years 7 months)

• Built and maintained distributed data pipelines on AWS using Spark, EMR, Redshift, and S3, processing billions of user interactions daily. • Created and maintained star schema–based models in Redshift and Snowflake to support product, ads, and community teams with performant, scalable data access. • Developed scalable reporting solutions and real-time dashboards for experimentation, A/B testing, and growth analytics using Looker and Redash. • Collaborated with cross-functional teams to instrument product events, normalize behavioral tracking, and integrate them into the core data models. • Automated data validation, testing, and monitoring across pipelines to meet data SLAs and reduce pipeline failures by 40%. • Acted as a liaison b

Data Engineer

Reddit, Inc.

Oct 2015 - Jun 2017 (1 year 9 months)

• Built Reddit's foundational data infrastructure on AWS, configuring secure VPCs, EC2, RDS, and S3 for scalable batch data processing. • Created ingestion pipelines to centralize Reddit post, comment, vote, and session data into the company's first data lake. • Developed internal tools with Flask and Python for data exploration, empowering teams to query and visualize key product metrics. • Implemented alerting and monitoring for ETL failures and latency using CloudWatch and PagerDuty, improving pipeline reliability. • Supported the data needs of teams across growth, safety, and platform engineering with custom SQL models and reporting layers. • Helped define internal policies for data retention, privacy, and user anonymization, alig

About

Detail

Timeline

Résumé