R

Reshma Shaik

About

Detail

Arizona, United States

Contact Reshma regarding: 
work
Full-time jobs

Timeline


work
Job
school
Education

Résumé


Jobs verified_user 0% verified
  • Databricks
    Data Engineer
    Databricks
    Mar 2024 - Current (2 years 6 months)
    • Designed and deployed scalable batch and streaming data pipelines using Databricks (PySpark) and Delta Lake, processing 1.5+ TB/day of structured, semi-structured, and unstructured data for predictive analytics, generative AI, and computer vision use cases. • Developed and orchestrated production-grade ETL workflows with Databricks Workflows and Prefect, improving SLA adherence by 40% through modular, parameterized job configurations. • Implemented Delta Live Tables to enable near real-time transformations, reducing processing latency by 30% and accelerating delivery of datasets for machine learning models and operational dashboards. • Optimized Spark SQL and PySpark workloads via adaptive query execution, broadcast joins, and caching
  • Cognizant
    Data Engineer
    Cognizant
    Jun 2020 - Jul 2023 (3 years 2 months)
    • Built 30+ production-grade batch and streaming pipelines using Apache NiFi, PySpark, and Luigi, automating ingestion from CRM, ERP, IoT, and clickstream sources into Snowflake and Azure Data Lake, powering predictive analytics and AI/ML workloads. • Optimized end-to-end ETL workflows by modularizing components and introducing Dask for parallel data processing, reducing monthly cloud compute costs by 22% through job-level parallelization and Spark cluster tuning. • Led migration of legacy batch ETL to streaming architecture using AWS Kinesis and Apache Beam, enabling near real-time processing of behavioral and sensor event data with <3 min SLA latency. • Modeled enterprise datasets using Star and Snowflake schemas, applied Delta Lake o
Education verified_user 0% verified
  • Grand Canyon University
    Master of Science in
    Grand Canyon University
    Aug 2023 - Aug 2025 (2 years 1 month)