Mohammad Azmat Shaik

• Data Engineer with 5+ years building scalable, cloud-native ETL/ELT pipelines and real-time streaming solutions across AWS, Azure, and GCP for healthcare and finance, ensuring HIPAA, GDPR, and SOX compliance with strong metadata management, governance, and stakeholder collaboration experience. • Expert in Python, Scala, SQL for data wrangling and advanced analytics; skilled with JSON, Avro, Parquet, ORC, and CSV for cloud-native data lakes and warehouses. • Designed and orchestrated complex pipelines using Airflow, Control-M, Azure Data Factory, AWS Glue, S3, Kinesis, Synapse, BigQuery, and Pub/Sub. • Developed streaming architectures with Kafka, Kinesis, Pub/Sub for real-time ingestion of health telemetry, transaction logs, and marketing signals. • Modeled data using Star and Snowflake schemas, implementing OLAP/OLTP solutions to power BI tools like Tableau, Power BI, and Looker. • Led secure infrastructure projects with Terraform, CloudFormation, ARM templates, enforcing IAM, encryption, and governance across AWS EMR, Azure Synapse, and GCP Dataflow. • Built CI/CD pipelines with Jenkins, GitLab, Bitbucket, Azure DevOps, deploying containerized ETL jobs with Docker/Kubernetes, and automated testing. • Supported AI/ML workflows with TensorFlow, PyTorch, Scikit-learn, and maintained monitoring using ELK Stack, Prometheus, and Grafana for SLA and data quality assurance. • Documented technical designs, data lineage, and troubleshooting guides in Confluence and Lucidchart, facilitating team onboarding, audits, and continuous improvement across fast-paced Agile teams using JIRA and Azure Boards. • Proactively mentored junior engineers on Spark optimization, Flink configuration, and Git workflows, fostering a collaborative, knowledge-sharing culture that accelerated team velocity and code quality.