Data Engineer, Wmall ( ShopDeck ) - Founding Member
Wmall ( ShopDeck )
Sep 2019 - May 2021 (1 year 9 months)
• Solely built an end-to-end data pipeline using SQL, Python, Airflow & Amazon Redshift As Data Warehouse addressing data availability issues for cataloging, operations, marketing, and customer care. Maintained roles and access levels for analysts in AWS-IAM for secure data management. • Implemented a monitoring and alerting system for AWS compute consumption using Python and SQL, ensuring optimal resource utilization & reducing costs by 15%. • Designed & Established an events pipeline from scratch with Airflow, Python, SQL, & hosted on AWS, enhancing data workflows and providing 100% visibility for product analysis on events data where there was previously no insight. • Set up end-to-end Apache Superset as a BI tool, improving data visuali