Data Engineering Consultant
Kubrick Group
Jan 2023 - Sep 2024 (1 year 9 months)
Overview
• Developed practical skills in SQL, Python and data-driven mindset from training for client work deployments
• Designed and improved ETL pipelines using automated Airflow jobs for Airlines client, resulting in 300% increase in data loading/checks efficiency for British Airways product suite. (i.e. Avios Hotels, Wine Flyer, Avis Carhire)
• Managed AWS Redshift end-to-end pipelines for loyalty end-users whilst replicating migration data to Snowflake
• Deployed Github Action jobs using SQL scripts with Agile test-driven development approach Data Project Lead (Kubrick Internal)
• Built a chatbot powered by OpenAI Agents SDK, Langchain, & Neo4j to improve consultant training capabilities
• Automated Dbt pi