Madiha Khalid

Madiha Khalid

About

Detail

Senior Data Engineer | Helping Startups to build their Scalable & Cost Effective Data Platform | Ex-Jimdo | Mentor at DET & Topmate |Erasmus Mundus MS IT4BI |
Germany
Contact Madiha regarding: 
work
Full-time jobs

Timeline

work
Job
school
Education

Résumé

Jobs verified_user 0% verified
  • C
    Senior Data Engineer Consultant
    Cloudworkz
    Feb 2025 - Current (1 year 9 months)
    In my role as a Senior Data Engineer Consultant at Cloudworkz, I provided crucial support to Danskebank in migrating on-prem to AWS. By building ETL Pipelines in Python, I enabled the migration team to execute a successful migration, resulting in increased efficiency and cost savings for the client.
  • Startupbootcamp
    Startup Mentor
    Startupbootcamp
    Apr 2024 - Current (2 years 7 months)
  • d
    Founder | Principal Data Engineer | Data Platform Advisor
    datavent.io
    Jan 2024 - Current (2 years 10 months)
    - Data Engineering - Lakehouse Architecture - AI Integration - Data Pipeline - Cost Optimised - Startup Mentorship - Career Guidance for Aspiring Engineers
  • S
    Senior Data Engineer
    Apr 2023 - Mar 2024 (1 year)
  • Jimdo
    Senior Data Engineer
    Jimdo
    Nov 2021 - Apr 2023 (1 year 6 months)
  • Jimdo
    Data Engineer
    Jimdo
    Nov 2018 - Nov 2021 (3 years 1 month)
    - Design, developed and maintain ETL Pipeline using Python, Docker and Jenkins over AWS Infrastructure - Moved to new Infrastructure solution to schedule ETL pipeline on Apache Airflow using Kubernetes Cluster with CI/CD pipelines deployment. - Continuously working with stakeholder and Analyst to provide reliable and high quality data in AWS Redshift - Data Integration using REST API from various Tools Facebook, Google AdWords, Zendesk, CRM, Braze etc - Optimised AWS Redshift cluster resource utilization and SQL queries tuning to improve the performance - Parallelise ETL Jobs using Dask framework to improve the runtime performance of jobs - Convert existing full copy data load ETLs to incremental load of legacy data pipeline - Maintain infr
  • B
    Big Data Developer Researcher
    Dec 2017 - Sep 2018 (10 months)
    - Design and Implement Scalable Big Data Lambda Architecture Using Apache Spark, Cassandra and Elasticsearch for the Water management sector of Catalonia. - Building Data Lake using Apache Cassandra Integrate different financial data sources i.e. SAP ISU, Oracle Informix. - Applied extensive data analytics using Apache Spark to calculate water consumption, bills, supplying entities. - Elasticsearch used to persist the results for fast query results.
  • Barcelona Supercomputing Center
    Research Student
    Barcelona Supercomputing Center
    Feb 2017 - Oct 2017 (9 months)
    -Design and Implementation of Kappa Architecture using microservices. -Analyse mobility data pattern from live stream of data from various sensors. -Build trajectories and Implement Markov Chain real-time udpated model to predict the next location of a moving object. - Manage backend architecture for Big Data (Velocity and Volume) using Apache Kafka , Apache Cassandra and Apache Flink. - Deployment of architecture into Amazon Web Service EC2 instances for Apache Kafka and Cassandra and Hadoop EMR for Apache Flink
  • Jazz
    Executive Business Intelligence & Solutions Development
    Jazz
    May 2014 - Sep 2015 (1 year 5 months)
    Design & Develop web based business applications. Responsible for different business process automation. Design BI application technical solution based on business requirement and design. Design ETL Procedures in SQL server integration services. Create complex data solutions by leveraging database design, performance tuning, query optimization, indexes, data migration tools, and data analysis of back end data generated by products and services. Provide support to the clients for existing application. Big Data Analysis: NPS reporting on millions of customer’s feedback record. Projects: Mobilink’s Net Promoter System by Bain & Company -Customer Feedback Loop CFL, Franchise Portal, ZCCM feedback portal
  • Warid Telecom
    Executive Engineer Service Development
    Warid Telecom
    Jan 2013 - May 2014 (1 year 5 months)
    Design and develop Enterprise Level Automated Software for performance monitoring. Develop KPIs Monitoring Dashboard web based for technical sub-departments. Develop advance level SQL Queries (Bulk import, Merge, Cursor, Stored Procedures.) Project Documentation, Project scope, Architecture Diagrams. Oracle and SQL Server database maintenance, backups & restore. Big Data Analysis: Report generation on millions of subscriber’s data. GSM Network data extraction and generate reports on different criteria.
  • Warid Telecom
    NSS Planning Intern
    Warid Telecom
    Aug 2012 - Nov 2012 (4 months)
  • W
    Web Development
    Oct 2011 - Jul 2012 (10 months)
Education verified_user 0% verified
  • Universitat Politècnica de Catalunya
    master, Master’s Degree Information Technology for Business Intelligence E.M IT4BI
    Universitat Politècnica de Catalunya
    Jan 2016 - Jan 2017 (1 year 1 month)
  • Université de Tours
    master, Master’s Degree Information Technology for Business Intelligence E.M IT4BI
    Université de Tours
    Jan 2016
  • Université libre de Bruxelles
    master, Master’s Degree Information Technology for Business Intelligence E.M IT4BI
    Université libre de Bruxelles
    Jan 2015 - Jan 2016 (1 year 1 month)
  • G
    bachelor, Bachelor of Science (BS) Computer Science
    Government College University, Lahore
    Jan 2008 - Jan 2012 (4 years 1 month)
This is a community-created genome.