Big Data Engineer
Zoolatech
Jun 2022 - Nov 2023 (1 year 6 months)
• Extract the data from multiples sources like Teradata, Snowflake, Hive tables, Kafka (Real-time streaming).
• Build and maintain batch and real-time ETL pipelines in a Airflow, Databricks using python as a primary
• language.
• Data transformation with sql code and python libraries such as pandas, pyspark,
• Dimensions and Facts Design and Data Modeling for reporting and warehouse purposes.
• Maintenance of databases, as well as the creation of new objects such as dim tables, fact tables, views, sp, etc.
• Creation of branches by git, devops with gitlab.