Azure Databricks ETL Data Engineer at Galaxy I Technologies | Torre

Azure Databricks ETL Data Engineer

You will engineer robust data solutions, optimizing performance and ensuring quality for critical systems.
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Provide your expected compensation while applying
location_on
Remote (anywhere)
Match
skeleton-gauges
You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Review preferences
Shared by
Cata Morales
about 2 months ago

Requirements and responsibilities


Responsibilities include designing and developing ETL/ELT pipelines using Azure Databricks, building data transformation workflows using PySpark (Python) & SQL, ingesting data from ADLS Gen2, Azure SQL, and external systems, implementing and managing Delta Lake tables with optimization techniques, ensuring data quality through validation, reconciliation, and error handling, optimizing Spark jobs for performance, scalability, and cost efficiency, integrating pipelines with Azure Data Factory (ADF) and orchestration tools, and supporting deployment, monitoring, and troubleshooting of production pipelines.
Optionally, you can add more information later (benefits, pre-screening questions, etc.)
check_circle

Payment confirmed

A member of the Torre team will contact you shortly

In the meantime, continue adding information to your job opening.