Databricks Data Engineer / Developer (Enterprise Data Platform) at Paralucent | Torre

Databricks Data Engineer / Developer (Enterprise Data Platform)

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Freelance
Recurrent
Provide your expected compensation while applying
location_on
Remote (for Canada residents)
Shared by
Emma of Torre.ai
3 days ago

Responsibilities


Location: Remote within CanadaClient: Consulting ClientContract Duration: 6 months contractMUST HAVE:3+ years of hands-on Databricks development experience.4+ years of overall Data Engineering, ETL, or Data Integration experience.OverviewOur consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities.The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture. This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment.Key ResponsibilitiesDesign, develop, and maintain data pipelines within the Enterprise Data Platform (EDP).Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements.Make use of an Agentic approach to development and ensure that output matches development standards.Develop scalable and reusable data solutions using Databricks and cloud-based data technologies.Support migration and modernization activities from HANA environments to a modern data platform.Collaborate with Data Architects to implement scalable data models and platform solutions.Develop data transformation logic and workflows to support business and analytics requirements.Ensure data quality, integrity, consistency, and performance across platform solutions.Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns.Participate in code reviews, testing, deployment, and release activities.Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions.Contribute to platform best practices, documentation, and continuous improvement initiatives.Required Qualifications3+ years of hands-on Databricks development experience.4+ years of overall Data Engineering, ETL, or Data Integration experience.Strong experience building ETL/ELT data pipelines and transformation processes.Proven experience working with large and complex datasets.Experience with Agentic frameworks and AI-assisted coding is a value add.Experience developing data solutions within cloud-based platforms.Solid understanding of data warehousing, data lake, and lakehouse concepts.Experience working in Agile delivery environments.Strong problem-solving and analytical skills.Excellent communication and collaboration abilities.Preferred QualificationsExperience supporting large data platform initiatives.Experience in significant data migration efforts.Experience with Azure Data Services and Databricks Lakehouse architecture.Experience with modern data engineering frameworks and best practices.Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives.Experience working in large enterprise or consulting environments.Knowledge of data governance, metadata management, and data quality frameworks.Technical KnowledgeRequiredDatabricksETL / ELT DevelopmentData EngineeringData IntegrationSQLPythonData Pipeline DevelopmentData TransformationData Warehousing ConceptsAgile DeliveryPreferredAzure Data FactoryDelta LakeSpark / PySparkAzure SynapseData Lake ArchitectureCloud Data PlatformsData Governance & Data QualityCI/CD for Data SolutionsKey Skills & ExperienceDatabricks DevelopmentData EngineeringETL/ELT Design & DevelopmentEnterprise Data PlatformsData ModernizationData MigrationData WarehousingCloud Data PlatformsSQL & Python DevelopmentData Quality & ValidationAgile DeliveryStakeholder CollaborationIdeal Candidate ProfileWe are seeking a developer who:Has hands-on Databricks experience and can contribute immediatelyUnderstands enterprise data concepts and platform modernization initiativesHas strong ETL/ELT and data engineering experienceCan partner effectively with architects, project managers, and business teamsIs comfortable working in a fast-paced, highly visible enterprise transformation programCan help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities