Data Quality Engineer (Python & Databricks) at AIDA Recruitment | Torre

Data Quality Engineer (Python & Databricks)

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Freelance
Recurrent
Provide your expected compensation while applying
location_on
Remote (for Romania residents)
Shared by
Emma of Torre.ai
5 days ago

Responsibilities


For our customer, we are looking for a Data Quality Engineer (Python & Databricks).Location: Romania (Remote)Contract Type: B2B (rate ~30 - 33 USD/h)In this role, you will be responsible for designing and maintaining automated data validation frameworks that ensure data consistency, accuracy, and integrity across cloud migration initiatives. Working closely with data engineers and platform teams, you will validate data pipelines, processing workflows, and cloud infrastructure while supporting large-scale migrations between AWS and GCP.You will develop automated quality gates, verify data parity across distributed systems, and integrate validation processes into CI/CD pipelines. This role combines strong Python development, data engineering, and cloud platform expertise to ensure production-ready, high-quality data solutions.The Ideal Candidate4+ years of experience in Data Quality Engineering, Data Validation, or Data EngineeringStrong Python programming skills for building automated validation frameworksHands-on experience with Databricks and advanced SQLExperience validating data across distributed systems and cloud platformsStrong knowledge of Kafka, Redis, S3, GCS, and modern data processing architecturesExperience with CI/CD pipelines and Jenkins or similar orchestration toolsUnderstanding of cloud migration projects and data reconciliation techniquesExcellent analytical, troubleshooting, and communication skillsExperience working in Agile environments with English-speaking engineering teamsWhat You Will DoDesign and implement automated data validation pipelines using Python and DatabricksDevelop and maintain data parity checks across ETL and processing layersValidate data integrity across Kafka clusters and downstream systemsVerify replication accuracy, object parity, and stored procedure consistency during cloud migrationsValidate Airflow and Cloud Composer DAG execution, scheduling, retry logic, and alertingBuild automated data quality gates integrated into CI/CD pipelinesMonitor pipeline telemetry and provide validation evidence to support migration readinessCollaborate with engineering teams to identify, troubleshoot, and resolve data quality issuesLeverage AI-assisted development tools to improve validation, test automation, and defect analysisWhat the Company Offers100% remote work from RomaniaB2B contractOpportunity to work on enterprise-scale cloud migration and data platform initiativesModern technology stack including Python, Databricks, AWS, GCP, Kafka, and JenkinsInternational engineering environment with English-speaking teamsExposure to large-scale distributed systems and cloud-native architecturesLong-term project utilizing modern AI-assisted engineering practicesCompetitive compensation and opportunities for professional growth