For companies:
For professionals:
For everyone:
For developers:
Responsibilities
ResponsibilitiesDesign and build data pipelines/flows for ML use casesImplement data versioning practicesDeploy and manage flows in orchestration toolsImprove and maintain CI/CD pipelinesManage Python dependencies (Poetry, uv)Deploy data scientists' scripts and models from notebooks to productionImplement data quality checks to ensure pipeline reliabilityOptimize data processing jobs for performance and cost, particularly on distributed systems and cloud data servicesQualifications3–5 years of experience as a Data EngineerStrong proficiency in PythonExperience with distributed systems for big data processing (Dask, Spark)Experience building ETL pipelinesExperience building reliable, maintainable data pipelinesHands-on experience with GCP core data services (Cloud Storage, BigQuery, Cloud Build, GKE)Experience with orchestration tools (Airflow, Dagster, or similar)Comfortable working in a Linux environment with Jupyter, Python, Git, Docker, SQL, and NoSQLStrong experience with Pandas, SQL, and writing DockerfilesProfessional-level EnglishNice to haveExperience with ML datasetsExperience building data pipelines for AI modelsExperience with LangGraph and RAG systemsOur BenefitsFlexible working environmentVolunteer time offLinkedIn LearningEmployee-Assistance-Program (EAP)NIQ is a publicly traded company, the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights, delivered with advanced analytics through state-of-the-art platforms. NIQ delivers the Full View (TM). We're looking for an experienced Data Engineer to join our growing Machine Learning team. You'll build and maintain the data infrastructure that powers our ML workflows, from raw data ingestion to model deployment.
Closes in:
0
days
0
hours
0
min
0
sec
tune NOT FOR YOU? IMPROVE YOUR RESULTS