Data Engineer at Benefits Data Trust | Torre

Data Engineer

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Compensation
USD80k - 90k/year
Non-negotiable
location_on
Hybrid (United States)
Posted about 6 years ago

Responsibilities


• Build out our new GCP data platform and collaborate on architectural patterns for it with the Data Engineering team • Support the development of machine learning models with productionizing, monitoring and alerting tools • Write, update, and maintain ETL jobs across our data pipelines (mostly in Airflow) • Implement continuous improvements using our existing tools/technologies, which include SQL, Airflow, Python, Docker/Kubernetes, and others such as Terraform and Apache Beam. May also be expected to research and select other tools when the situation demands • Collaborate with internal customers to identify ongoing platform improvements (teams including Analytics, Projects, Policy, Software Engineering, and others throughout the organization) • Consult to software engineers on data-related changes to BDT’s suite of software applications, including schema/model design, table structure, and data collection • Engage with colleagues and collaborators using curiosity, critical thinking, a drive to completion, empathy, and a focus on the impact • Follow existing data access and performance design standards for the data platform, software engineering, and all products and services accessing BDT information.