Data Platform Engineer at WorkNovas Technology Worknovas, LLC | Torre
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Provide your expected compensation while applying
location_on
Remote (anywhere)
Shared by
Jose Aldave
5 months ago

Responsibilities


We are seeking a hands-on Senior Data Engineer/Data Platform Engineer to migrate and rebuild 100+ Databricks pipelines from a legacy AWS environment into a new Databricks platform. This execution-focused role requires strong expertise in Databricks, Spark, and CI/CD modernization. Responsibilities include migrating Databricks jobs and workflows across AWS, developing and optimizing batch and streaming pipelines with Spark (PySpark/Scala), implementing CI/CD pipelines using GitHub Actions, automating deployments with Terraform and Databricks Asset Bundles, and managing data migration across S3. Partner with a small engineering team to meet aggressive timelines. Must-have: Databricks on AWS, Spark (PySpark/Scala), Terraform, GitHub Actions, AWS S3/IAM/Secrets Manager. Nice-to-have: Databricks Asset Bundles, Unity Catalog, multi-account AWS environments, Apache Airflow/MWAA.