AWS Databricks Tech Lead at TechnoGen Inc. | Torre

AWS Databricks Tech Lead

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Provide your expected compensation while applying
location_on
Remote (for United States residents)
Shared by
Juan Fernando Domínguez
6 days ago

Responsibilities


Role: AWS Databricks Tech LeadDesigning and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.Required SkillsExtensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experienceProficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experienceStrong understanding of cloud data architectures (Azure Data Lake, AWS S3, GCP Storage) and related ecosystem - 5+ years of experienceExperience with CI/CD tools and DevOps practices for data engineering - 5+ years of experienceFamiliarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experienceSolid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experienceExcellent communication and problem-solving skills - 5+ years of experienceNote: Please focus on candidates who have demonstrated lead-level accountability, rather than those with experience limited to senior developer responsibilities. The previously submitted profiles appeared to be primarily individual contributors. This role requires someone who can lead client discussions and solutioning, while also coordinating with the offshore team to drive execution. From a technical standpoint, we are specifically looking for strong Databricks expertise on the AWS cloud platform—not Azure. Please target candidates with approximately 12–15 years of experience. Prior experience in Health Plan / Healthcare Payer domain, especially with Interoperability would be quite helpful in this role.