We are seeking a highly technical Data Architect with strong hands-on expertise in Azure Databricks, PySpark, SQL, Delta Lake, and modern data architecture. This role will design scalable enterprise data platforms and review complex data engineering implementations for MedTech Supply Chain transformation.Key ResponsibilitiesArchitect scalable Lakehouse & Medallion frameworks using Azure Databricks.Design conceptual, logical, and physical data models for MedTech Supply Chain.Define ingestion, transformation, curation, and consumption layers.Implement batch, incremental, CDC, and streaming pipelines.Review PySpark/Spark SQL solutions and optimize workloads for performance & cost.Establish metadata-driven frameworks, data quality, lineage, and governance.Lead Delta Lake implementations (MERGE, schema evolution, historical processing).Define CI/CD standards and security with Unity Catalog.Collaborate with Data Engineers, Product Managers, and business stakeholders.Required Experience10+ years in Data Engineering / Data Architecture.Strong hands-on Azure Databricks, PySpark, SQL, and Lakehouse Architecture.Experience with Delta Lake, Unity Catalog, metadata-driven pipelines, and data-quality frameworks.Background in large-scale enterprise data platforms.Knowledge of Vector Databases, Knowledge Graphs, Ontology, and semantic modeling.Strong SAP Supply Chain data knowledge preferred.Core Technical SkillsAzure Databricks • Apache Spark • PySpark • SQL/Spark SQL • Delta Lake • Unity Catalog • Databricks Workflows • Auto Loader • CDC • Structured Streaming • Medallion Architecture • Data Modeling • Metadata & Lineage • Performance TuningMedTech Supply Chain KnowledgeMaterials • Inventory • Sales Orders • Purchase Orders • Deliveries • Shipments • Manufacturing • Demand & Supply Planning • ATP • Lead Times • Order FulfillmentPlease share resume to lavanya@diligenttec.com
19 days ago