About the Role:-We are looking for a Senior Data Engineer with 10+ years of experience in building scalable data pipelines, data architectures, and data platforms. The ideal candidate will be responsible for designing, developing, and maintaining robust data systems that enable efficient data processing, analytics, and business intelligence.In this role, you will work with large-scale data systems, cloud technologies, and modern data engineering tools to ensure reliable data flow and accessibility across the organization.Key Responsibilities:-Design, build, and maintain scalable ETL/ELT pipelines for data ingestion and transformationDevelop and optimize data architectures, data lakes, and data warehousesWork with structured and unstructured data from multiple sourcesEnsure data quality, integrity, and governance across all data platformsOptimize data pipelines for performance, scalability, and cost efficiencyCollaborate with data scientists, analysts, and business stakeholders to support data needsImplement data security and compliance best practicesMonitor and troubleshoot data workflows and pipeline failuresAutomate data processes and improve data reliabilitySupport real-time and batch data processing systemsRequired Skills & Experience:-10+ years of experience in Data Engineering or related fieldStrong proficiency in Python, Java, or ScalaExtensive experience with SQL and relational/NoSQL databasesHands-on experience with big data technologies (Apache Spark, Hadoop, Kafka)Experience building and managing ETL/ELT pipelinesStrong experience with cloud platforms (AWS, Azure, or GCP)Experience with data warehousing solutions (Snowflake, Redshift, BigQuery)Knowledge of workflow orchestration tools (Airflow, Prefect, etc.)Understanding of data modeling techniques (star schema, snowflake schema)Strong problem-solving and performance tuning skillsPreferred Qualifications:-Experience with real-time streaming frameworks (Kafka Streams, Spark Streaming, Flink)Exposure to DataOps and CI/CD pipelinesExperience with containerization tools (Docker, Kubernetes)Familiarity with data governance and data catalog toolsExperience working in enterprise or regulated industriesBachelor’s or Master’s degree in Computer Science, Engineering, or related fieldRelevant cloud or data engineering certifications
