For companies:
For professionals:
For everyone:
Responsibilities
The Core Persona Needed: Software Engineers First, Data Engineers SecondWe are not looking for typical ETL developers who just move data from point A to point B or build a unique pipeline for every single source.As we are building a generic, automated data platform where one single master job handles everything based on configuration parameters. Therefore, we need Software Engineers who happen to work with data. Any change these candidates make will impact the entire system, so they must be abstract, system-level thinkers.Technical Profile BreakdownStrong Core Python & Engineering Foundations: Writing clean, generic, reusable Python code using Object-Oriented Programming (OOP), classes, and functions. They must understand code architecture (e.g., how values/references are passed).Python Packaging & Deployment: Hands-on experience building Python packages, using wheel files, and publishing/serving them via PyPI.Automated Testing: Routine experience writing Unit Tests and Integration Tests in an automated CI/CD setup.CI/CD Tools: Strong familiarity with GitHub Actions for automating builds and deployments.PySpark Core Knowledge: They don't need to be a Databricks wizard, but they must know the engine under the hood. They need to understand: o Optimizing PySpark code when things run slow. o How partitioning and ordering work. o How to speed up heavy data transfers (e.g., tuning JDBC connection parameters to pull huge tables).System Security & Access Controls: Understanding basic security concepts, access-based controls, and how to securely control data access across systems.Experience: 5-8 yearsShift Time: 3 AM - 12 PM ISTNotice Period: Immediate joiner
Closes in:
0
days
0
hours
0
min
0
sec
tune NOT FOR YOU? IMPROVE YOUR RESULTS