GCP Data Engineer at Lakshya Software Technologies | Torre

GCP Data Engineer

Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Compensation INR3M/year
~USD31.5k/year
Negotiable
location_on
Remote (for India residents)
Posted 2 months ago

Responsibilities


Technical Leadership & Mentorship: - Lead and guide an offshore BAU production support team ensuring seamless overlap with US working hours. Hands-On Production Support: - Act as the ultimate point of escalation for troubleshooting, debugging, and resolving pipeline failures for data issues. Pipeline Management & Optimization: - Oversee the data flow architecture (Data Lake to Dims/Facts). - Execute complex SQL fixes, DAG updates, data backfills, and system validations. Rigorous Change Control: - Ensure all production deployments have comprehensive evidence, testing, and robust rollback plans before execution. Continuous Improvement: - Identify recurring issues in the data pipelines. - Implement proactive, automated solutions using Python and SQL to reduce technical debt and manual toil. Required Skills & Experience: - 8+ years of dedicated Data Engineering experience with a proven track record of acting in a Team Lead or Technical Lead capacity. - Deep hands-on expertise in Google BigQuery including advanced concepts like Slowly Changing Dimensions (SCD Type 1/2), partitioning, clustering, and cost optimization. - Extensive experience building and maintaining complex DAGs in Apache Airflow / Cloud Composer including proficiency with Jinja templating. - Strong proficiency in Python for data manipulation, automation, and API integration. - Deep understanding of production support workflows, incident management, and strict ITIL/Change Control processes. - Excellent communication skills with the ability to provide reliable overlap with standard US working hours. Preferred Qualifications: - Strong foundational knowledge of the Kimball Data Warehouse methodology (Star Schemas, Dimensions, Facts). - Experience extracting, transforming, and loading data from Salesforce. - Prior experience leading, mentoring, or collaborating with offshore BAU/Support engineering teams.