Data Engineer L2 - Sr. Data Engineer (Databrick Certified) at Net2source | Torre
Data Engineer L2 - Sr. Data Engineer (Databrick Certified)
trending_up Invest in Torre
Net2source

Data Engineer L2 - Sr. Data Engineer (Databrick Certified)

Net2source
Posted by
Gessica Brito Lustosa
Emma
Emma
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time

Legal agreement: Employment

Compensation
USD40 - 43/hour
Negotiable
location_on
Remote (for Brazil residents)
Posted about 1 year ago

Responsibilities

As a Senior Engineer, you will build distributed data processing solutions and high-load database solutions for diverse business cases, including reporting, product analysis, marketing optimization, and financial reporting. You will contribute as part of a self-organizing team of experienced data engineers, working in a challenging and innovative environment for our client, creating the foundation for decision-making in a company that handles billions of events per day. You will investigate, create, and implement solutions for existing technical challenges. You will provide guidance, instruction, direction, and leadership to a development team with the aim of achieving project goals. Key tasks and responsibilities: - Obtains tasks from the project lead or Team Leader (TL), prepares functional and design specifications, and approves them with all stakeholders. - Ensures assigned areas are delivered within established deadlines and required quality objectives. - Provides estimates, agrees on task duration with the manager, and contributes to the project plan for the assigned area. - Analyzes the scope of alternative solutions and makes decisions on area implementation based on their experience and technical knowledge. - Leads the functional and architectural design of assigned areas. Ensures that design decisions in the project meet architectural and design requirements. - Handles risks at the area level, provides and implements a mitigation plan. - Reports on the readiness/quality of the area and raises red flags in crisis situations that are beyond their Area of Responsibility (AOR). - Responsible for resolving crisis situations within their AOR. - Design, develop, and implement large-scale, high-volume, and high-performance data models and pipelines for Data Lake and Data Warehouse. - Develop and implement data quality checks, conduct QA, and implement monitoring routines. Improve the reliability and scalability of our ETL processes. - Initiates and conducts code reviews, creates code standards, conventions, and guidelines. - Suggests technical and functional improvements to add value to the product. - Constantly improves their professional level. - Collaborates with other teams. Required education and experience: Mandatory: - 8+ years of professional experience. - University degree in Computer Science or similar. - 5+ years of experience working in data engineering, business intelligence, or a similar role. - Proficiency in Python programming languages. - Databricks certification required. - Expert in database fundamentals, advanced proficiency in complex SQL, and distributed computing. - 5+ years of experience in ETL orchestration and workflow management tools such as Airflow, Flink, Oozie, and Azkaban using AWS/GCP. - Experience with Spark, Snowflake & Databricks. - Experience working with Snowflake, Redshift, PostgreSQL, and/or other DBMS platforms. - Excellent communication skills and experience working with technical and non-technical teams. - Able to pass the HackerRank coding test.
This job post is closed.