Data engineer senior at StaffRockIt | Torre

Data engineer senior

Full-time

Legal agreement: Employment

Base compensation
USD2.7k - 3.2k/month

+ Certificaciones AWS

Non-negotiable
location_on
Remote (specific timezone)
public
GMT-06:00 to GMT+00:00
Posted about 4 years ago

Responsibilities


"POSITION ACCOUNTABILITIES Below is a list of skills/attributes that a Data Engineer should possess at all levels but with increasing competency levels as they attain higher levels and titles. ● Deliver consulting projects/work on-time, on budget, and in a way that accomplishes client goals ● Develop and implement technical best practices for data ingestion, data quality, data cleansing, and other data integration/ETL/Engineering-related activities ● Understand and experience maintaining a multi-terabyte enterprise data warehouse with accompanying incremental data pipelines ● Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and modern cloud technologies. ● Conduct or participate in meetings with owners of key system components to fully understand current data and systems environments ● Resolve source data issues and refine transformation rules ● Analyze source system data to assess transformation logic and data quality through data profiling ● Leverage data quality processes to assist with data cleansing requirements ● Work with technical and business representatives to determine strategies for handling data anomalies that are identified ● Design ETL processes and develop source-to-target data mappings, integration workflows, and load processes ● Develop, test, integrate, and deploy data pipelines using a variety of tools and external programming/scripting languages as necessary ● Provide technical documentation and other artifacts for data pipelines, ingestion, integration, or other data solutions ● Identify problems, develop ideas and propose solutions within different situations requiring analytical, evaluative, or constructive thinking in daily work ● Apply creative thinking to identify possible reporting solution alternatives ● Other duties assigned as needed POSITION SKILLS & REQUIREMENTS ● 3+ years of hands-on experience with one or more of these data integration/ETL tools: ○ Azure Data Factory ○ Databricks/Spark ● Experience building on-prem data warehousing solutions ● Experience with designing and developing ETLs, Data Marts, Star Schema ● Experience with building data warehousing solutions in Azure ○ Moving data from on-prem to cloud ○ Designing a data warehouse solution using Synapse or Azure SQL DB ○ Experience building pipelines using Synapse or Azure Data Factory to ingest data from various sources ○ Understanding of integration run times available in Azure ● Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of databases ● Knowledge of scripting languages like Python, and Scala. ● Microsoft Azure Cloud platform certifications (nice to have)