Data Engineer at Edge Staffing | Torre
Data Engineer
trending_up Invest in Torre
Edge Staffing

Data Engineer

Edge Staffing
Posted by
Richard Beach
Emma
Emma
Emma highlights
This highlight was written by Emma’s AI. Ask Emma to edit it.
Full-time
Base compensation
USD80k - 115k/year

+ Health insurance

Non-negotiable
location_on
Hybrid (500 International Pkwy, Lake Mary, FL 32746, USA)
Posted 11 months ago

Responsibilities

Data Engineer Hybrid, Lake Mary, FL SUMMARY Responsible for designing, developing, testing, and maintaining data pipelines and architecture. Data pipelines will ingest data from a variety of sources, then transform and store it for analytical use. ESSENTIAL DUTIES AND RESPONSIBILITIES * Identify, analyze, organize, and store raw data from various mediums (RDBMS, flat files, APIs, etc.). * Develop, test, and deploy scalable data pipelines for critical business needs. * Evaluate, maintain, and enhance current data pipelines and architecture. * Maintain code repositories adhering to proper branching flows. * Build and maintain CI/CD framework and architecture. * Deploy and maintain testing frameworks/suites for data pipelines and CI. * Develop, deploy, and maintain APIs and endpoints for analyst and system use. * Deploy and maintain Kubernetes cluster(s). * Conduct peer code reviews. * Collaborate with business, development, and analytics teams to gather requirements. * Participate in data governance and stewardship programs to enhance control and dissemination of data following best practices. * Develop and maintain technical documentation for pipeline architecture and tooling. REQUIRED SKILLS * Strong object-oriented/functional programming skills. * Python/Scala programming experience. * Proficient with ANSI SQL. * Familiarity with orchestration tools (Dagster preferred), Docker/Podman, CI/CD tools, and version control (git). * Familiarity with lightweight directory access. * Experience or knowledge of Agile Development methodologies and SDLC. * Excellent problem-solving and analytical skills. * Proven ability to extract data from a variety of sources (Relational/Non-Relational Databases, APIs, FTP/SFTP, etc.). * Comfortable using cloud technology platforms (AWS preferred). * Proven ability to take initiative and be innovative. QUALIFICATIONS * Bachelor’s degree from an accredited college or university and/or relevant work experience. * Excellent written and verbal communication skills. * Interpersonal skills to develop relationships within the system to enhance the appropriate flow of information. EDUCATION AND/OR EXPERIENCE College Degree and/or 3–5 years of related experience.
This job post is closed.