Andre Machado Data Engineer @ BairesDev | Microsoft Certified: Azure

Data Engineer

BairesDev

Feb 2023 - Current (3 years 5 months)

I worked as part of a busy team tasked with migrating Pinterest's data from legacy databases to a more modern data lake environment using advanced Microsoft Azure technologies. This included utilizing Azure Data Factory for pipeline orchestration, Azure Synapse/Dataflow for data integration and transformation, and Azure DataBricks for scalable big data processing and performance optimization. Additionally, I used PySpark and Python Pipelines for ETL scripting and automation. This role provided me with extensive experience in collaborative data migration projects and advanced Azure technology applications. • Azure Synapse / Dataflow • Azure DataBricks • Azure OpenAI • PySpark and Python Pipelines • Tableau • PowerBI

Senior Data Engineer

Quartile

Mar 2020 - Jan 2023 (2 years 11 months)

During three years , I served as the sole Data Engineer overseeing the reporting and data domains. I pioneered and implemented all necessary technologies to develop and manage the Azure DataLake architecture, utilizing Synapse and DeltaLakes, along with a three-layer development system using Databricks. I introduced ThreadPool processing in Databricks, significantly reducing processing time in critical projects like the Impression Share Project. I redesigned the Data Granularity and Update System, resulting in a 57% monthly cost reduction on Power BI plans. Additionally, I created an Azure Functions pipeline for Operational Logs and established Development and Staging environments to mitigate data leakage risks in production. I also standar

Data Engineer

Agibank

Nov 2018 - Mar 2020 (1 year 5 months)

• Azure Data Factory/ pipelines • Azure Synapse / Dataflow • Azure DataBricks • Convert user stories to report designs • Requirements analysis • Import data into the Data Warehouse from source systems using ETL with Pentaho/kettle - Microsoft SSIS • Model Development with Microsoft SSAS • Collaborate with internal teams to identify reporting requirements, design features and specifications • Design and implement security and distribution architecture for reports • Debug reporting problems and issues • Support all facets of data modeling and data management activities • Dashboards development • ETL Development • SCRUM framework • PLSQL Development • T-SQL Development • Microsoft PowerBI • SQL Server DBA • Microsoft SSIS /

Oracle PLSQL II Analyst

TOTVS

Jun 2016 - Dec 2017 (1 year 7 months)

Development of procedures, packages, triggers, function, tuning, database migration (ETL), lifting ERP data. Loads from files or other databases. Automatization load routines and data extraction.

C

Qlikview Consultant

Campos de Ceres

Jul 2015 - Mar 2017 (1 year 9 months)

• Convert user stories to report designs • Integration of extensions • Azure Data Factory • Azure Spark and Databricks • Web Extensions Development to integrate with Qlik Sense • Requirements analysis • Layout (Front-End) development • Import data into the Data Warehouse from source systems using ETL • Collaborate with internal teams to identify reporting requirements, design features and specifications • Design and implement security and distribution architecture for reports • Extensions (plugins) development • Debug reporting problems and issues • Support all facets of data modeling and data management activities • Dashboards development • ETL Development • SCRUM framework • PLSQL Development

C

Plsql Developer

CONFEDERAÇÃO SICREDI

Jul 2015 - Dec 2017 (2 years 6 months)

Outsourcing • RedHat • SVN • Documentation • USD

Data Analyst

HP

Jun 2014 - Jul 2015 (1 year 2 months)

Database Migration Oracle and SQL Server, planning, analysis and documentation. Database creation and its structures (tables, triggers, procedures, indexes, views, etc.), analyze and develop routines for optimization of databases. ER Development, Enterprise Manager use Microsoft Project, versioning systems (SVN) routines documentation. Development of backup jobs, logs, maintenance, data recovery, scheduled routines, jobs, schedules. Java development, backend programming, mapping the bank through hibernate and development of webservices. Using multiple OS as Oracle Linux, RedHat, Windows Server. Using virtual machines, remote access and cloud.

S

Analyst ORACLE PLSQL II

Stefanini - Dell

Feb 2013 - Jun 2014 (1 year 5 months)

Development of procedures, packages, triggers, function, tuning, database migration (ETL), lifting ERP data. Loads from files or other databases. Automatization load routines and data extraction. Installation and database configuration.

System Analyst / PLSQL

PUCRS - Pontifícia Universidade Católica do Rio Grande do Sul

Aug 2010 - Jun 2012 (1 year 11 months)

Web systems development in Java using JSP and frameworks like some hibernates, JSF, RichFaces, Spring, among others. Analysis and Development of internal systems to the functioning of the university, maintenance and new developments in the enrollment system, physical space, among others. Development system for internships sector, development of heart monitoring software (hospital are lucas PUC), turnstile control, electronic messaging system, security system, the student portal, among others.

C

Computer and Network Technician

Casa Generalizia Dei Fratelli delle Scuole Cristiane

Aug 2009 - Jul 2010 (1 year)

Management of network servers, installation of new equipment, maintenance of network equipment such as routers, switches, expansion project and wireless network, internal system development for communities to register. Done in PHP / Symfony using MySql database.

C

System Analyst / Developer

CNM - Congresso Nacional de Municipios

Sep 2007 - Jun 2009 (1 year 10 months)

Working as developer in a Java system to make data migration between different types of databases. Using only standard api and JDBC without specific frameworks for Java, accessing system databases such as Interbase, MySQL, Postgres, SQL Server, among others in order to migrate to Oracle.

Andre Machado

About

Detail

Timeline

Résumé