Daniel Andrade

Daniel Andrade

About

Detail

Senior Data Engineer (Python/Scala/SQL)
San José, San José Province, Costa Rica

Timeline


work
Job
school
Education
folder
Project
auto_stories
Publication

Résumé


Jobs verified_user 25% verified
  • Turing.com
    Data Engineer public Remote experience
    Turing.com
    Aug 2023 - Current (2 years 9 months)
    • Migrated PL-SQL procedures to Python data pipelines orchestrated by Airflow DAGs to achieve better performance, less code maintenance, and a CI/CD methodology to existing Oracle procedures. The project also consisted of migrating 35 tables from Oracle to PostgreSQL that operated with the new Python pipelines. • Built several web-scraping scripts to be run on demand using Selenium in order to extract data needed for curation to process investigators and facilities information used by other downstream pipelines. • Created scheduled Python ETL jobs to automate the ingestion of files from shared directories into our PostgreSQL database. • Developed, using the Streamlit framework, 5 different apps to be used internally by non-technical u
  • Zagalabs
    Data Engineer Lead verified_user Verified experience
    Zagalabs
    Dec 2021 - Nov 2023 (2 years)
    Managing Scala repositories to run new applications and maintain and optimize current applications. ▪ Applying automation through Databricks with Spark workflows. • Managed and improved the Scala domain modules, responsible for updating 15 tables in the production database, that provide valuable paid analytics to users. • Adding new features to the module, while ensuring the test coverage is always above 70% by adding unit tests and validation tests. • Reviewed all PRs related to the module and provided training sessions and support for onboarding new developers working with anything related to the domain. • Managed lower environments for the domain, including DEV, QA, and STAGE, working with AWS S3 replica and ETL to meet business and
  • A
    Data developer
    APP GROWTH NETWORK
    May 2020 - Dec 2021 (1 year 8 months)
    - Building analytics solutions specific for mobile applications that leverage AI and ML to increase ad performance. - Using ETL tools to make use of various data sources including ad platforms and attribution services. - Learning Data Engineering skills to work along side our CTO in Appollo a master Saas platform for UA/UR intelligence.
  • MGMA
    Founder
    MGMA
    Jul 2018 - Sep 2020 (2 years 3 months)
    - Closed the gap between success in performance and success in business for sports careers by developing an easy-to-use app that manages sports careers content for users. - Created content that can be utilized and shared within teams and their loyal audiences, leading to increased sports performance through stats reporting and generating revenue via subscription channels for users. - Emphasized building the next version of the app with feedback from existing beta users, ensuring continuous improvement and user satisfaction. - Leveraged technical skills in Databricks to run predictive models, enhancing the app's functionality and user experience, while utilizing SQL to manipulate data for effective processing and reporting.
Education verified_user 0% verified
  • U
    Data Engineering Nanodegree
    Udacity Nanodegree
    Jun 2021 - Dec 2021 (7 months)
  • UCAM Universidad Católica San Antonio de Murcia.
    Másters Data Engineering & Sports Data Science
    UCAM Universidad Católica San Antonio de Murcia.
    Jan 2020 - Mar 2021 (1 year 3 months)
Projects (professional or personal) verified_user 0% verified
  • Zagalabs
    Setup Airflow Environment
    Zagalabs
    Jun 2023 - Current (2 years 11 months)
  • Zagalabs
    Learning
    Zagalabs
    Jan 2022 - Current (4 years 4 months)
  • Zagalabs
    Feature development
    Zagalabs
    Dec 2021 - Current (4 years 5 months)
  • I
    Data Aggregation (Ads APIs)
    IVTEC
    Jan 2020 - Dec 2021 (2 years)
Publications verified_user 0% verified
  • MGMA
    https://github.com/Mgmaplus
    MGMA
    Jan 2017 - Current (9 years 4 months)