Alec Ventura Senior Data Engineer | DataOps

Senior Data Engineer

Clever Real Estate

Jul 2024 - Current (2 years 4 months)

Designed and built a data lake from scratch using the Medallion architecture, implementing scalable ETL workflows with Databricks, Delta Lake, and Airflow (MWAA).

Established the full data pipeline architecture to support analytics and operational use cases. Provisioned infrastructure entirely with Terraform, including MWAA setup, Databricks workspace configuration, and a PostgreSQL RDS instance within a private VPC.

Configured a secure VPN server for access, following AWS best security practices for network isolation and credential management. Developed and optimized ETL pipelines to process MLS and public records data, transforming raw inputs into denormalized tables in PostgreSQL to support operational teams.

Senior Data Engineer

metadata.io

May 2023 - Jul 2024 (1 year 3 months)

Maintained and enhanced ETL workflows using Airflow, Databricks, Python, and SQL, ensuring stability across all data teams company-wide.

Optimized LinkedIn, Google Ads, and Facebook campaign extractors, improving data accuracy and reducing execution time for reports team.

Designed a revenue impact report using PySpark, Databricks, and Airflow, enabling customers to analyze user journey insights and refine marketing strategies.

W

Senior Data Engineer

Wildlife

Jan 2021 - Apr 2023 (2 years 4 months)

Managed and optimized ETL workflows using Airflow, Databricks, Python, and SQL, ensuring data integrity across pipelines for the core data team for one of the world's leading mobile game developers and publishers.

Led the migration of legacy Python APIs from EC2 to Kubernetes (K8s), improving scalability and reducing infrastructure costs.

Built a data quality validation framework using Python's Great Expectations, standardizing data reliability for all data teams company-wide.

Refactored Apple in-app purchase ETL processes, replacing an inefficient ElasticSearch + Python API with a PySpark solution, cutting costs by $55K annually.

Developed Databricks Delta tables with optimized denormalizatio

Data Ops/Data Engineer

Linx

Oct 2017 - Dec 2020 (3 years 3 months)

Architected a high-throughput microservices system (2M RPM) using Scala, Kubernetes, ElasticSearch, DynamoDB, and Kafka for an e-commerce recommendation engine.

Led the migration of MapReduce Hadoop jobs to Spark, significantly improving processing efficiency.

Established monitoring and alerting systems with Prometheus and Grafana, ensuring real-time observability of data infrastructure.

Managed infrastructure automation using Chef, Ansible, and Terraform, reducing instance launch time and enforcing Infrastructure as Code (laC) best practices.

Conducted load testing using Gatling, preparing data systems to handle Black Friday traffic surges.

Migrated two Apache Kafka clusters into

Alec Ventura

About

Detail

Timeline

Résumé

Alec Ventura

About

Detail

Behavioral traits