Vi Tran

G

Data Engineer

GAION Co. Ltd

Sep 2024 - Current (1 year 10 months)

• Developed and deployed a high-performance data streaming pipeline for real-time anomaly detection in Korea's banking sector. • Designed a scalable pipeline using Redpanda (Kafka) to aggregate and process logs from multiple sources. • Enabled efficient storage, indexing, and visualization of data in OpenSearch, improving monitoring and alerting. • Integrated Logstash and Splunk for enhanced log processing and analysis.

Data Engineer - Freelance

Consensys

Apr 2024 - Sep 2024 (6 months)

• Building an end-to-end data pipeline and ETL system for scraping and processing product information, ratings, and reviews from major e-commerce platforms, including Amazon, Tokopedia, Taobao, JD.com, and Shopee. Leveraged Talend and dbt for data modeling and transformation, ensuring efficient ingestion, transformation, and integration into a centralized repository. • Built robust ETL workflows using Apache Airflow to automate and streamline data processing tasks, optimizing reliability and scalability across the pipeline. • Integrated processed data into Snowflake, ensuring optimal storage, retrieval performance, and data consistency for downstream analysis and reporting. • Designed and implemented deep learning models within the data

O

Data Engineer Analytics

Opus Match

Apr 2022 - May 2024 (2 years 2 months)

• Led the design and deployment of a recommendation system that analyzed candidate behaviors to deliver real-time, personalized job matches and suggestions, enhancing user engagement and job relevance. • Optimized Large Language Models (LLMs) tailored for healthcare-specific tasks, including resume parsing and conversational AI, streamlining feature engineering for various machine learning models. • Collaborated closely with front-end engineers to build an ETL pipeline that captured user behavior data across web and mobile, powering a personalized recommendation engine. • Developed and visualized SEO performance reports with BI tools such as AWS QuickSight and Apache Superset, providing actionable insights for content optimization. • A

K

Machine Learning Engineer

Kyanon Digital

Nov 2021 - Apr 2022 (6 months)

• Developed robust web scraping solutions using BeautifulSoup and Selenium for efficient data collection. • Implemented asynchronous task distribution systems using Celery and RabbitMQ to optimize processing workflows. • Developed a Face Recognition system: ∗ Designed and implemented workflows for data collection, sampling, model training, and evaluation. ∗ Created an intuitive user interface using Streamlit for system interaction and result visualization.

About

Detail

Timeline

Résumé