F

Fangyuan C

About

Detail

Data Engineer | Python | SQL | Data Model | Cloud Computing | AWS | Azure | Databricks
United States

Contact Fangyuan regarding: 
work
Full-time jobs

Timeline


work
Job
school
Education

Résumé


Jobs verified_user 0% verified
  • Corning Incorporated
    Senior Data Engineer
    Corning Incorporated
    Oct 2022 - Current (4 years)
    - Architected and developed high-performance data pipelines using Apache Spark on AWS to ingest and process over 500 TB of data daily from disparate sources, achieving a 30% reduction in data latency - Designed and implemented a Retrieval-Augmented Generation (RAG) solution leveraging LangChain framework to support IT service desk teams by enabling efficient retrieval of relevant documents, resulting in a 30% reduction in average response time. - Led migration from on-premises data warehouse to AWS S3-based data lake on Databricks Unity Catalog, implementing cost-effective storage and improved data accessibility, resulting in a 40% faster data retrieval. - Utilized Apache Airflow to schedule, monitor, and manage data workflows, building ove
  • Capgemini
    Data Engineer
    Capgemini
    Sep 2021 - Sep 2022 (1 year 1 month)
    - Working with stakeholders and other engineering teams to identify and scope the right data architecture and technology to be used to facilitate analysis of most common Amazon customer behavioral questions. - Architected and developed high-performance data pipelines using Apache Spark on AWS to ingest and process over 500 TB of data daily from disparate sources, achieving a 30% reduction in data latency - Designed data schema for fact and dimension tables to meet business requirements and optimize storage and computation - Developed and implement ETL to ingest large dataset from multiple sources by Python and big data tool(EC2, EMR, S3, Lambda, Glue, Hive, Redshift) - Developed ETL queries from ODS to DM to support PBI report with over 3 b
  • Bridge
    Software Engineer - Data
    Bridge
    May 2019 - Sep 2021 (2 years 5 months)
  • CHINESEINVESTORS.COM
    Software Engineer Intern
    CHINESEINVESTORS.COM
    Oct 2018 - Dec 2018 (3 months)
Education verified_user 0% verified
  • Baruch College
    Graduate Accounting and Information System
    Baruch College
    Jan 2016 - Jan 2018 (2 years 1 month)
  • H
    bachelor, Bachelor's degree Accounting
    Hubei University of Economics
    Jan 2011 - Jan 2015 (4 years 1 month)
This is a community-created genome.