M

Michael Elliott

About

Detail

Illinois, United States

Timeline


work
Job
school
Education

Résumé


Jobs verified_user 0% verified
  • C
    Senior Data Engineer
    Cross River Bank
    Oct 2023 - Current (2 years 11 months)
    Architected and maintained scalable data pipelines for batch and streaming workloads using AWS Glue, Apache Airflow, and Python, supporting mission-critical data products. Designed and implemented data lakehouse architecture in Databricks using Delta Lake, structured across bronze, silver, and gold layers for governed data access and optimized performance. Led ingestion and transformation of high-volume, multi-format data (JSON, XML, CSV) from APIs, RDBMS, and SaaS platforms into Snowflake, BigQuery, and Azure Synapse. Developed real-time data streaming applications using Apache Kafka, Spark Streaming, and Apache Beam, improving data latency for reporting systems. Created reusable frameworks in PySpark and Scala to connect to data sources l
  • CCC Intelligent Solutions
    Senior Data Engineer
    CCC Intelligent Solutions
    Apr 2020 - Sep 2023 (3 years 6 months)
    Played a key role in the full Software Development Life Cycle, including data analysis, modeling, and ETL design across multiple enterprise platforms. Developed complex ETL pipelines using Informatica PowerCenter, AWS Glue, and Talend, loading data from Oracle, Teradata, and flat files into cloud data warehouses. Automated ingestion and transformation workflows using Apache Airflow, PySpark, and shell scripts across AWS and GCP infrastructure. Engineered real-time streaming jobs using Kafka, Spark Streaming, and Scala for ingestion into HDFS and Parquet formats. Worked with large-scale datasets in HDFS, Hive, HBase, and Cassandra, applying transformations and performance tuning using Spark SQL and RDDs. Built ingestion pipelines to migrate
  • Voice Systems Engineering
    Data Engineer
    Voice Systems Engineering
    Sep 2017 - Mar 2020 (2 years 7 months)
    Collaborated with business stakeholders to gather data requirements, define data models, and translate them into scalable data solutions. Designed and developed ETL processes using SSIS to extract data from SQL Server, Excel, CSV, and text files into target data marts. Created complex reports and dashboards with SSRS and Power BI, including parameterized, drill-down, and matrix reports from both OLTP and OLAP sources. Built and maintained Spark applications on Databricks using Spark SQL and PySpark for data cleansing, aggregation, and transformation. Migrated a legacy Oracle-based data warehouse to AWS Redshift, optimizing schema design and performance. Developed Spark jobs on AWS EMR using Python for processing structured and semi-structur
  • Utah Tech Labs
    Data Engineer
    Utah Tech Labs
    May 2015 - Aug 2017 (2 years 4 months)
    Assisted in designing and developing ETL workflows using Talend to load data from various sources into the data warehouse. Created and optimized PL/SQL procedures and queries to improve data retrieval and processing efficiency. Supported the development of Spark jobs in Scala and Python for batch data processing on AWS EMR and Azure Databricks. Developed Tableau dashboards and reports for business users to visualize and analyze data trends. Managed file transfers and data automation using Talend components and FTP protocols. Participated in building Azure data pipelines with Azure Data Factory and worked with Azure Data Lake Storage. Collaborated with senior team members on data cleansing, transformation, and integration tasks to ensure dat
Education verified_user 0% verified
  • Brigham Young University
    Bachelor of Science (B.Sc.)
    Brigham Young University
    Aug 2011 - Apr 2015 (3 years 9 months)
    Completed a rigorous academic program with a strong emphasis on Computer Science and Data Engineering. Engaged in hands-on projects, collaborative team work, and research that enhanced technical skills and problem-solving abilities. Actively participated in campus organizations and events that developed leadership and communication skills. Gained practical experience through internships and labs, preparing for a successful professional career.