Erin Olson

Data Scientst I

Bank of America

Oct 2024 - Current (1 year 11 months)

• Evaluated outputs of LLMs, summarization, and classification models in terms of linguistic features, target coverage, and risk to provide actionable insights for model developers. • Led the annotation and evaluation strategy for the first Gen AI summarizer for complaint evaluation at Bank of America. Automated calculation of performance metrics using Python and presented results to model developers. • Led initiatives to update Bank of America’s rule-based regulatory classifier model, working with partners from Legal, Regulatory Escalations, Architecture, and Reporting to ensure thorough and accurate coverage for new laws and procedural updates. • Streamlined procedures for development of deterministic and Machine Learning development proj

B

Data Consultant

Bank of America via MatlenSilver

Nov 2023 - Oct 2024 (1 year)

• Investigated issues with the regulatory classification model raised by external stakeholders and team members. • Performed volume, accuracy,and qualitative language analyses for model updates to estimate risk; presented analyses and recommendations to stakeholders. • Provided insights into ASR model performance issues for model owners. • Gathered supporting data for team and individual projects using SQL and Python

Language Engineer

Amazon Web Services (AWS)

May 2021 - May 2023 (2 years 1 month)

• Collaborated with data, engineering, product, and science teams to expand Lex training data collections to 25 different languages, spanning 35 different countries. • Streamlined collection and acceptance procedures for AWS Lex Language Modeling training data, reducing needed internal headcount by 75%. • Collected and maintained language-specific code artifacts and testing datasets needed for AWS Lex intent-based models. • Acted as primary liaison between AWS Lex and external data vendors during the data collection process; developed guidelines for vendors for collecting and evaluating data. • Wrote and edited Python scripts to automate routine steps in collection and maintenance processes. • Investigated customer issues and implemented im

Data Engineer

Amazon

Nov 2020 - Apr 2021 (6 months)

• Automated collection and Quality Assurance procedures for language data from 11 distinct languages spanning 18 different countries. • Developed guidelines for collecting and reviewing audio and text data. • Investigated potential regressions in model performance, in conjunction with others on the Data, Science, and Engineering Teams. • Acted as primary point of contact for external data vendors collecting Language Modeling data. • Collected audio and text data in-house for training and testing. Show less

English Linguist - Prosody

Defined.ai

Jun 2020 - Jul 2020 (2 months)

• Provided thorough and consistent ToBI annotations for recordings of English speech. • Researched the ToBI annotation system as used in the broader linguistic community. • Communicated interpretations of standards and practices to colleagues. • Provided research materials and summaries to colleagues who expressed interest.

Graduate Research And Teaching Assistant

Massachusetts Institute of Technology

Sep 2014 - Sep 2020 (6 years 1 month)

• Implemented existing Machine Learning regression models of sound pattern learning in R and Python. • Wrote Python scripts to curate and extrapolate from open-source linguistic data to generate reasonable training data sets for the regression model. • Evaluated results of models against a corpus of real-world language data. • Improved models to better fit corpus data. • Collected spoken linguistic data both in-person and online; extracted relevant acoustic information and performed statistical analysis. • Developed and lead weekly review sessions for undergraduate and graduate students. • Graded undergraduate assignments and essays. • Presented findings at academic conferences; published findings in proceedings, collections and academic jo

Lab Manager - Experimental Syntax and Semantics Lab (ESSL)

Massachusetts Institute of Technology

Jul 2013 - Jul 2014 (1 year 1 month)

• Advised graduate student researchers designing experimental studies; aided in recruiting participants. • Taught basics of experiment design and statistical analysis to new lab employees. • Developed computer programs for running self-paced reading and forced-choice studies and surveys using Javascript, HTML, MatLab, Python. • Maintained lab computers and eye tracker; installed new equipment and software; fixed errors in experimental scripts. • Ran participants in online language studies; ensured participants understood instructions and performed tasks accurately. • Cleaned and analysed language, reaction time, and eye tracking data collected through lab experiments using Python and R. • Conducted tutorials on how to use automated tools to

M

Research Assistant

McGill

Jan 2012 - Jun 2013 (1 year 6 months)

• Interviewed a language consultant about their language. • Collaborated with the larger research assistant group to develop materials for language teaching using CAN8 software. • Wrote short articles and wiki pages on the grammar of the language under study. • Presented research to peers.

Lab Manager and Research Assistant - Prosody Lab

McGill University

May 2010 - Jun 2013 (3 years 2 months)

• Conducted language studies with participants; ensured participants understood instructions and performed tasks in a comfortable environment. • Kept lab equipment in functioning order; installed new equipment and software. • Ensured experiments were running properly and fixed errors in experiment scripts written in MatLab. • Collaborated with other researchers to design experiments. • Demonstrated the workings of the lab to students of experimental linguistics courses; trained in new employees. • Processed data collected during experiments in Praat, R. • Managed lab bookings for participants and other researchers; managed funds for paying participants; communicated lab needs to the rest of the department. Show less

About

Detail

Timeline

Résumé