Olga Megorskaya

Olga Megorskaya

About

Detail

CEO of Toloka.ai
Netherlands

Timeline


work
Job
auto_stories
Publication

Résumé


Jobs verified_user 0% verified
  • Toloka
    CEO of Toloka.ai
    Toloka
    Jan 2020 - Current (6 years 6 months)
    Toloka is the leading data partner for all stages of AI development — from training to evaluation. With over a decade of experience building data pipelines for , we deliver the highest quality data and scalability through our optimal combination of machine learning technology and expert human feedback.
  • Yandex
    Head of Crowdsorcing and Platforms
    Yandex
    Jan 2015 - Dec 2020 (6 years)
    Responsible for developing infrastructure and implementing effective use of data labelling by crowdsourcing for all ML-based products of Yandex, including Search (web, multimedia, geo); Voice assistant Alisa, speech technologies for Yandex Cloud; Self-Driving Cars, etc And implementing Human-in-the-loop solutions for majority of human-powered business processes at Yandex, including: Moderation of Ads and UGC Technical support for 80+ services of Yandex Social Media monitoring Manual testing and Quality Assurance using Crowd Spatial crowdsourcing actualisation of data about offline businesses for Maps and Business Directory Generating of content for E-commerce and Ads
  • Yandex
    Head of Search Assessors Service
    Yandex
    Sep 2011 - Dec 2015 (4 years 4 months)
    Responsible for providing all teams of Yandex Search with human labels for ML. Developed and implemented a comprehensive methodology for scalable and automated management of in-house assessors which allowed to grow numbers of in-house labellers from dozens in 2010 to thousands in 2015 without growth in management costs: Automatic selection and hiring of assessors based on specifically developed psychological online testing Automated training and examination of assessors New model of scalable quality control (combination of overlap, honeypots and inter-assessors discussions)
  • Yandex
    Manager of Search quality evaluation
    Yandex
    Mar 2009 - Dec 2011 (2 years 10 months)
    hiring, training, writing guidelines for the team of assessors
  • KIT Finance Investment Bank
    Risk Management Dept
    KIT Finance Investment Bank
    Apr 2008 - Jan 2009 (10 months)
  • Toloka
    Chief Executive Officer
    Toloka
Publications verified_user 0% verified
  • A
    On The Relation Between Assessor's Agreement and Accuracy in Gamified Relevance Assessment
    ACM SIGIR
    Aug 2015
This is a community-created genome.