MANSI THAKUR AI Engineer

Influencer Talent Manager (Freelance) – DRIM Global (Remote)

DRIM Global

Aug 2024 - Dec 2024 (5 months)

As an Influencer Talent Manager (Freelance) for DRIM Global (Remote), I orchestrated seamless campaign execution by coordinating collaborations between advertisers, influencers, and sponsors. I meticulously planned schedules, reviewed deliverables, and ensured strict adherence to corporate compliance throughout campaign lifecycles. My responsibilities included training collaborators on workflows, expectations, and reporting standards to enhance overall efficiency and project coordination. I conducted in-depth data analysis of campaign effectiveness and documented outcomes to inform future strategic initiatives and market analysis. In this capacity, I also evaluated AI-assisted outputs crucial for influencer discovery and campaign workflows

LLM Evaluation & Scenario Testing (Project Work + Practice)

Invisible Technologies

Jun 2023 - Current (2 years 11 months)

In my role focused on LLM Evaluation & Scenario Testing at Invisible Technologies, I was responsible for assessing the quality and performance of AI models in production-like environments. I conducted thorough evaluations of model behavior across various deployment scenarios, ensuring that the systems met quality assurance standards. Collaborating closely with engineering teams, I contributed to the development of testing pipelines and performed code reviews to enhance system outputs. My experience included working with CI/CD workflows and environment configurations, which provided me with practical exposure to DevOps concepts, such as model deployment lifecycles and reliability validation. Additionally, I utilized my knowledge of Django to

Q

Data Analyst – Quantum Analytics (NG), London (Remote)

Quantum Analytics (NG)

Jun 2023 - Jan 2024 (8 months)

As a Data Analyst at Quantum Analytics (NG), I built dashboards and analytical reports using Power BI and Excel, ensuring that insights were both actionable and visually compelling. I queried and validated datasets using SQL to guarantee the accuracy of insights, while also simplifying complex findings for non-technical stakeholders to support informed decision-making. My responsibilities included conducting data quality checks and implementing corrective actions to maintain high standards. Additionally, I evaluated automated and model-assisted analytical outputs, such as predictive insights and trend summaries, by validating them against source data and business rules, which involved assessing accuracy, logical consistency, and completenes

A

AI Data Annotator & Evaluation Specialist (Freelance | Remote)

Jan 2023 - Current (3 years 4 months)

As an AI Data Annotator & Evaluation Specialist (Freelance | Remote), I evaluated LLM-generated outputs for accuracy, logical reasoning, consistency, and adherence to guidelines. I performed scenario-based analysis to identify edge cases, contradictions, and missing assumptions, ensuring comprehensive evaluation of AI outputs. My responsibilities included validating SQL logic, multi-step reasoning, and structured outputs in Otorottock-style projects. I applied the TryRating workflow, Maps Assessment, and policy-based evaluation frameworks to flag failure modes and provide structured feedback aimed at improving AI training quality. Additionally, I supported dataset creation for training and refining modern AI systems. My foundational knowled

I

Intern Engineer – Infinity Arch, India

Infinity Arch

Jul 2022 - Feb 2023 (8 months)

As an Intern Engineer at Infinity Arch, India, I actively contributed to the success of engineering projects by assisting in design review, documentation, and project planning. My role involved analyzing constraints to optimize design feasibility, cost, and timelines, thereby developing strong analytical and problem-solving foundations. I evaluated automated and software-generated outputs within engineering and design workflows, which included reviewing system-generated drawings, calculations, and analysis outputs against project specifications and design standards. This process required identifying discrepancies, assessing accuracy and completeness, and documenting findings, aligning with AI evaluation principles through a criteria-based a

F

Freelancer – Operations, QA, Data & Creative Services (Remote)

Sep 2021 - Current (4 years 8 months)

As a Freelancer in Operations, QA, Data & Creative Services (Remote), I delivered end-to-end project support for over 50 international clients across diverse data, media, and branding projects. Acting as the primary point of contact, I managed requirements, timelines, updates, and escalations, ensuring seamless communication and project flow. I coordinated with external professionals to guarantee quality delivery and smooth handovers, while maintaining comprehensive documentation, conducting quality checks, and establishing feedback loops to enhance repeat business. Balancing multiple concurrent projects across global time zones, I engaged in AI quality assurance and evaluation tasks, reviewing AI-generated outputs against detailed guidelin

MANSI THAKUR

About

Detail

Timeline

Résumé