Software Engineer for Training AI Data
Outlier AI
Jul 2024 - Jan 2025 (7 months)
• Evaluated 200+ LLM responses and AI-generated code outputs using rubric scoring and domain-specific metrics to refine model performance, achieving a 4/5 overall average quality score across 5+ projects • Ranked and fine-tuned diverse AI models (general LLMs, image generators, API-driven travel systems) • Audited 20+ annotators' work weekly and authored technical guidelines for annotators and developers, improving code review efficiency and reducing integration issues • Developed 200+ training prompts (algorithms, OOP, system design), boosting model accuracy by directly addressing critical model vulnerabilities