Senior Machine Learning Engineer
Employment Hero
Jul 2023 - Jun 2024 (1 year)
• Implement an advanced RAG multi-vector retriever, including parent-child document, summary, hypothetical queries and self-query to increase retrieval accuracy while retaining the contextual information.
• Use different query transformation methods to improve retrieval, such as rewrite-retrieve-read, step-back prompting, condensed/standalone question, multi-query retrieval and RAG-fusion.
• Implement re-ranking as a second stage to rank retrieved documents using relevance scores.
• Use multimodal LLM to produce summaries from images, then pass them to the LLM for answer synthesis.
• Store long-term historical chat and user feedback for analytics and reinforcement learning (RLHF).
• Plan the LLM RAG evaluation strat