You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Posted 5 months ago
Requirements and responsibilities
Our MissionFilevine is building the seamless intersection between legal and business by creating a world- class platform to help professionals scale.Role Summary:We're a team of driven, enthusiastic problem solvers with strong backgrounds in machine learning, engineering, product management, legal and operations, on a mission to help attorneys resolve cases faster, for better outcomes. With two established ML teams pushing boundaries in transcription, NLP and GenAI applications, we're now building a critical analytics layer to ensure operational excellence, quality assurance, and continuous improvement across all our AI systems.ResponsibilitiesBuild ML operations analytics tracking pipeline health, costs, latency, and quality metrics across all servicesLead LLM evaluation initiatives using frameworks like Braintrust or Langfuse, designing custom metrics, quality monitoring and LLM observability in generalCollaborate with our data annotation team on prompt engineering and evaluation dataset creationAggregate and operationalize user feedback for model improvementCreate actionable dashboards and insights for ML teams and leadershipHelp define SLAs, cost optimization and failure prevention strategies for our ML pipelinesQualifications3+ years in data science, ML operations, or analytics engineeringExperience with LLM evaluation frameworks and quality metrics designStrong Python, SQL, and data visualization skillsKnowledge of prompt optimization techniquesExcellent communication skills in English to translate technical metrics into business insightsCollaborative mindset with ability to work across machine learning teamsAbility to meet periodically in our Prague office as we value in-person collaborationIndependent contractor statusThis opportunity is for independent contractors and is not intended to establish an employment relationship. Contractors are responsible for their own taxes and compliance with applicable laws in their jurisdiction.Geographic eligibilityThis role is open exclusively to candidates currently residing in, or willing to relocate to, Czechia or Slovakia with the legal right to work in these countries. Unfortunately, we are unable to consider applications from candidates based outside of these locations due to operational and regulatory requirementsPrivacy Policy NoticeFilevine will handle your personal information according to what’s outlined in our Privacy Policy.AI DisclaimerWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Optionally, you can add more information later (benefits, pre-screening questions, etc.)