We’re Hiring: Senior Software Engineer – Java | LLM Evaluation & Repository ValidationWe’re looking for experienced Senior Software Engineers / Tech Leads with strong Java expertise to contribute to an exciting project at the intersection of Software Engineering and AI/LLM research.About the ProjectWe’re building LLM evaluation and training datasets based on realistic software engineering problems. The project involves working with public GitHub repositories to create verifiable SWE tasks that challenge and evaluate modern AI models.What You’ll Work OnAnalyze and triage GitHub issues across trending open-source librariesSet up and configure code repositories, including Dockerization and development environmentsEvaluate unit test coverage and qualityModify and run real-world codebases locally to assess LLM performance in bug-fixing scenariosCollaborate with researchers to identify repositories and issues that are challenging for LLMsPotential opportunities to lead and collaborate with junior engineersWhat We’re Looking For2–6 years of professional experience in Java/software engineeringStrong experience with JavaProficiency with Git and DockerUnderstanding of basic software pipeline setupAbility to navigate and understand complex codebasesComfortable running, modifying, and testing real-world projects locallyExperience contributing to or evaluating open-source projects is a plusNice to HavePrevious experience with LLM research or evaluation projectsExperience building or testing developer tools or automation agentsRole Details: Location: Remote. Role Type: Contractor. Commitment: 40 hours/week. Benefits: Contractor assignment; medical benefits and paid leave are not included.

Senior Software Engineer (Java) – LLM Evaluation & Repository Validation

Emma

Responsibilities

Skills wanted:

Language(s) required:

Isha Malhotra

Isha Malhotra

About ProIntegrate:

mission:

prointegrate.net

Admin access needed