Find your next role
Discover roles across ambitious teams
4,264 jobs
- More jobs
Mistral
Evaluation Engineer, Applied AI
Paris · On-site · Full time · Mid level
About the role
Shape how enterprise customers measure and trust AI solutions. Deliver evaluation systems to define when AI models are ready for business impact.
What you’ll do
• Design frameworks to evaluate large language model performance. • Build scalable evaluation infrastructure and pipelines. • Develop new evaluation methods for sector-specific capabilities. • Collaborate with customers to create custom evaluation suites. • Partner with research teams to improve models.
What you’ll bring
• 3+ years evaluating ML, LLM, or agentic systems. • Experience implementing AI or ML products with APIs or back-end. • Strong Python coding skills. • Deep understanding of ML concepts and LLMs. • Familiarity with evaluation frameworks and ML libraries.
Life at Mistral
Comprehensive benefits supporting well-being, growth, and work-life balance. Benefits vary by country and include healthcare, parental leave, and wellness programs.
About Mistral
Mistral provides full-stack AI solutions partnering with enterprises in finance, manufacturing, defense, healthcare, and public sector to co-create customized AI systems.