Evaluation Engineer, Applied AI: Build Next-Gen LLM Benchmarks

Mistral is building frontier LLM evals to shape the next generation of flagship models. As an Evaluation Engineer, you will own evals from start to finish, running workshops with customers and internal teams to identify critical industry use cases and design benchmarks to measure them inside real software.

You will source data, define scoring, and run benchmarks on our models and on competitors, then publish results that guide product and go-to-market decisions.