HPC AI Benchmark specialist

About Eviden

Eviden is the Atos Group brand for hardware and software products with c. € 1 billion in revenue, operating in 36 countries and comprising four business units advanced computing, cybersecurity products, mission‑critical systems and vision AI. As a next‑generation technology leader, Eviden offers a unique combination of hardware and software technologies for businesses, public sector and defense organizations and research institutions, helping them to create value out of their data. Bringing together more than 4,500 world‑class talents and holding more than 2,100 patents, Eviden provides a strong portfolio of innovative and eco‑efficient solutions in AI, computing, security, data and applications.

Benchmark ML Engineer Position

Bull, currently Eviden's Big Data & Security (BDS) division, delivers some of the world's most powerful High‑Performance Computing (HPC) solutions. As a leader in Europe, it advises and supports its clients in solving the most complex scientific problems of today and tomorrow. As part of our development and ambitious future programs, we are recruiting a Benchmark ML Engineer. You will work within the Applications and Performance team (more than 30 Engineers) whose main mission is to respond to HPC & AI calls for tenders. This team plans and guarantees the performance of customers' scientific applications on proposed supercomputers. The position can be based on several Eviden HPC sites in France (Grenoble, Les Clayes‑sous‑Bois, Bruyères‑le‑Châtel, Bordeaux, Rennes, Toulouse or Montpellier). Other sites in Europe are possible. You will be responsible for the preparation, execution, and analysis of AI applications, mainly benchmarks. These benchmarks generally consist of trainings or inferences on a reference data set and rules, to evaluate the performance of the system in terms of time or throughput. Usual benchmarks are taken from the MLPerf suite (Training and Inference Datacenter). The purpose of the benchmarking activity is to characterize the application on current systems to project on target systems latency vs throughput, accuracy vs performance, scaling efficiency, etc. Target systems are computing clusters usually equipped with accelerators (e.g. NVIDIA GPU, AMD GPU, Intel Gaudi GPU, …). Therefore, the benchmarks are run in a multi‑node multi‑accelerator framework. Part of the work consists of estimating the performance of non‑existent systems (new technology, larger size, etc.). Surrounded by passionate and attentive experts, your missions will be multiple. You may be required to make short trips mainly in France and Europe.

Responsibilities

• AI benchmark analysis
• Literature review on the application considered
• Code exploration (if available)
• Match between hardware architecture and hyperparameters
• Benchmark preparation
• Software environment (usually in a container)
• Training and job scripts
• Dataset preparation
• Hyperparameter search
• Documentation
• Benchmark execution and performance estimation
• Test executions
• Analysis
• Reports

Profile

• Relevant degree in higher education or university
• Ideally, several years of experience in the field of AI
• Autonomous with team spirit

Ideal Skills

• Machine / Deep Learning
• Good understanding of the fundamentals of deep learning
• Experience in training classic neural network architectures (MLP, CNN, RNN)
• Transformers and LLM
• Large‑scale distributed training strategies (parallel data, parallel tensors, parallel pipelines, FSPD, DeepSpeed, …)
• Execution environment
• Containers (docker, singularity)
• Job scheduler (SLURM mainly)
• Knowledge of architectures will be a plus (GPU, Network, storage)
• Python
• Bash
• PyTorch, TensorFlow

Let’s grow together.