Data Engineer

We’re looking for an experienced Data Engineer to reinforce our Data team and contribute to our mission: transforming a critical mass of information into actionable insights for the entire company .

You master the full data lifecycle, from development to production. You will join a team in its maturation phase to tackle a major challenge: transitioning from internal data management to massive real-time processing (500,000 events per second). Alongside our Data Ops and our Head of Data, you will be a driving force in the implementation of our Spark environment.

Your missions:

• Design and implement the Spark job flow to process massive real-time data streams.
• Centralize and harmonize heterogeneous sources (Product, Finance, Marketing) to make data accessible and reliable for all Sekoia teams.
• Develop, test, and orchestrate pipelines (via Airflow).
• Propose innovative solutions to ensure the resilience and performance of our platform.
• Empower collaborators by providing the tools they need to leverage high-quality data independently.

This position is based in Paris.

Qualifications and experience:

• 3 to 5 years of professional experience in Data Engineering or Python development with a strong focus on data processing.
• Proficiency in Python and Spark.
• Proactive, autonomous, and mature, taking ownership of subjects.
• Strong interest in Big Data challenges, especially handling massive real-time data streams and high-availability infrastructures.
• Commitment to code quality by following software engineering best practices, including CI and automated testing.
• Experience with orchestration tools, with Airflow being a significant plus.
• Capability to build systems that remain performant under heavy loads (500k events/sec).
• Curiosity about new trends in the data ecosystem and willingness to learn and grow.
• Fluent in English, both written and spoken.
• Bonus: Experience in cybersecurity.

We encourage applicants who may not tick all the boxes to apply, and please indicate in the cover letter why you must be selected.