DATA ENGINEER
About
Sekoia.io repense la cybersécurité pour la rendre encore plus pertinente , efficace et accessible . L'un des principaux défis que nous relevons est d'analyser et de comprendre en permanence les menaces émergentes afin de définir des stratégies appropriées et d'avoir la capacité de les exécuter à grande échelle. En combinant la technologie et une équipe pluridisciplinaire de passionnés de Threat Intelligence, Sekoia.io a un fort impact sur la cybersécurité avec une approche qui brise les silos , qu'ils soient technologiques, organisationnels ou culturels.
Job Description
We’re looking for an experienced Data Engineer to reinforce our Data team and contribute to our mission: transforming a critical mass of information into actionable insights for the entire company . You master the full data lifecycle, from development to production. You will join a team in its maturation phase to tackle a major challenge: transitioning from internal data management to massive real-time processing (500,000 events per second). Alongside our Data Ops and our Head of Data, you will be a driving force in the implementation of our Spark environment.
Your Missions
- Design and implement the Spark environment on Kubernetes to process massive real-time data streams.
- Centralize and harmonize heterogeneous sources (Product, Finance, Marketing) to make data accessible and reliable for all Sekoia teams.
- Develop, test, and orchestrate pipelines (via Airflow).
- Propose innovative solutions to ensure the resilience and performance of our platform.
- Empower collaborators by providing the tools they need to leverage high-quality data independently.
This position is based in Paris.