Data Engineer

Role Summary

The Data Engineer is following the project in an agile manner during the entire life cycle: from the very start of the idea with the business teams to the day-to-day in production.

Responsibilities

• Understanding business needs, defining functional requirements and proposing technical solutions in response.
• Designing and developing the data transformation flows (python,SQL,PySpark ?) inside our datalab infrastructure (Dataiku).
• When tested, delivering into production and monitoring the smooth execution on a daily basis.
• Training and coaching the other team members (Index, Quant and Global analytics) to use the datalab platform, and defining good practices (code review, clean code?).

Key Accountabilities

• Exploring new ideas with the business teams (new product, new possible automation?) and refining them.
• Studying the feasibility by identifying the right data sources (internal or external), data processing required and the output format / delivery channels.
• Designing and developing the optimized data processing flow matching with the required level of scalability and performance.
• Coordinating with the business teams to follow the different tasks and progress on the various use cases.
• Writing the associated documentation for the delivered projects.
• Monitoring the use cases running in production on the production Datalab nodes.
• Assuring the quality of the deliverables (peer code review, shared library to mutualize the code...).
• Defining good practices on the datalab topics (flow architecture rules, pre‑production check list?) and distributing them inside the Datalab community.

About the Candidate

• Curiosity, willingness to learn.
• Strong technical skills for data processing with expertise in pandas and/or Pyspark.
• Experience to lead design process with business teams, to gather and challenge needs, to define and explain solutions.
• Ability to quickly master a subject and to be able to challenge business teams on their use cases.
• Good organizational skills to work on multiple projects/ use cases at the same time.
• Team player with ability to work effectively in a changing team environment that demands a high degree of cooperation, flexibility and teaming.
• Excellent people skills and ability to create strong relationships with the different business teams he/she will work with. Good teaching ability to explain technical choices for business people with no IT background.
• Tactical and operational vision to find the right balance between speed and reliability.
• Demanding, pragmatic when needed, flexible, adaptable and innovative in response to changing situations and demands.
• Very strong drive and tenacity to get things done.
• Demonstrating the highest standards of honesty and ethical behavior.
• Challenges ideas that he/she believes are incorrect.

Education & Knowledge

• Fluent in written and verbal English. Fluency in French is a strong plus.
• Data oriented development languages (pandas or pyspark).

Experience

• 3-5 years? experience in one or more of the following: Datalab teams, Commando teams in financial industry, IT (big) data project with a role of development (in pandas or pyspark) data pipelines for production grade usage.
• 2 years? experience with strong involvement inside (or with) business teams for collecting needs, and requirements and designing data solution to answer them.

Equal Opportunity Employer Statement

We are proud to be an equal opportunity employer. We do not discriminate against individuals on the basis of race, gender, age, citizenship, religion, sexual orientation, gender identity or expression, disability, or any other legally protected factor. We value the unique talents of all our people, who come from diverse backgrounds with different personal experiences and points of view and we are committed to providing an environment of mutual respect.