Data Engineer - Freelance

Context

As part of its Target Architecture, ENGIE M&S Belgium set-up Databricks and Dataiku platforms on top of an AWS platform and started migration projects for different use cases implemented in various technologies (SAS, AWS Sagemaker, BW/HANA, etc.).

Job description

We are seeking a skilled Dataiku Expert to join a Project team in charge of rebuilding SAS programs functionalities whom results are used by our Finance Team and our Regulatory Report Team.

Objective is to combine the usage of Databricks (storage / compute) and of Dataiku (data transformation), using as much as possible Dataiku Visual Recipes.

Responsibilities

·       Develop and maintain complex data transformation steps using Dataiku under specific guidelines (dev vs automation node, use of Dataiku’s low code recipes, etc.)

·       Under governance of Tech Lead, leverage Databricks compute to enhance data processing and efficiency (performance, costs)

·       Ensure data quality and integrity throughout the data transformation lifecycle

·       Realize knowledge transfer within the Project team and the Business team which will take over the responsibility to run the projects in the future

Required Skills

·       Proven expertise in using Dataiku for complex data transformation and ELT process, using Visual Recipes and developing Plug-in

·       Strong skills in SQL (and other relevant programming languages like Python) and in data warehousing projects

·       Experience with Databricks and its compute capabilities

·       Ability to work collaboratively with technical and non-technical people

·       Analytical mindset with attention to detail

Qualifications

·       Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.

·       Minimum 5 years of experience in SQL/SAS and Data warehousing

·       Minimum 2 years of experience with Dataiku (Dataiku Developer certification)

Languages

·       Fluent in either Dutch or French

·       Fluent in English