Data Engineer Senior

ACENSI is looking a Senior Data Engineer for one of their clients based in Brussels :

Activities

The main activities are:

Develop within the data framework

Write technical specifications

Write Unit Test

Participating to architecture direction

Provide and Put in place the best practise around data management

Ensure deliveries and respect deadlines

Production Monitoring / Maintenance

Expected skills

General skills (soft skills)

The consultant(s) put forward for this assignment must have sound experience in the activities described above, with high level analytical skills, rigour as well as a great ability to listen and communicate.

Expected technical skills

Technical skills required: (by order of priority for the assignment)

Python V3

Pyspark

Databricks

AWS

Airflow (preferred)

Azure DevOps (TFS or VSTS) (preferred)

Terraform (preferred)

Iomnia / Postman (preferred)

CI / CD (preferred)

C# (preferred)

Expected functional skills

Solid understanding of relational databases (SQL) and data warehouses

Experience with the Databricks platform, including creating and executing ETL tasks, managing Spark clusters, and optimizing SQL queries (preferred)

Ability to collaborate with multidisciplinary teams and communicate effectively with stakeholders (preferred)

Proactive problem-solving skills and the ability to work autonomously (preferred)

Knowledge and skills in the energy market industry (preferred)

Knowledge of portfolio management or risk management or Trading (preferred)

Knowledge in the energy forecasting activities (preferred)

Demonstrated ability to effectively understand customer requirements and deliver innovative solutions that those customer demands (preferred)

Agile methodology (preferred)

Expected behavioural competencies

Strong interpersonal skills with proven ability to interact with a wide variety of stakeholders, assimilate feedback and assess impact on your perimeter

Comfortable with working in a fast-paced multidisciplinary environment while maintaining strict customer data privacy requirements

Capacity to atomize and abstract topics to make them more generic

Entrepreneurial spirit and creative approach to problem solving especially in Digital initiatives

Uncompromising integrity and ethical standards

Expected deliverables

Monthly Time Track

Activity report

KPI dashboard

Estimation of the workload

Documents on his/her delivery