Job Description

Roles & Responsibilities

MISSION DESCRIPTION.

The Data Platform implements a "Data Centric" architecture, serving as the central data hub within our client's IT system to break down information silos. It delivers this data via APIs to the entire ecosystem, enabling widespread processing and real-time access. This simplifies and accelerates analytical data processing, bridging the gap between operational and decision-making processes.

As part of the Data Platform teams, the consultant will be responsible for designing, developing, and maintaining large-scale data processing solutions using technologies such as BigQuery, BigTable, Apache Kafka, and Apache Spark. The consultant will work closely with the development and production teams to ensure the quality and performance of the implemented solutions.

Experience level : > 7 years

Location : Casablanca, Morocco

Type of mission : Freelance

Start date : ASAP

Annual budgeted projected charge : 220 to 225 JH

REQUIRED TECHNICAL ENVIRONMENT AND EXPERTISE.

Solid experience in development with languages such as Scala and/or Java , and a deep understanding of functional programming concepts.

Proven skills in using data streaming platforms such as Apache Kafka , and distributed data processing frameworks such as Apache Spark .

Significant experience in the field of Data and Cloud (GCP or AWS) , particularly with services such as Cloud Storage, BigQuery, Dataproc, Kubernetes, and other relevant tools for large-scale data management and processing

Good command of BigQuery and advanced SQL , with experience in processing large volumes of data .

Proficiency in CI/CD tools , particularly via GitLab CI/CD and Docker Compose , for the automation of data workflows .

Good knowledge of the Linux environment and command-line tools .

In-depth knowledge of microservices architecture concepts and best development practices .

Experience in writing unit and integration tests to ensure code quality.

Excellent written and oral communication skills : Ability to produce high-quality deliverables and reports.

Knowledge of Kafka-stream, spring boot,

Working in agile methodology (Scrum) , with the ability to collaborate effectively in multidisciplinary teams .

METHODS, ORGANISATIONS AND INTERACTIONS.

Excellent written and oral communication : Good written and oral communication in French for smooth interactions with the profession.

Analytical mindset and continuous improvement : Ability to evaluate code and its impacts , as well as to question existing solutions in order to improve them.

Ability to take a step back : Ability to assess problems objectively and propose solutions for improvement.

Ability to meet deadlines while maintaining high standards.

Team spirit : Ability to collaborate effectively with team members to achieve common goals

LEVEL AND TYPE OF EXPERTISE REQUIRED.

Candidates must hold a Master's degree (Bac+5) from an engineering school or equivalent university degree with a specialization in computer science, or have equivalent significant experience.

Over 7 years of experience in Scala/Java

Experience in the retail or mass distribution sector would be an asset.

Desired Candidate Profile

DESCRIPTION DE LA MISSION.

La Plateforme Data met en uvre une architecture Data Centric , point de r f rence de la data dans le SI de notre client pour casser les silos d information de l entreprise. Elle fournit ces donn es par API l ensemble de l cosyst me pour g n raliser leur traitement et leur consultation en temps r el et permet de simplifier et acc l rer les traitements analytiques de nos donn es pour faire converger l op rationnel et le d cisionnel.

Int gr (e) dans les quipes Plateforme Data le/la consultant(e) aura pour mission de concevoir, d velopper et maintenir des solutions de traitement de donn es grande chelle, en utilisant des technologies telles que BigQuery, BigTable, Apache Kafka et Apache Spark. Le/la consultant(e) travaillera en troite collaboration avec les quipes de d veloppement et de production afin de garantir la qualit et la performance des solutions mises en place.

Niveau d'exp rience :b> >/b>7 ans
Localisation :b> /b>Casablanca, Maroc
Type de mission : Freelance
D marrage: ASAP
Charge pr visionnelle annuelle budg t e : 220 225 JH

Senior Data Engineer (Freelance)
Client of Novancy One

People Looking for Senior Data Engineer (Freelance) Jobs also searched

Senior Data Engineer (Freelance) Client of Novancy One

People Looking for Senior Data Engineer (Freelance) Jobs also searched

Senior Data Engineer (Freelance)
Client of Novancy One