Freelance Senior Data Engineer

Client of Novancy One

MISSION DESCRIPTION. 

The Data Platform implements a Data Centric architecture, the data reference point in our client's information system to break down the company's information silos. It provides this data via API to the entire ecosystem to generalize its processing and consultation in real time and allows us to simplify and accelerate the analytical processing of our data to converge operations and decision-making.

Integrated into the Data Platform teams, the consultant will be responsible for designing, developing and maintaining large-scale data processing solutions, using technologies such as BigQuery, BigTable, Apache Kafka and Apache Spark. The consultant will work closely with the development and production teams to ensure the quality and performance of the solutions implemented.

• Solid development experience with languages ​​such as Scala and/or Java, and a deep understanding of functional programming concepts.
• Proven skills in using data streaming platforms like Apache Kafka , and distributed data processing frameworks like Apache Spark.
• Significant experience in the field of Data and Cloud (GCP or AWS) , in particular services such as Cloud Storage,