Data Engineer Java Spark

SQLI

Job description

As a Spark Java Data Engineer, you will be required to:

- Participate in the development and production of streams in Java as well as in evolutions for business teams, including:

The development of batch processing in PySpark and stream processing in Java-Spark.

Testing and data manipulation.

The production of flows.

Bug analysis and fixing.

- Intervene in support of application incidents concerning the Data flows managed by the team.

- Manage your projects from start to finish, from specification analysis to delivery, while ensuring the necessary corrections.

- Carry out priority changes to data flows for the Network's businesses, by:

Developing processing in Java Spark.

Respecting project milestones.

Delivering with quality and carrying out the associated tests.

Optimizing flows to improve resource consumption.

With a strong interest in business use cases and data understanding.

Providing support to users.

Qualifications

Having a Bac+5 in Computer Science or similar field.

Minimum 6 years of experience in a similar position.

Advanced proficiency in the Java language, which is the primary language for this position.

Good knowledge of Spark is highly desired.

Knowledge of Python appreciated, especially for scripting.

Ability to work independently on projects while being able to collaborate effectively with colleagues.

Excellent oral and written communication skills, essential for daily exchanges with business teams.