Data Engineer Azure

Client of Novancy One

Context :

As part of a migration project to the Azure cloud, we are looking for a Data Engineer for our client capable of designing, developing and optimizing robust and scalable data pipelines, within a Big Data environment based on a Medallion architecture (Azure Synapse Analytics, Apache Spark, Python/SQL).

• Start date: ASAP
• Location: Casablanca, Morocco

Missions :

• Design and develop data ingestion and transformation pipelines
• Participate in the implementation and evolution of a Data M architecture (Bronze/Silver/Gold)
• Developing Big Data processing with Spark (PySpark / Spark SQL)
• Industrialize data flows on Azure Synapse Analytics
• Optimize the performance of SQL processing and queries
• Ensuring the quality, reliability, and traceability of data
• Implement monitoring and alerting mechanisms
• Participate in technical architecture choices and best practices in Data Engineering
• Collaborating with Data, BI, Data Scientist and third-party teams
• Participate in the testing, deployment, and support phases

Required technical skills:

Cloud & Data Platform

• Azure Synapse Analytics
• Databricks
• Azure Data Lake Storage (ADLS)
• Azure Data Factory (ADF) appr ci
• Architecture Data Lakehouse

Big Data

• Apache Spark, Spark SQL, PySpark
• Optimization of distributed treatments

Development

• Python, advanced SQL, SQL performance management

Architecture Data

• Architecture Medallion (Bronze / Silver / Gold)
• Data modeling, batch workflow management

Tools & Methodologies

• Git
• CI/CD appr ci

Key advantage:

• Experience with generative AI, notably Claude Code (a huge plus)