Data Engineer MS Fabric PySpark

SQLI Maroc

Employer Active

Posted 4 hrs ago

Experience

3 - 8 Years

Job Location

Rabat - Morocco

Education

Bachelor of Technology/Engineering(Computers)

Nationality

Any Nationality

Gender

Not Mentioned

Vacancy

1 Vacancy

Job Description

Roles & Responsibilities

Your main tasks will be:

  • Design, develop and maintain large-scale data pipelines using PySpark.
  • Set up data flows with Azure Data Factory, integrating various data sources and destinations (SQL, Data Lakes, APIs, etc.).
  • Ensure the integration of data from various systems in a cloud environment (Azure).
  • Optimize the performance of data processing (SQL, PySpark, etc.).
  • Collaborating with business teams, data analysts and data scientists to understand needs and propose effective and scalable solutions.
  • Participate in defining the data architecture and governance strategy.
  • Set up and monitor data processing jobs (error handling, performance management).
  • Document the solutions implemented and follow best development practices.
  • Participate in the continuous improvement of existing processes and tools.

Desired Candidate Profile

Formation et exp rience :

  • Master's degree (Bac +5) in computer science, data science, or an equivalent field.
  • Minimum of 3 years of experience in a similar role, with proven experience in development on PySpark and Azure Data Factory.

strong>Comp tences techniques :/strong>

  • Mastering PySpark for processing massive data in a distributed environment.
  • Significant experience in setting up and managing Azure Data Factory for creating and orchestrating data pipelines.
  • Solid experience in relational and non-relational databases (SQL, NoSQL).
  • Knowledge of data management tools in the Azure ecosystem (Azure Data Lake, Azure SQL Database, Azure Blob Storage, etc.).
  • Practical knowledge of Azure cloud services and their use in data processing solutions (Azure Databricks, Azure Synapse Analytics, etc.).
  • Experience with version control tools (Git, Azure DevOps, etc.) and good software development practices.
  • Knowledge of the concepts of Big Data and performance optimization in distributed environments.

Personal skills:

  • Autonomy, rigor and attention to detail.
  • Excellent ability to solve complex technical problems.
  • Good communication skills and ability to work in a team.
  • Analytical mindset and ability to understand business needs in order to propose appropriate solutions.

Company Industry

  • IT - Software Services

Department / Functional Area

  • IT Software

Keywords

  • Data Engineer MS Fabric PySpark

Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com

SQLI Maroc

Our mission for the past 30 years? To be there at the right time!

Our expertise? We help our clients capture user attention and transform fleeting interactions into memorable ones. With this in mind, we support companies in implementing and managing digital solutions for a reinvented user experience.

What is the right interaction? It's capturing our attention at the right time, in the right place, and converting it into desire and trust. A subtle balance between too much and too little. Between too early and too late.

Become an SQL employee and be part of this great adventure within a human-sized company with big ambitions. We are more than 2,200 talented individuals across more than 13 countries and 3 continents.

Our culture? /strong>br> strong>Oser et cr is.

Read More

https://jobs.smartrecruiters.com/SQLI1/744000127635739-data-engineer-ms-fabric-pyspark

  • Home
  • Jobs in Morocco