Data Engineer

Client of Talentmate

Synopsis

The Data Engineer will be responsible for designing, building, and maintaining the organisation s modern data infrastructure, including the development of scalable data pipelines and the management of large, complex datasets within Azure Databricks and the broader Azure data ecosystem. In partnership with engineers, analysts, and data scientists, they will ensure data is reliable, accessible, and optimised for analytics, data science, and product decision-making, while contributing to the ongoing evolution of the organisation s data platform.

Accountabilities

• Design, develop, and maintain scalable data pipelines on Azure Databricks
• Build robust workflows for both batch and streaming data pipelines using Spark and Delta Lake
• Ingest and process data from diverse sources into Azure Data Lake Storage (ADLS) and Azure Synapse Analytics
• Collaborate with cross-functional teams to define data models, transformation logic, and business rules
• Apply data warehouse design principles, including data modeling and partitioning strategies
• Work with both structured and unstructured data formats
• Apply data governance practices such as cataloging, lineage tracking, and compliance
• Monitor, troubleshoot, and optimize pipeline performance, reliability, and data quality
• Automate workflows using orchestration tools such as Azure Data Factory or Apache Airflow
• Enforce data governance and security standards in alignment with organizational compliance requirements
• Troubleshoot and resolve data-related issues and pipeline failures
• Continuously drive process improvements for faster, more reliable data delivery
  
  

Education & Experience

• 4+ years of experience as a Data Engineer, Data Platform Engineer, or in a similar role
• Bachelors degree in computer science, Engineering, Information Systems, or a related field
• Hands-on experience with Azure Databricks, Spark, and Delta Lake to build and manage scalable ETL/ELT processes
• Strong Python, PySpark and SQL skills for data engineering and scripting tasks
• Experience with Azure Synapse, SQL Data Warehouse, or similar technologies
• Proficiency working with Azure Data Lake (Gen2) for storage and data processing
• Experience using Azure Data Factory for data orchestration
• Experience handling structured and semi-structured data formats (e.g., JSON, Parquet)
• Exposure and hands-on experience with Unit Testing and Data Testing suits is highly desirable and experience with tools such as
• Basic knowledge of Linux shell scripting and source control systems such as Git
• Exposure to other cloud platforms such as AWS or GCP is a plus
  
  

About Etihad Airways

Etihad Airways, the national airline of the UAE, was formed in 2003 and quickly went on to become one of the world s leading airlines. From its home in Abu Dhabi, Etihad flies to passenger and cargo destinations in the Middle East, Africa, Europe, Asia, Australia and North America. Together with Etihad s codeshare partners, Etihad s network offers access to hundreds of international destinations. In recent years, Etihad has received numerous awards for its superior service and products, cargo offering, loyalty programme and more. All this ties into Etihad s ambitious Journey 2030 strategy. The airline plans to double its fleet size and triple the number of customers over the next six years as it sets out to be the airline everyone wants to fly!

To learn more, visit etihad.com

Recruitment Fraud Alert

Beware of fraudulent job offers from individuals or organizations claiming to represent the Etihad group. We will never ask for personal information, bank details, or payment during the recruitment process. Interviews are conducted face-to-face or via video/telephone before any formal offer. If you are asked for money, please treat it as fraudulent.

Job Details