Specialist - Data Services & Infrastructure Almosafer

About the Role

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that enable data-driven decision-making across the organization.

The ideal candidate will have strong backend data engineering expertise and exposure to modern big data and AI-driven ecosystems.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Python or Java.
• Build and maintain ETL/ELT frameworks using Apache Spark (Batch & Streaming).
• Write advanced SQL queries for data transformation, validation, and analytics.
• Develop APIs to share data with other services.
• Integrate data from multiple structured and unstructured sources.
• Collaborate with Data Scientists, Analysts, and Product teams to support analytics and ML use cases.
• Implement data validation, logging, and error-handling mechanisms.
• Optimize pipeline performance and manage large-scale datasets.

Profile Requirements

• Strong programming experience in Python and/or Java And scala.
• Hands-on expertise with Apache Spark (Batch & Streaming).
• Advanced proficiency in SQL (query optimization, indexing, window functions).
• Experience with scripting (Python, Bash, Shell).
• API(Python, Java) Development skills.
• Understanding of distributed systems and big data architectures.
• Good knowledge in AWS services(S3, RDS, Redshift, Glue, EMR, Athena, Lambda, etc.).

Key Skills

• Spark (Batch & Streaming)
• SQL
• Python
• Scala
• Java
• ETL / ELT Pipeline
• AWS (S3, RDS, Redshift, Glue, EMR, Athena, Lambda, etc.)
• Airflow
• Data Modeling & Warehousing
• Batch & Streaming Data Processing
• API & Data Integration
• GenAI Data Integration (LLM, LangChain Good to have)

Soft Skills

• Strong problem-solving and analytical skills.
• Ability to work in a fast-paced, collaborative environment.
• Excellent communication and documentation skills.
• High ownership and accountability.