DATA Engineer
Importante Banque
Employer Active
Posted 7 hrs ago
Send me Jobs like this
Nationality
Any Nationality
Gender
Not Mentioned
Vacancy
1 Vacancy
Job Description
Roles & Responsibilities
Responsibilities:
- Ensure the technical design and development of IT assets dedicated to data management and their incoming and outgoing pipelines
- Design, implement, and maintain robust data pipelines to collect and process data from various sources (SQL databases, message files, APIs, etc.)
- Automate the execution and management of data workflows via orchestrators (e.g. Airflow)
- Adapt and improve existing developments to meet business needs in terms of performance and reliability
- Ensure the performance, security and quality of data flows and infrastructure
- Participate in the implementation of tests, CI/CD and good development practices
- Contribute to data quality assurance and compliance with governance standards
Skills:
- SQL: mastery for data querying and manipulation
- Programming: Python (commonly used), possibly Scala for Spark
- Big Data Technologies: Spark, Kafka, HDFS, etc. are an asset
- Orchestration: Airflow or equivalent for task scheduling
- Familiarity with CI/CD tools (GitLab, Jenkins) and DevOps methodologies
Desired Candidate Profile
- SQL: mastery for data querying and manipulation
- Programming: Python (commonly used), possibly Scala for Spark
- Big Data Technologies: Spark, Kafka, HDFS, etc. are an asset
- Orchestration: Airflow or equivalent for task scheduling
- Familiarity with CI/CD tools (GitLab, Jenkins) and DevOps methodologies
Company Industry
- Banking
- Financial Services
- Broking
Department / Functional Area
- IT Software
Keywords
- DATA Engineer
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com
Importante Banque