Send me Jobs like this
Experience
2 - 7 Years
Education
Bachelor of Technology/Engineering(Computers)
Nationality
Any Nationality
Gender
Not Mentioned
Vacancy
1 Vacancy
Job Description
Roles & Responsibilities
Your duties will also involve:
- Maintain and manage website scraping configurations using Python
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
What you will bring along:
- Minimum 2 years of experience in a similar role.
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Desired Candidate Profile
What you will bring along:
- Minimum 2 years of experience in a similar role.
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing (Airflow & DBT preferred).
- Expertise in database technologies, both relational (SQL) and NoSQL.
- Knowledge of cloud platforms, particularly Azure.
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git.
- Hands-on experience with Airflow and/or DBT.
- Experience with Terraform for infrastructure management.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Company Industry
- Consulting
- Management Consulting
- Advisory Services
Department / Functional Area
- IT Software
Keywords
- Data Engineer
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com
Similar Jobs
Data Engineer
DUBAI PROPERTIES GROUP LLC
- 3 - 6 Years
- Dubai - United Arab Emirates (UAE)
Data Engineer & Senior Data engineer (immediate to 30 days NP)banking
Sphere IT Consultants DWC LLC
- 5 - 10 Years
- Dubai - United Arab Emirates (UAE)
Data Engineer
Dicetek LLC
- 5 - 10 Years
- Abu Dhabi , Dubai - United Arab Emirates (UAE)
Data Analyst
Dulsco Group
- 5 - 6 Years
- Dubai - United Arab Emirates (UAE)
MIS & Data Analyst
Ejadah Asset Management Group LLC
- 2 - 3 Years
- Dubai - United Arab Emirates (UAE)