Senior Data Engineer
Silver Edge Arabia
Employer Active
Posted 6 hrs ago
Send me Jobs like this
Experience
5 - 7 Years
Job Location
Education
Bachelor of Science(Computers)
Nationality
Any Nationality
Gender
Not Mentioned
Vacancy
1 Vacancy
Job Description
Roles & Responsibilities
As a Data Engineer within our AI practice, you will ensure our data workflows are efficient, our pipelines are reliable, and our systems are scalable. Your key responsibilities include:
- GenAI Optimization: Building and maintaining data lakes, warehouses, and feature stores specifically optimized for GenAI workloads.
- Pipeline Engineering: Designing and implementing robust ETL/ELT processes and automated workflows using tools like Apache Airflow or Luigi.
- Architecture Design: Developing large-scale, high-performance data architectures that support real-time data processing and streaming.
- Cross-Functional Collaboration: Working side-by-side with Data Scientists and ML Engineers to understand feature engineering and data augmentation requirements.
- Innovation: Exploring and implementing emerging tools and technologies to enhance our evolving GenAI product development.
Technical Requirements:
- Programming: Proficiency in Python is a must. Familiarity with Scala or Java is highly valued.
- Big Data Frameworks: Hands-on experience with Apache Spark or Hadoop.
- Database Mastery: Expert knowledge of SQL and NoSQL (e.g., PostgreSQL, MySQL, MongoDB, Cassandra).
- AI/ML Context: Solid understanding of data preparation for Machine Learning, including MLOps tools and practices (MLflow, DVC).
- Version Control: Experience managing codebases and documentation via Git or GitLab.
Desired Candidate Profile
We are looking for a technical expert who thrives in an Agile environment and has a passion for AI/ML infrastructure.
Technical Requirements:
- Programming: Proficiency in Python is a must. Familiarity with Scala or Java is highly valued.
- Big Data Frameworks: Hands-on experience with Apache Spark or Hadoop.
- Database Mastery: Expert knowledge of SQL and NoSQL (e.g., PostgreSQL, MySQL, MongoDB, Cassandra).
- AI/ML Context: Solid understanding of data preparation for Machine Learning, including MLOps tools and practices (MLflow, DVC).
- Version Control: Experience managing codebases and documentation via Git or GitLab.
Professional Qualities:
- Proven track record in data engineering, preferably within AI/ML environments.
- Strong problem-solving skills and a creative approach to building innovative systems.
- Excellent communication skills with the ability to translate complex technical concepts for non-technical stakeholders.
- Education: Bachelor's degree in Computer Science, Data Science, IT, or a related field.
Company Industry
- Oil & Gas
- Petroleum
Department / Functional Area
- IT Software
Keywords
- Senior Data Engineer
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com
Silver Edge Arabia
Join a thriving company where technology is used to build a more sustainable and inclusive world. You'll gain the experience and connections needed to shape your future while working on projects that have a tangible global impact. Unlock the value of technology with us. Apply today.
https://www.careers-page.com/silver-edge-arabia/job/63X967YR