Send me Jobs like this
Experience
10 - 15 Years
Job Location
Education
Bachelor of Technology/Engineering(Computers)
Nationality
Any Nationality
Gender
Not Mentioned
Vacancy
1 Vacancy
Job Description
Roles & Responsibilities
Manage and optimize Databricks data platform.
Ensure high availability, security, and performance of data systems.
Provide valuable insights about data platform usage.
Optimize computing and storage for large-scale data processing.
Design and maintain system libraries (Python) used in ETL pipelines and platform governance.
Optimize ETL Processes
Enhance and tune existing ETL processes for better performance, scalability, and reliability.
Skills
Must have
Minimum 10 Years of experience in IT/Data.
Minimum 3 years of experience as a Databricks Data Platform Engineer.
Bachelor's in IT or related field.
Infrastructure & Cloud: Azure, AWS (expertise in storage, networking, compute).
Programming: Proficiency in PySpark for distributed computing.
Proficiency in Python for ETL development.
SQL: Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
Data Warehousing: Experience working with data warehousing concepts and Databricks platform.
ETL Tools: Familiarity with ETL tools & processes
Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.
Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.
Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.
Data Quality Tools: Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo.
Nice to have
Containerization & Orchestration: Docker, Kubernetes.
Infrastructure as Code (IaC): Terraform.
Understanding of Investment Data domain (desired).
Desired Candidate Profile
We are seeking an expert with deep proficiency as a DataBricks Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem.
Company Industry
- IT - Software Services
Department / Functional Area
- IT Software
Keywords
- Databricks Data Platform Engineer/Architect
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com