Senior Data Engineer

Proximie

Position Overview

We are hiring a senior data engineer based in Beirut to join Proximie s data engineering team. As we grow as a company, our data becomes more important than ever. We need to utilise it to make analytical decisions, store it securely, move it between different systems, all the while ensuring that we adhere to healthcare and data protection regulations. As an AWS partner it is important that the senior data engineer has experience having worked with the cloud provider before, preferably building data lakes and building data pipelines on it.

Responsibilities

• Design, evolve and future-proof scalable data architectures to meet performance, cost, and reliability goals.
• Build and orchestrate resilient batch and real-time data pipelines.
• Data modelling & cataloguing including;
  • Performance Tuning in various technologies (e.g. Spark, Presto, Athena, Postgres)
  • Build automated testing frameworks including implement anomaly detection and validation checks (e.g. with Great Expectations).
• Monitoring & Incident Response including;
  • Enforce data access controls, encryption at rest/in transit, PII masking/anonymization, and collaborate on HIPAA/GDPR (or equivalent) compliance.
  • Manage and version cloud infrastructure using IaC tooling (e.g. Terraform)
• Partner with Data Scientists, Analysts, Product and Business teams to translate requirements into data solutions.
• Drive development of customer-facing data products APIs, timelines, dashboards and support machine-learning data pipelines.
• Mentor junior engineers, champion best practices, document architectures/runbooks/data dictionaries, and standardize coding conventions and CI/CD.

Key Requirements

• BSc in Computer Science or equivalent.
  
• Minimum of 5+ years as a Data Engineer with experience developing and supporting with data lakes, warehouses preferably on AWS.
• Experience designing and building robust data pipelines.
• Experience across a variety of AWS products such as S3, Glue, EMR, Lambda, Aurora or equivalents
• Professional software development experience with Python and SQL
• Able to work as a team to deliver against requirements in a collaborative and agile way.

Desirable Requirements

• Certification from a major cloud provider, ideally AWS Certified Solutions Architect
• Data visualisation experience.
• Experience in creating data systems compliant with HIPAA, GDPR and related frameworks.
• Experience of testing, CI and monitoring data-driven applications.
• Experience working with third-party APIs.
• Experience with dbt, Snowflake or DataBricks.
• Experience with orchestration tools e.g., Airflow.
• Experience with messaging and event-processing platforms.
• Experience with Terraform.
• Building REST/GraphQL APIs.