Job Description

Roles & Responsibilities

Lucidya is a leading AI-powered Customer Experience Management (CXM) platform in the MENA region, enabling enterprises to understand, engage, and serve customers across digital channels at scale.

As we move toward IPO-scale, we are rebuilding parts of our platform to achieve:

Extreme reliability (SLO-driven engineering)
High-scale distributed processing (billions of data points)
AI-native architecture (LLM + real-time intelligence)

What You Will Work On Microservices & Distributed Architecture

Design and operate high-throughput, event-driven pipelines across a 100+ microservice ecosystem handling billions of data points
Build and scale distributed messaging systems with RabbitMQ, backpressure management, consumer scaling, and queue health
Develop and maintain API gateway layers with advanced routing (multi-upstream, traffic splitting, environment isolation)
Architect SSO and identity federation for enterprise clients, supporting multi-IdP routing with zero coupling to core services
Define clean service boundaries across ingestion, processing, and delivery pipelines spanning Ruby and Python

Performance & Systems

Diagnose and resolve complex production issues (e.g., deadlocks, queue exhaustion, connection pool saturation) and eliminate root causes
Optimize PostgreSQL for heavy write workloads, contention management, schema design, triggers, and connection scaling
Design and tune Elasticsearch for search, indexing, and real-time Arabic relevance at scale
Make informed trade-offs between multi-process and async architectures based on workload characteristics

Observability & Reliability

Build and maintain observability across a large-scale system using Grafana, Loki, distributed tracing, and SLOs
Own production incidents end-to-end, tracing failures across queues, search systems, and external integrations
Lead root cause analysis and implement preventative measures across multi-service pipelines
Build internal tooling that improves engineering velocity, automation, deployment gating, and review enforcement
Turn architectural principles into enforceable standards and guardrails, not just documentation

Platform Evolution

Drive platform decoupling and service isolation across the system
Contribute to Kubernetes migration and infrastructure modernization
Standardize and improve CI/CD pipelines across services

Stack

Ruby on Rails Python PostgreSQL Elasticsearch Redis RabbitMQ Kubernetes AWS / GCP APISIX Grafana + Loki

Desired Candidate Profile

You improve systems you weren t asked to touch

Read and understand an existing codebase by week one
See a broken system and fix it before anyone asks you to
Have strong opinions about architecture and can back them up with data
Think in systems: latency, throughput, failure modes, and cost at scale
Treat documentation, tests, and observability as non-negotiable defaults and not afterthoughts
Ship fast and without breaking things. Speed and quality are not a trade-off for you
Consistently exceed expectations where meeting the bar is a floor, not a target
Are hungry for hard challenges and actively seek problems at the edge of your limits
Feel a sense of urgency that doesn t require external pressure
Have rebuilt or stabilised something significant and can talk about it concretely

Software Engineer 10x Lucidya