Senior Software Engineer II - AI Platform

Careem

Architect and implement the foundational services for Careem s Agentic AI Platform, covering agent creation APIs, orchestration pipelines, state machines, and monitoring layers.

Design abstractions for multi-agent collaboration, memory persistence, and reasoning cycles integrated.

Build scalable orchestration frameworks (LangGraph, or custom) that coordinate model calls, context injection, and multi-turn workflows across internal and external agents.

Develop observability and governance systems for AI agents: tracing, metrics, auditing, and self-healing.

Integrate LLM-based and retrieval-augmented components into backend services with strict latency, reliability, and compliance requirements.

Work with data scientists and ML engineers to operationalize models (embedding stores, vector databases, evaluation pipelines, model versioning).

Establish standards for agent safety, lifecycle management, and deployment reliability across Careem s product ecosystem.

Mentor engineers and shape platform-wide engineering practices around AI integration and distributed systems design.

What You ll Need

6+ years of backend or distributed systems engineering experience, with 2 3 years in AI/ML infrastructure or LLM-based systems.

Deep hands-on experience in Python and Go, with production experience in building scalable, event-driven architectures.

Expertise in orchestration and distributed compute (Kubernetes).

Experience in building end-to-end event-drive architecture and data pipelines (Kafka, Airflow and Flink)

Familiarity with agentic frameworks (LangGraph, LangChain, AutoGen) and design of multi-agent or RAG systems.

Experience in integrating LLMs and vector stores (FAISS, Pinecone, Weaviate, Milvus) into backend applications.

Solid understanding of model and agent observability, monitoring, and continuous evaluation.

Strong architectural skills, capable of designing systems that balance scalability, cost, and experimentation velocity.

Experience working with data streaming, metrics, and real-time feedback loops.

Growth mindset and bias for ownership, you thrive in high-autonomy, fast-paced, and purpose-driven environments.