Lead AI Inference Engineer

Tether Operations Limited

Posted on 2 Mar

Experience

3 - 8 Years

Education

Bachelor of Science(Computers)

Nationality

Any Nationality

Gender

Not Mentioned

Vacancy

1 Vacancy

Job Description

Roles & Responsibilities

You'll lead a cross-functional pod that spans the full stack, from C++ inference engines to JavaScript applications. Your responsibility is to ensure that local AI capabilities ship reliably and perform well across devices. You'll balance hands-on technical work with team coordination, guiding foundation and middleware engineers toward shared goals.

This role is ideal for someone who understands both the low-level challenges of edge AI and the product-facing needs of app developers, and wants to drive the delivery of cohesive, production-ready local AI systems.

Responsibilities

  • Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx

  • Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments

  • Integrate AI features into existing products, enriching them with the latest advancements in machine learning

  • Managing a cross functional team (pod) made of middleware (JS), foundation (C++), QA and documentation engineers to produce high quality deliverables

  • Regularly assessing, both qualitatively and quantitatively, our position in the market with regards to similar products or platforms

  • Leveraging the expertise of technical architects to ensure robust architectural choices and code quality

  • Ensuring stable releases by following precise internal release processes

Desired Candidate Profile

Excellent programming skills C++

  • Strong experience with Llama.cpp and ggml inference engines, which facilitates the deployment of models to specific GPU architectures
  • Good understanding of deep learning concepts and model architectures
  • Experience with transformers, LLMs, Diffusion Models
  • Demonstrated ability to rapidly assimilate new technologies and techniques
  • Has experience managing a small, specialized, cross functional team (pod) of 3-5 people
  • Has a genuine passion for building good products that improve people's lives
  • A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D

Bonus points if:

  • You have extensive experience with Javascript/Typescript
  • You understand the difficulties, nuances and importance of p2p technology
  • You have experience with any of Vulkan, Metal and OpenCL
  • You have productionized models

Department / Functional Area

Keywords

  • Lead AI Inference Engineer

Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com

Tether Operations Limited

At Tether, we re not just building products, we re pioneering a global financial revolution. Our cutting-edge solutions empower businesses from exchanges and wallets to payment processors and ATMs to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain technology, Tether enables you to store, send, and receive digital tokens instantly, securely, and globally, all at a fraction of the cost. Transparency is the bedrock of everything we do, ensuring trust in every transaction.

Tether Finance: Our innovative product suite features the world s most trusted stablecoin, USDT, relied upon by hundreds of millions worldwide, alongside pioneering digital asset tokenization services.

Tether Power: Driving sustainable growth, our energy solutions optimize excess power for Bitcoin mining using eco-friendly practices in state-of-the-art, geo-diverse facilities.

Tether Data: Fueling breakthroughs in AI and peer-to-peer technology, we reduce infrastructure costs and enhance global communications with cutting-edge solutions like KEET, our flagship app that redefines secure and private data sharing.

Tether Education: Democratizing access to top-tier digital learning, we empower individuals to thrive in the digital and gig economies, driving global growth and opportunity.

Tether Evolution: At the intersection of technology and human potential, we are pushing the boundaries of what is possible, crafting a future where innovation and human capabilities merge in powerful, unprecedented ways.

Read More

https://tether.recruitee.com/o/lead-ai-inference-engineer-100-remote-united-arab-emirates