Python / PyTorch Developer Frontend Inference Compiler

Cerebras Systems

Would you like to participate in creating the fastest Generative Models inference in the world? Join the Cerebras Inference Team to participate in development of unique Software and Hardware combination that sports best inference characteristics in the market while running largest models available.

Cerebras wafer scale inference platform allows running Generative models with unprecedented speed thanks to unique hardware architecture that provides fastest access to local memory, ultra-fast interconnect and huge amount of available compute.

You will be part of the team that works with latest open and closed generative AI models to optimize for the Cerebras inference platform. Your responsibilities will include working on model representation, optimization and compilation stack to produce the best results on Cerebras current and future platforms.

Responsibilities:

• Analysis of new models from generative AI field and understanding of impacts on compilation stack
• Develop and maintain model definition framework that consists of model building blocks to represent large language models based on PyTorch and Cerebras dialects ready to be deployed on Cerebras hardware.
• Develop and maintain the frontend compiler infrastructure that ingests PyTorch models and produces an intermediate representation (IR).
• Extend and optimize PyTorch FX / TorchScript / TorchDynamo-based tooling for graph capture, transformation, and analysis.
• Collaboration with other teams throughout feature implementation
• Research on new methods for model optimization to improve Cerebras inference