AI Models

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

LLM inference in C/C++

Robust Speech Recognition via Large-Scale Weak Supervision

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A high-throughput and memory-efficient inference and serving engine for LLMs

Inference code for Llama models

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Universal LLM Deployment Engine with ML Compilation

StableLM: Stability AI Language Models

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型

Official inference library for Mistral models

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries