Repositories list

• vllm

  Public

  vllm-project/vllm’s past year of commit activity
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17

  amdcudainferencepytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •16k16k forks•78k78k stars•1.9k1.9k issues•2.6k2.6k pull requests•Updated Apr 24, 2026Apr 24, 2026

• vllm-omni

  Public

  vllm-project/vllm-omni’s past year of commit activity
  A framework for efficient model inference with omni-modality models

  inferencepytorchtransformer+ 6

  inferencepytorchtransformerimage-generationdiffusionmodel-servingmultimodalvideo-generationaudio-generation

  Python

  •

  Apache License 2.0

  •825825 forks•4.5k4.5k stars•405405 issues•334334 pull requests•Updated Apr 24, 2026Apr 24, 2026

• tpu-inference

  Public

  vllm-project/tpu-inference’s past year of commit activity
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •169169 forks•300300 stars•5353 issues•179179 pull requests•Updated Apr 24, 2026Apr 24, 2026

• speculators

  Public

  vllm-project/speculators’s past year of commit activity
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •7676 forks•364364 stars•1616 issues•2121 pull requests•Updated Apr 24, 2026Apr 24, 2026

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •128128 forks•3838 stars•22 issues•7171 pull requests•Updated Apr 24, 2026Apr 24, 2026

• recipes

  Public

  vllm-project/recipes’s past year of commit activity
  Common recipes to run vLLM

  JavaScript

  •

  Apache License 2.0

  •239239 forks•738738 stars•1818 issues•4848 pull requests•Updated Apr 24, 2026Apr 24, 2026

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6

  inferencetransformermodel-servingmlopsascendllmllmopsllm-servingvllm

  C++

  •

  Apache License 2.0

  •1.1k1.1k forks•2k2k stars•1.4k1.4k issues•418418 pull requests•Updated Apr 24, 2026Apr 24, 2026

• vllm-metal

  Public

  vllm-project/vllm-metal’s past year of commit activity
  Community maintained hardware plugin for vLLM on Apple Silicon

  Python

  •

  Apache License 2.0

  •9797 forks•964964 stars•44 issues•11 pull request•Updated Apr 24, 2026Apr 24, 2026

• vllm-xpu-kernels

  Public

  vllm-project/vllm-xpu-kernels’s past year of commit activity
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •5151 forks•3636 stars•1414 issues•3030 pull requests•Updated Apr 24, 2026Apr 24, 2026

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

  kubernetesrustgolang+ 15

  kubernetesrustgolangmcpfine-tuningpii-detectionmixture-of-modelshuggingface-transformersbert-classificationllm+ 8

  Go

  •

  Apache License 2.0

  •639639 forks•3.8k3.8k stars•102102 issues•7272 pull requests•Updated Apr 24, 2026Apr 24, 2026

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  HTML

  •8787 forks•3636 stars•11 issue•44 pull requests•Updated Apr 24, 2026Apr 24, 2026

• flash-attention

  Public

  vllm-project/flash-attention’s past year of commit activity
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.6k2.6k forks•121121 stars•00 issues•2323 pull requests•Updated Apr 24, 2026Apr 24, 2026

• router

  Public

  vllm-project/router’s past year of commit activity
  A high-performance and light-weight router for vLLM large scale deployment

  Rust

  •

  Apache License 2.0

  •7272 forks•200200 stars•1313 issues•1919 pull requests•Updated Apr 24, 2026Apr 24, 2026

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •392392 forks•2.3k2.3k stars•9797 issues•6565 pull requests•Updated Apr 23, 2026Apr 23, 2026

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •562562 forks•4.8k4.8k stars•285285 issues•4040 pull requests•Updated Apr 23, 2026Apr 23, 2026

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  compressionquantization

  compressionquantization

  Python

  •

  Apache License 2.0

  •490490 forks•3.2k3.2k stars•6363 issues•5959 pull requests•Updated Apr 23, 2026Apr 23, 2026

• ci-infra

  Public

  vllm-project/ci-infra’s past year of commit activity
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  HCL

  •

  Apache License 2.0

  •6868 forks•3535 stars•00 issues•4242 pull requests•Updated Apr 23, 2026Apr 23, 2026

• compressed-tensors

  Public
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •8383 forks•274274 stars•1212 issues•1414 pull requests•Updated Apr 22, 2026Apr 22, 2026

• guidellm

  Public

  vllm-project/guidellm’s past year of commit activity
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •146146 forks•1.1k1.1k stars•6363 issues•2424 pull requests•Updated Apr 22, 2026Apr 22, 2026

• vllm-daily

  Public

  vllm-project/vllm-daily’s past year of commit activity
  vLLM Daily Summarization of Merged PRs

  44 forks•5050 stars•00 issues•00 pull requests•Updated Apr 20, 2026Apr 20, 2026

• FlashMLA

  Public

  vllm-project/FlashMLA’s past year of commit activity
  C++

  •

  MIT License

  •1k1k forks•1111 stars•00 issues•33 pull requests•Updated Apr 20, 2026Apr 20, 2026

• dllm-plugin

  Public

  vllm-project/dllm-plugin’s past year of commit activity
  vLLM plugin for block-based diffusion language model (dLLM) support

  Python

  •

  Apache License 2.0

  •55 forks•1212 stars•1111 issues•00 pull requests•Updated Apr 16, 2026Apr 16, 2026

• agentic-api

  Public
  Stateful API logic for agentic applications using vLLM

  Python

  •

  Apache License 2.0

  •99 forks•2323 stars•11 issue•33 pull requests•Updated Apr 16, 2026Apr 16, 2026

• bart-plugin

  Public
  vLLM Model plugin for the encoder-decoder BART model

  Python

  •

  Apache License 2.0

  •77 forks•1111 stars•22 issues•66 pull requests•Updated Apr 10, 2026Apr 10, 2026

• vllm-skills

  Public

  vllm-project/vllm-skills’s past year of commit activity
  Agent skills for vLLM

  Shell

  •

  Apache License 2.0

  •1919 forks•6666 stars•33 issues•22 pull requests•Updated Apr 3, 2026Apr 3, 2026

• vllm-neuron

  Public

  vllm-project/vllm-neuron’s past year of commit activity
  Community maintained hardware plugin for vLLM on AWS Neuron

  awsinferentiaaws-neuron+ 1

  awsinferentiaaws-neurontrainium

  Python

  •

  Apache License 2.0

  •1111 forks•2929 stars•33 issues•11 pull request•Updated Mar 20, 2026Mar 20, 2026

• perf-dashboard

  Public

  vllm-project/perf-dashboard’s past year of commit activity
  Performance dashboard for vLLM

  Python

  •22 forks•11 star•00 issues•11 pull request•Updated Mar 10, 2026Mar 10, 2026

• media-kit

  Public

  vllm-project/media-kit’s past year of commit activity
  vLLM Logo Assets

  55 forks•88 stars•22 issues•00 pull requests•Updated Jan 15, 2026Jan 15, 2026

• vLLM-in-PyTorch-Conference-2025

  Public

  vllm-project/vLLM-in-PyTorch-Conference-2025’s past year of commit activity
  11 fork•1212 stars•00 issues•00 pull requests•Updated Dec 14, 2025Dec 14, 2025

• vllm-openvino

  Public
  Python

  •

  Apache License 2.0

  •1212 forks•4545 stars•33 issues•11 pull request•Updated Dec 4, 2025Dec 4, 2025