Technology · Framework
vLLM
Framework · Catalog tech@1
High-throughput LLM inference and serving engine.
- Categories
- Matched as
- vllm
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. vLLM has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.93,061 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 2.2 in the last 30 days · 0 in the 30 before
Adoption by registry
The growth of vLLM’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of vLLM’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 1published events that mention it
- Events · 30 days
- 2published events that mention it
- Previous 30 days
- 0events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
93.1K stars
Members 33repositories tagged with one of its aliases, most-starred first
- modelscope/FunASR
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
20.6K stars
- budtmo/docker-android
Android in docker solution with noVNC supported, video recording, mcp server and AI-agent
15.9K stars
- halfrost/Halfrost-Field
✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记
13.2K stars
- LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
12K stars
- OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
10.1K stars
- xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
9.6K stars
- ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
8.2K stars
- kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
6.7K stars
- kserve/kserve
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
6.1K stars
- vllm-project/semantic-router
A programmable Mixture-of-Models router for heterogeneous LLM inference
6K stars
- mostlygeek/llama-swap
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
5.8K stars
- gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
5.8K stars
Packages
“Is” packages are vLLM itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 11the technology itself, most-adopted first
- ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - nextai-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-acc
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-cpu
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-cpu-amxbf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)
Not published by PyPI - vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized)
Not published by PyPI - vllm-cpu-avx512bf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)
Not published by PyPI - vllm-cpu-nightly
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI
Ecosystem 7packages that depend on it, most-adopted first
- bentoml-unsloth
BentoML: The easiest way to serve AI apps and models
Not published by PyPI - docext
Onprem information extraction from documents
Not published by PyPI - hipporag
A powerful graph-based RAG framework that enables LLMs to identify and leverage connections within new knowledge for improved retrieval.
Not published by PyPI - hipporag-nyabot
A powerful graph-based RAG framework that enables LLMs to identify and leverage connections within new knowledge for improved retrieval.
Not published by PyPI - ochat
An efficient framework for training and serving top-tier, open-source conversational LLMs.
Not published by PyPI - octotoolkit
An effective and easy-to-use agentic framework with extendable tools for complex reasoning.
Not published by PyPI - orpheus-speech
Orpheus Text-to-Speech System
Not published by PyPI
Latest news the 3 latest events that mention it
- 4h agoOCT 24, 2026
- 21d agoOCT 3, 2026
- 4mo agoJUL 8, 2026