Technology · Framework
vLLM
Framework · Catalog tech@1
High-throughput LLM inference and serving engine.
- Categories
- Matched as
- vllm
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. vLLM has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.93,061 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 2.2 in the last 30 days · 0 in the 30 before
Adoption by registry
The growth of vLLM’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of vLLM’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 1published events that mention it
- Events · 30 days
- 2published events that mention it
- Previous 30 days
- 0events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
93.1K stars
Members 33repositories tagged with one of its aliases, most-starred first
- OpenBMB/UltraRAG
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
5.7K stars
- katanaml/sparrow
Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
5.2K stars
- lemony-ai/cascadeflow
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
4K stars
- PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
3.7K stars
- containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
3.1K stars
- vllm-project/vllm-ascend
Community maintained hardware plugin for vLLM on Huawei Ascend
2.9K stars
- sybil-solutions/local-studio
Control panel for VLLM, Sglang, llama.cpp, exllamav3
1.8K stars
- syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the answer quotes the prompt), ~1,035 tok/s at 64 concurrent, 150k-262k context. vLLM patches, requant pipeline, benchmarks.
1.8K stars
- vllm-project/vllm-metal
Community maintained hardware plugin for vLLM on Apple Silicon
1.8K stars
- SemiAnalysisAI/InferenceX
Open Source Inference Research Platform Standard / 开源推理研究平台
1.8K stars
- intel/auto-round
A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包
1.6K stars
- waybarrios/vllm-mlx
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
1.6K stars
Packages
“Is” packages are vLLM itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 11the technology itself, most-adopted first
- ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - nextai-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-acc
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-cpu
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-cpu-amxbf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)
Not published by PyPI - vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized)
Not published by PyPI - vllm-cpu-avx512bf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)
Not published by PyPI - vllm-cpu-nightly
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-tpu
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI
Ecosystem 7packages that depend on it, most-adopted first
- bentoml-unsloth
BentoML: The easiest way to serve AI apps and models
Not published by PyPI - docext
Onprem information extraction from documents
Not published by PyPI - hipporag
A powerful graph-based RAG framework that enables LLMs to identify and leverage connections within new knowledge for improved retrieval.
Not published by PyPI - hipporag-nyabot
A powerful graph-based RAG framework that enables LLMs to identify and leverage connections within new knowledge for improved retrieval.
Not published by PyPI - ochat
An efficient framework for training and serving top-tier, open-source conversational LLMs.
Not published by PyPI - octotoolkit
An effective and easy-to-use agentic framework with extendable tools for complex reasoning.
Not published by PyPI - orpheus-speech
Orpheus Text-to-Speech System
Not published by PyPI
Latest news the 3 latest events that mention it
- 5h agoOCT 24, 2026
- 21d agoOCT 3, 2026
- 4mo agoJUL 8, 2026