Get Started

Package · PyPI

ai-dynamo-vllm

PyPI · v0.8.4.post4 · Apache Software License

A high-throughput and memory-efficient inference and serving engine for LLMs

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Technologies

Install

pip install ai-dynamo-vllm

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.28
DerivedRelease cadence and recency, 0 to 1
Releases per year
21
7 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.8.4.post4
7 versions
First published
MAR 18, 2025
Last release
JUL 18, 2025
15mo ago
Licence
Apache Software License
Links
PyPI page
Homepage · github.com
Docs · vllm.readthedocs.io

Repository

In the Crest catalog

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Stars
93.1K
Forks
22.9K
Language
Python
Last push
22d ago
Last release
32d ago

Linked by the package’s own registry metadata.GitHub

Dependencies latest version · v0.8.4.post4

Runtime 55

  • aiohttpAny version
  • blake3Any version
  • cachetoolsAny version
  • cloudpickleAny version
  • compressed-tensors==0.9.3
  • depyf==0.18.0
  • einopsAny version
  • fastapi>=0.115.0
  • filelock>=3.16.1
  • gguf>=0.13.0
  • huggingface-hub>=0.30.0
  • importlib_metadataAny version
  • lark==1.2.2
  • llguidance<0.8.0,>=0.7.9
  • lm-format-enforcer<0.11,>=0.10.11
  • mistral_common>=1.5.4
  • msgspecAny version
  • ninjaAny version
  • numba==0.60.0
  • numpyAny version
  • openai>=1.52.0
  • opencv-python-headless>=4.11.0
  • opentelemetry-api<1.27.0,>=1.26.0
  • opentelemetry-exporter-otlp<1.27.0,>=1.26.0
  • opentelemetry-sdk<1.27.0,>=1.26.0
  • opentelemetry-semantic-conventions-ai<0.5.0,>=0.4.1
  • outlines==0.1.11
  • partial-json-parserAny version
  • pillowAny version
  • prometheus-fastapi-instrumentator>=7.0.0
  • prometheus_client>=0.18.0
  • protobufAny version
  • psutilAny version
  • py-cpuinfoAny version
  • pydantic>=2.9
  • python-json-loggerAny version
  • pyyamlAny version
  • pyzmqAny version
  • ray!=2.44.*,>=2.43.0
  • requests>=2.26.0
  • scipyAny version
  • sentencepieceAny version
  • setuptools>=74.1.1
  • six>=1.16.0
  • tiktoken>=0.6.0
  • tokenizers>=0.19.1
  • torch==2.6.0
  • torchaudio==2.6.0
  • torchvision==0.21.0
  • tqdmAny version
  • transformers>=4.51.1
  • typing_extensions>=4.10
  • watchfilesAny version
  • xformers==0.0.29.post2
  • xgrammar==0.1.18

Related packages

Related news