Package · PyPI
PyPI · v0.32.0 · Apache-2.0
A high-throughput and memory-efficient inference and serving engine for LLMs
Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work
pip install vllm-cpuPyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.
Adoption history
PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.
In the Crest catalog
A high-throughput and memory-efficient inference and serving engine for LLMs
Linked by the package’s own registry metadata.GitHub (opens in a new tab)
>=3.14.3>=0.71.0==0.17.0==0.20.0<0.137.0,>=0.133.0>=3.20.3>=1.31.0==2024.2.1>=4.23.0==1.2.2<1.8.0,>=1.7.0==0.11.3<3.0.0,>=2.0.0>=1.11.6<1.0.0,>=0.1.14==0.65.0>=2.25.0>=4.13.0>=1.27.0>=1.27.0>=1.27.0>=0.4.1>=0.0.11==0.2.14>=12.3.0>=8.0.0>=0.18.0!=6.30.*,!=6.31.*,!=6.32.*,!=6.33.0.*,!=6.33.1.*,!=6.33.2.*,!=6.33.3.*,!=6.33.4.*,>=5.29.6>=2.12.0>=25.0.0>=2.33.0>=0.6.2<81.0.0,>=78.1.1>=1.16.0>=1.0.1>=0.6.0>=0.23.2==2.13.0+cpu>=0.14