Package · PyPI

vllm-xft

PyPI · v0.5.5.4 · Apache 2.0

A high-throughput and memory-efficient inference and serving engine for LLMs

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Install

pip install vllm-xft

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.27
DerivedRelease cadence and recency, 0 to 1
Releases per year
11
12 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.5.5.4
12 versions
First published
MAR 29, 2024
Last release
APR 29, 2025
18mo ago
Licence
Apache 2.0

Repository

In the Crest catalog

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Stars
93.1K
Forks
22.9K
Language
Python
Last push
22d ago
Last release
32d ago

Linked by the package’s own registry metadata.GitHub (opens in a new tab)

Dependencies latest version · v0.5.5.4

Runtime 29

  • aiohttpAny version
  • fastapiAny version
  • filelock>=3.10.4
  • gguf==0.9.1
  • importlib_metadataAny version
  • librosaAny version
  • lm-format-enforcer==0.10.6
  • msgspecAny version
  • numpy<2.0.0
  • openai>=1.0
  • outlines<0.1,>=0.0.43
  • pillowAny version
  • prometheus-fastapi-instrumentator>=7.0.0
  • prometheus_client>=0.18.0
  • protobufAny version
  • psutilAny version
  • py-cpuinfoAny version
  • pydantic>=2.8
  • pyzmqAny version
  • requestsAny version
  • sentencepieceAny version
  • soundfileAny version
  • tiktoken>=0.6.0
  • tokenizers>=0.19.1
  • tqdmAny version
  • transformers>=4.43.2
  • typing_extensions>=4.10
  • uvicornAny version
  • xfastertransformer>=1.8.0

Related news