Get Started

Package · PyPI

vllm-cpu-amxbf16

PyPI · v0.16.0 · GPL-3.0-only

vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Technologies

Install

pip install vllm-cpu-amxbf16

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.62
DerivedRelease cadence and recency, 0 to 1
Releases per year
89
32 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.16.0
32 versions
First published
NOV 28, 2025
Last release
APR 7, 2026
7mo ago
Licence
GPL-3.0-only
Links
PyPI page
Homepage · github.com
Docs · docs.vllm.ai

Repository

In the Crest catalog

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

Stars
93.1K
Forks
22.9K
Language
Python
Last push
22d ago
Last release
32d ago

Linked by the package’s own registry metadata.GitHub

Dependencies latest version · v0.16.0

Runtime 59

  • aiohttp>=3.13.3
  • anthropic>=0.71.0
  • blake3Any version
  • cachetoolsAny version
  • cbor2Any version
  • cloudpickleAny version
  • compressed-tensors==0.13.0
  • depyf==0.20.0
  • diskcache==5.6.3
  • einopsAny version
  • fastapi>=0.115.0
  • filelock>=3.16.1
  • gguf>=0.17.0
  • grpcioAny version
  • grpcio-reflectionAny version
  • ijsonAny version
  • intel-openmp==2024.2.1
  • lark==1.2.2
  • llguidance<1.4.0,>=1.3.0
  • lm-format-enforcer==0.11.3
  • mcpAny version
  • mistral_common>=1.9.0
  • model-hosting-container-standards<1.0.0,>=0.1.13
  • msgspecAny version
  • ninjaAny version
  • numba==0.61.2
  • numpyAny version
  • openai>=1.99.1
  • openai-harmony>=0.0.3
  • opencv-python-headless>=4.13.0
  • outlines_core==0.2.11
  • partial-json-parserAny version
  • pillowAny version
  • prometheus-fastapi-instrumentator>=7.0.0
  • prometheus_client>=0.18.0
  • protobuf!=6.30.*,!=6.31.*,!=6.32.*,!=6.33.0.*,!=6.33.1.*,!=6.33.2.*,!=6.33.3.*,!=6.33.4.*,>=5.29.6
  • psutilAny version
  • py-cpuinfoAny version
  • pybase64Any version
  • pydantic>=2.12.0
  • python-json-loggerAny version
  • pyyamlAny version
  • pyzmq>=25.0.0
  • regexAny version
  • requests>=2.26.0
  • sentencepieceAny version
  • setproctitleAny version
  • setuptools<81.0.0,>=77.0.3
  • six>=1.16.0
  • tiktoken>=0.6.0
  • tokenizers>=0.21.1
  • torch==2.10.0+cpu
  • torchaudioAny version
  • torchvisionAny version
  • tqdmAny version
  • transformers<5,>=4.56.0
  • typing_extensions>=4.10
  • watchfilesAny version
  • xgrammar==0.1.29

Related packages

Related news