Package · PyPI

gptqmodel

PyPI · v7.6.0 · Apache-2.0

Production ready LLM model compression/quantization toolkit with hw accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

Install

pip install gptqmodel

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.93
DerivedRelease cadence and recency, 0 to 1
Releases per year
30
64 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v7.6.0
64 versions
First published
AUG 15, 2024
Last release
OCT 12, 2026
12d ago
Licence
Apache-2.0

Repository

In the Crest catalog

ModelCloud/GPTQModel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Stars
1.3K
Forks
213
Language
Python
Last push
24d ago
Last release
40d ago

Linked by the package’s own registry metadata.GitHub (opens in a new tab)

Dependencies latest version · v7.6.0

Runtime 23

  • accelerate>=1.13.0
  • datasets>=3.6.0
  • defuser>=0.0.28
  • device-smi>=0.5.7
  • dill>=0.3.8
  • filelockAny version
  • jinja2>=3.1.0
  • logbar>=0.4.14
  • maturin>=1.9.4
  • ninja>=1.13.0
  • numpy==2.2.6
  • packaging>=24.2
  • pillow>=11.3.0
  • protobuf>=7.34.0
  • pyarrow>=21.0
  • pypcre>=0.6.2
  • requests>=2.32.2
  • safetensors>=0.7.0
  • threadpoolctl>=3.6.0
  • tokenicer>=0.0.14
  • torch>=2.8.0
  • torchao>=0.18.0
  • transformers>=5.14.0

Related news

No published news event mentions this package or its repository yet.