In the Crest catalog
LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
- Stars
- 12K
- Forks
- 2K
- Language
- Python
- Last push
- 22d ago
- Last release
- 42d ago
Linked by the package’s own registry metadata.GitHub (opens in a new tab)
Package · PyPI
lmcache
PyPI · v0.5.5 · Apache-2.0
A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
- AI & Machine Learning (primary)
- LLM Infrastructure
- ML Frameworks & Training
- Observability
- Backend · Tentative
- Testing · Tentative
Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work
Install
pip install lmcacheAdoption
- Adoption
- Not published by PyPI
- Not published
- Popularity
- Not published by PyPI
- Not published
- Dependents
- Not published by PyPI
- Not published
- Maintenance
- 0.97
- DerivedRelease cadence and recency, 0 to 1
- Releases per year
- 44
- 59 versions over its life
Growth by period
PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.
- 7 days
- Not published by PyPI
- Not published
- 30 days
- Not published by PyPI
- Not published
- 90 days
- Not published by PyPI
- Not published
- 1 year
- Not published by PyPI
- Not published
Adoption history
Adoption history
PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.
Facts from the registry
- Latest version
- v0.5.5
- 59 versions
- First published
- MAY 28, 2025
- Last release
- SEP 28, 2026
- 26d ago
- Licence
- Apache-2.0
Repository
Dependencies latest version · v0.5.5
Runtime 40
- aiofileAny version
- aiofilesAny version
- aiohttpAny version
- awscrtAny version
- blake3Any version
- cachetoolsAny version
- cryptographyAny version
- cuda-python
<14,>=13 - cufile-pythonAny version
- cupy-cuda13xAny version
- fastapiAny version
- google-api-coreAny version
- google-cloud-bigtableAny version
- grpcio
>=1.78.0 - httptoolsAny version
- httpxAny version
- huggingface_hub
>=1.5.0 - msgspecAny version
- numbaAny version
- numpy
<=2.2.6 - nvtxAny version
- opentelemetry-api
<=1.40.0,>=1.20.0 - opentelemetry-exporter-otlp
>=1.20.0 - opentelemetry-exporter-prometheus
<=0.61b0,>=0.50b0 - opentelemetry-sdk
>=1.20.0 - prometheus_client
<=0.24.1,>=0.18.0 - protobuf
<7,>=6.31.1 - psutilAny version
- py-cpuinfoAny version
- pytestAny version
- pyyamlAny version
- pyzmq
>=25.0.0 - redisAny version
- safetensorsAny version
- setuptools
<81.0.0,>=77.0.3 - setuptools_scm
>=8 - sortedcontainersAny version
- torchAny version
- transformers
>=5.4 - uvicornAny version
Related packages
- lmcache-cliA LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.Published from the same repository
- ttnnGeneral compute framework for Tenstorrent devicesSame primary category
- rapid-peRapidPE: The original low-latency gravitational wave parameter estimation code.Same primary category
- keras-hub-nightlyPretrained models for Keras.Same primary category
- amd-gaiaGAIA is a lightweight agent framework designed for the edge and AI PCs.Same primary category
- nemo-relayPython bindings for the NeMo Relay agent runtime.Same primary category
- pipecat-aiAn open source framework for voice (and multimodal) assistantsSame primary category
Related news
No published news event mentions this package or its repository yet.