Get Started

Package · PyPI

lmms-eval

PyPI · v0.7.3 · MIT

A framework for evaluating large multi-modality language models

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Technologies

Install

pip install lmms-eval

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.80
DerivedRelease cadence and recency, 0 to 1
Releases per year
10
25 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.7.3
25 versions
First published
MAR 6, 2024
Last release
AUG 28, 2026
57d ago
Licence
MIT
Links
PyPI page
Homepage · lmms-lab.github.io
Source · github.com

Repository

In the Crest catalog

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Stars
4.4K
Forks
665
Language
Python
Last push
23d ago
Last release
57d ago

Linked by the package’s own registry metadata.GitHub

Dependencies latest version · v0.7.3

Runtime 51

  • Jinja2Any version
  • accelerate>=0.29.1
  • aiohttpAny version
  • av<16.0.0
  • datasets>=2.19.0
  • einopsAny version
  • evaluate>=0.4.0
  • ftfyAny version
  • hf_transferAny version
  • httpx>=0.23.3
  • jsonlinesAny version
  • latex2sympy2Any version
  • loguruAny version
  • math-verifyAny version
  • mpmathAny version
  • nltkAny version
  • numexprAny version
  • numpy>=1.26.4
  • openaiAny version
  • opencv-python-headlessAny version
  • openpyxlAny version
  • packagingAny version
  • peft>=0.2.0
  • pillowAny version
  • pre-commitAny version
  • protobufAny version
  • pybind11>=2.6.2
  • pycocoevalcapAny version
  • pydanticAny version
  • pytablewriterAny version
  • python-dotenvAny version
  • pyyamlAny version
  • qwen-vl-utils>=0.0.14
  • ruff>=0.16.4
  • sacrebleu>=1.5.0
  • scikit-learn>=0.24.1
  • sentence_transformersAny version
  • sentencepieceAny version
  • sympyAny version
  • tenacity>=8.3.0
  • tiktokenAny version
  • timmAny version
  • torch>=2.1.0
  • torchvision>=0.16.0
  • tqdm-multiprocessAny version
  • transformers>=4.39.2
  • transformers-stream-generatorAny version
  • wandb==0.25.0
  • yt-dlpAny version
  • zssAny version
  • zstandardAny version

Related packages

Related news

No published news event mentions this package or its repository yet.