Package · PyPI

lighteval

PyPI · v0.13.0 · MIT License

A lightweight and configurable evaluation package

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Install

pip install lighteval

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.39
DerivedRelease cadence and recency, 0 to 1
Releases per year
10
22 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.13.0
22 versions
First published
OCT 19, 2023
Last release
NOV 24, 2025
11mo ago
Licence
MIT License

Repository

In the Crest catalog

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Stars
2.6K
Forks
565
Language
Python
Last push
24d ago
Last release
11mo ago

Linked by the package’s own registry metadata.GitHub (opens in a new tab)

Dependencies latest version · v0.13.0

Runtime 28

  • GitPython>=3.1.41
  • accelerateAny version
  • aenum==3.1.15
  • colorlogAny version
  • datasets>=4.0.0
  • fsspec>=2023.12.2
  • hf-xet>=1.1.8
  • httpx>=0.27.2
  • huggingface_hub>=0.30.2
  • inspect-ai>=0.3.140
  • langcodesAny version
  • latex2sympy2_extended==1.0.6
  • nltk==3.9.1
  • numpy>=2
  • openaiAny version
  • protobufAny version
  • pycountryAny version
  • pydanticAny version
  • pytablewriterAny version
  • richAny version
  • rouge_score==0.1.2
  • sacrebleuAny version
  • scikit-learnAny version
  • sentencepiece>=0.1.99
  • termcolor==2.3.0
  • torch<3.0,>=2.0
  • transformers>=4.54.0
  • typer>=0.20.0

Related news

No published news event mentions this package or its repository yet.