GitHub intelligence

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Observed OCT 8, 2026 · 00:08 UTC

Facts

Language
Python
License
other
Created
AUG 16, 2023
Last push
Last release

Measurements

Stars
14,756
Forks
2,792
7D change
Collectingfrom OCT 9
30D change
Collectingfrom NOV 1
90D change
Collectingfrom DEC 31
Velocity
Collectingfrom OCT 16
Acceleration
Collectingfrom OCT 23
Trajectory
Collectingfrom OCT 16
Trending percentile
Collectingfrom OCT 16

Categories

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Technologies

Star history

Daily history began OCT 2. The chart appears after 7 days. 1 observed day shown.

14.7K14.8K14.8KJUL 10JUL 31AUG 21SEP 11OCT 2OCT 2: 14,756 stars
Observed days (1)
DayStarsForks
OCT 214,7562,792
NVIDIA/TensorRT-LLM — Crest of Tech