GitHub intelligence
NVIDIA/ TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Observed OCT 8, 2026 · 00:08 UTC
Facts
- Language
- Python
- License
- other
- Created
- AUG 16, 2023
- Last push
- Last release
- GitHub
- NVIDIA/TensorRT-LLM ↗
Measurements
- Stars
- 14,756
- Forks
- 2,792
- 7D change
- Collectingfrom OCT 9
- 30D change
- Collectingfrom NOV 1
- 90D change
- Collectingfrom DEC 31
- Velocity
- Collectingfrom OCT 16
- Acceleration
- Collectingfrom OCT 23
- Trajectory
- Collectingfrom OCT 16
- Trending percentile
- Collectingfrom OCT 16
Categories
Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work
Technologies
Star history
Daily history began OCT 2. The chart appears after 7 days. 1 observed day shown.
Observed days (1)
| Day | Stars | Forks |
|---|---|---|
| OCT 2 | 14,756 | 2,792 |