Package · PyPI

ftllm

PyPI · v0.1.8.2 · Licence not reported

High-performance C++ inference engine for dense and MoE language models

Tentative categories were assigned with moderate confidence (0.5 to 0.75): they are shown, but they do not count toward a category’s momentum. How categories work

Install

pip install ftllm

Adoption

Adoption
Not published by PyPI
Not published
Popularity
Not published by PyPI
Not published
Dependents
Not published by PyPI
Not published
Maintenance
0.91
DerivedRelease cadence and recency, 0 to 1
Releases per year
24
36 versions over its life

Growth by period

PyPI publishes no adoption figure, so there is no growth to derive. Nothing is estimated in its place.

7 days
Not published by PyPI
Not published
30 days
Not published by PyPI
Not published
90 days
Not published by PyPI
Not published
1 year
Not published by PyPI
Not published

Adoption history

Adoption history

PyPI publishes no adoption count, so there is no history to chart. That is a fact about the registry, not a gap in ours: the package’s releases and maintenance are measured instead.

Facts from the registry

Latest version
v0.1.8.2
36 versions
First published
MAR 17, 2025
Last release
SEP 7, 2026
47d ago
Licence
Not reported

Repository

In the Crest catalog

ztxz16/fastllm

fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型,任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型,单并发20tps;INT4量化模型单并发30tps,多并发可达60+。

Stars
5.1K
Forks
501
Language
C++
Last push
23d ago
Last release
None recorded

Linked by the package’s own registry metadata.GitHub (opens in a new tab)

Dependencies latest version · v0.1.8.2

Runtime 24

  • XlsxWriter>=3.1.0
  • aria2Any version
  • blobfileAny version
  • fastapiAny version
  • imageioAny version
  • imageio-ffmpegAny version
  • jinja2>=3.1.0
  • modelscope<2,>=1.34.0
  • nvidia-cublas-cu12Any version
  • nvidia-cuda-runtime-cu12Any version
  • nvidia-nccl-cu12Any version
  • openaiAny version
  • openpyxl>=3.1.0
  • pandas>=2.0.0
  • partial-json-parserAny version
  • pydanticAny version
  • pypdf>=4.0.0
  • pyreadline3Any version
  • python-pptx>=1.0.0
  • shortuuidAny version
  • tiktokenAny version
  • transformersAny version
  • triton>=3.6
  • uvicornAny version

Related news

No published news event mentions this package or its repository yet.