Technology · Product
llama.cpp
Product · Catalog tech@1
LLM inference in C/C++ on local hardware.
- Categories
- Matched as
- ggml
- llama-cpp
- llama.cpp
- llamacpp
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. llama.cpp has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.130,136 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.0 in the last 30 days · 1 in the 30 before
Adoption by registry
The growth of llama.cpp’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of llama.cpp’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 0published events that mention it
- Events · 30 days
- 0published events that mention it
- Previous 30 days
- 1events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- ggml-org/llama.cpp
LLM inference in C/C++
130.1K stars
Members 61repositories tagged with one of its aliases, most-starred first
- alexpinel/Dot
Text-To-Speech, RAG, and LLMs. All local!
1.9K stars
- sammcj/gollama
Go manage your Ollama models
1.8K stars
- sybil-solutions/local-studio
Control panel for VLLM, Sglang, llama.cpp, exllamav3
1.8K stars
- undreamai/LLMUnity
Create characters in Unity with LLMs!
1.7K stars
- ddalcu/mlx-serve
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
1.7K stars
- intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
1.7K stars
- AtomicBot-ai/Atomic-Chat
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
1.7K stars
- intel/auto-round
A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包
1.6K stars
- RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
1.6K stars
- QwenAudio/Fun-ASR
Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.
1.6K stars
- ggml-org/Llama-macOS
A cosy home for your LLMs.
1.5K stars
- nobodywho-ooo/nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
1.5K stars
Packages
“Is” packages are llama.cpp itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 1the technology itself, most-adopted first
- gguf
Read and write ML models in GGUF for GGML
Not published by PyPI
Ecosystem 12packages that depend on it, most-adopted first
- ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - freetoken
Local MoE-offload LLM inference runtime with OpenAI- and Anthropic-compatible APIs
Not published by PyPI - gen-worker
A library used to build custom functions in Cozy Creator's serverless function platform.
Not published by PyPI - invokeai
A full-featured AI-assisted image generation environment designed for creatives and enthusiasts.
Not published by PyPI - lsglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang-kt
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - vllm-cpu-amxbf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)
Not published by PyPI - vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized)
Not published by PyPI - vllm-cpu-avx512bf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)
Not published by PyPI - vllm-omni
A framework for efficient model inference with omni-modality models
Not published by PyPI - vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI
Latest news the latest event that mention it
- 32d agoSEP 22, 2026