Technology · Product
llama.cpp
Product · Catalog tech@1
LLM inference in C/C++ on local hardware.
- Categories
- Matched as
- ggml
- llama-cpp
- llama.cpp
- llamacpp
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. llama.cpp has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.130,136 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.0 in the last 30 days · 1 in the 30 before
Adoption by registry
The growth of llama.cpp’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of llama.cpp’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 0published events that mention it
- Events · 30 days
- 0published events that mention it
- Previous 30 days
- 1events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- ggml-org/llama.cpp
LLM inference in C/C++
130.1K stars
Members 61repositories tagged with one of its aliases, most-starred first
- janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
44.8K stars
- khoj-ai/khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
37.6K stars
- AlexsJones/llmfit
Hundreds of models & providers. One command to find what runs on your hardware.
37.4K stars
- mozilla-ai/llamafile
Distribute and run LLMs with a single file.
26.2K stars
- llmware-ai/llmware
Unified framework for building enterprise RAG pipelines with small, specialized models
14.8K stars
- altic-dev/FluidVoice
Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. Windows pre-build available! A local Wispr Flow alternative. DM us on X exclusive model access! 😉 - https://x.com/fluidvoiceapp
11.9K stars
- getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10.9K stars
- RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
10.3K stars
- xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
9.6K stars
- QwenAudio/SenseVoice
Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.
9.4K stars
- MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
8K stars
- leejet/stable-diffusion.cpp
Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++
7.5K stars
Packages
“Is” packages are llama.cpp itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 1the technology itself, most-adopted first
- gguf
Read and write ML models in GGUF for GGML
Not published by PyPI
Ecosystem 12packages that depend on it, most-adopted first
- ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - freetoken
Local MoE-offload LLM inference runtime with OpenAI- and Anthropic-compatible APIs
Not published by PyPI - gen-worker
A library used to build custom functions in Cozy Creator's serverless function platform.
Not published by PyPI - invokeai
A full-featured AI-assisted image generation environment designed for creatives and enthusiasts.
Not published by PyPI - lsglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang-kt
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - vllm-cpu-amxbf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)
Not published by PyPI - vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized)
Not published by PyPI - vllm-cpu-avx512bf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)
Not published by PyPI - vllm-omni
A framework for efficient model inference with omni-modality models
Not published by PyPI - vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI
Latest news the latest event that mention it
- 32d agoSEP 22, 2026