Technology · Product
llama.cpp
Product · Catalog tech@1
LLM inference in C/C++ on local hardware.
- Categories
- Matched as
- ggml
- llama-cpp
- llama.cpp
- llamacpp
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. llama.cpp has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.130,136 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.0 in the last 30 days · 1 in the 30 before
Adoption by registry
The growth of llama.cpp’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of llama.cpp’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 0published events that mention it
- Events · 30 days
- 0published events that mention it
- Previous 30 days
- 1events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- ggml-org/llama.cpp
LLM inference in C/C++
130.1K stars
Members 61repositories tagged with one of its aliases, most-starred first
- off-grid-ai/OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
3.2K stars
- SharpAI/DeepCamera
Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
3.1K stars
- containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
3.1K stars
- Luce-Org/lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
2.9K stars
- Mobile-Artificial-Intelligence/maid
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
2.7K stars
- AtomicBot-ai/atomic-agent
Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
2.6K stars
- heshengtao/comfyui_LLM_party
LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG
2.4K stars
- antoinezambelli/forge
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
2.3K stars
- floneum/kalosm
Instant, controllable, local pre-trained AI models in Rust
2.2K stars
- withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
2.2K stars
- guinmoon/LLMFarm
llama and other large language models on iOS and MacOS offline using GGML library.
2.1K stars
- handy-computer/transcribe.cpp
ggml speech-to-text inference for 16+ model families
2K stars
Packages
“Is” packages are llama.cpp itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 1the technology itself, most-adopted first
- gguf
Read and write ML models in GGUF for GGML
Not published by PyPI
Ecosystem 12packages that depend on it, most-adopted first
- ai-dynamo-vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI - freetoken
Local MoE-offload LLM inference runtime with OpenAI- and Anthropic-compatible APIs
Not published by PyPI - gen-worker
A library used to build custom functions in Cozy Creator's serverless function platform.
Not published by PyPI - invokeai
A full-featured AI-assisted image generation environment designed for creatives and enthusiasts.
Not published by PyPI - lsglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - sglang-kt
SGLang is a fast serving framework for large language models and vision language models.
Not published by PyPI - vllm-cpu-amxbf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 + AMX optimized)
Not published by PyPI - vllm-cpu-avx512
vLLM CPU inference engine (AVX512 optimized)
Not published by PyPI - vllm-cpu-avx512bf16
vLLM CPU inference engine (AVX512 + VNNI + BF16 optimized)
Not published by PyPI - vllm-omni
A framework for efficient model inference with omni-modality models
Not published by PyPI - vllm-xft
A high-throughput and memory-efficient inference and serving engine for LLMs
Not published by PyPI
Latest news the latest event that mention it
- 32d agoSEP 22, 2026