Technologies in LLM Infrastructure
7 technologies · Momentum
No technology here has a momentum score yet, so this order is not a ranking: it follows news events in 30 days, then the name. A score needs at least 2 of its 5 signals to have history; until then it is not estimated. How momentum works
| Technology | Category | Momentum | Members | Packages · Is / Ecosystem | News · 30d | Official repository |
|---|---|---|---|---|---|---|
XLA Machine learning compiler for accelerators. | ML Frameworks & Training | Collecting0 of 5 signals | 4repositories |
| 2events | openxla/xla |
vLLM High-throughput LLM inference and serving engine. | LLM Infrastructure | Collecting0 of 5 signals | 33repositories |
| 2events | vllm-project/vllm |
SGLang Fast serving framework for language models. | LLM Infrastructure | Collecting0 of 5 signals | 15repositories |
| 1events | sgl-project/sglang |
LlamaIndex Data framework for LLM applications and RAG. | RAG | Collecting0 of 5 signals | 19repositories |
| 0events | run-llama/llama_index |
Ollama Run language models locally. | LLM Infrastructure | Collecting1 of 5 signals | 127repositories |
| 0events | ollama/ollama |
Sentence Transformers Embeddings for sentences and text. | NLP & Speech | Collecting0 of 5 signals | 7repositories |
| 0events | huggingface/sentence-transformers |
llama.cpp LLM inference in C/C++ on local hardware. | LLM Infrastructure | Collecting0 of 5 signals | 61repositories |
| 0events | ggml-org/llama.cpp |