Technology · Framework
Apache Spark
Framework · Catalog tech@1
Engine for large-scale data processing.
- Categories
- Matched as
- apache spark
- pyspark
- spark
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.44,109 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before
Adoption by registry
The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 1published events that mention it
- Events · 30 days
- 1published events that mention it
- Previous 30 days
- 0events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
44.1K stars
Members 95repositories tagged with one of its aliases, most-starred first
- yahoo/TensorFlowOnSpark
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
3.8K stars
- awslabs/deequ
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
3.6K stars
- lw-lin/CoolplaySpark
酷玩 Spark: Spark 源代码解析、Spark 类库等
3.5K stars
- liyupi/sql-generator
🔨 用 JSON 来生成结构化的 SQL 语句,基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现,项目简单(重逻辑轻页面)、适合练手~
3.4K stars
- apache/paimon
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
3.4K stars
- apache/linkis
Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
3.4K stars
- lakehq/sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
3.4K stars
- databricks/koalas
Koalas: pandas API on Apache Spark
3.4K stars
- WeBankFinTech/DataSphereStudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
3.3K stars
- lakesoul-io/LakeSoul
LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.
3.3K stars
- MoRan1607/BigDataGuide
大数据学习,从零开始学习大数据,包含大数据学习各阶段学习视频、面试资料
3.2K stars
- kubeflow/spark-operator
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
3.2K stars
Packages
“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 3the technology itself, most-adopted first
- pyspark
Apache Spark Python API
Not published by PyPI - pyspark-client
Python Spark Connect client for Apache Spark
Not published by PyPI - pyspark-connect
Apache Spark Python API with Spark Connect by default
Not published by PyPI
Ecosystem 15packages that depend on it, most-adopted first
- semantic-link-sempy
Semantic link for Microsoft Fabric
Not published by PyPI - Not published by PyPI
- tinsel
PySpark schema generator
Not published by PyPI
Latest news the latest event that mention it
- 3d agoOCT 21, 2026