Technology · Framework

Apache Spark

Framework · Catalog tech@1

Engine for large-scale data processing.

Matched as
  • apache spark
  • pyspark
  • spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Momentum

Collecting0 of 5 signals

No score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.

Snapshot OCT 24, 2026 · Scoring tech@1

Official repository stars
Collecting
Star growth needs repository snapshots 30 days apart.44,109 stars now
Member repository stars
Collecting
Star growth needs repository snapshots 30 days apart.0 new members in 30 days
Package adoption
Not published by its registries
Its packages’ registries publish no adoption figure, so there is nothing to grow.
Open models
No official models
No official model on Hugging Face, so this signal does not apply.
News
Collecting
News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days
1published events that mention it
Events · 30 days
1published events that mention it
Previous 30 days
0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

  • apache/spark

    Apache Spark - A unified analytics engine for large-scale data processing

    Official repositoryScala

    44.1K stars

Members 95repositories tagged with one of its aliases, most-starred first

  • yahoo/TensorFlowOnSpark

    TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

    Tagged sparkPython

    3.8K stars

  • awslabs/deequ

    Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

    Tagged sparkScala

    3.6K stars

  • lw-lin/CoolplaySpark

    酷玩 Spark: Spark 源代码解析、Spark 类库等

    Tagged apache-sparkScala

    3.5K stars

  • liyupi/sql-generator

    🔨 用 JSON 来生成结构化的 SQL 语句,基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现,项目简单(重逻辑轻页面)、适合练手~

    Tagged sparkVue

    3.4K stars

  • apache/paimon

    Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

    Tagged sparkJava

    3.4K stars

  • apache/linkis

    Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

    Tagged pysparkJava

    3.4K stars

  • lakehq/sail

    Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

    Tagged apache-sparkRust

    3.4K stars

  • databricks/koalas

    Koalas: pandas API on Apache Spark

    Tagged sparkPython

    3.4K stars

  • WeBankFinTech/DataSphereStudio

    DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

    Tagged sparkJava

    3.3K stars

  • lakesoul-io/LakeSoul

    LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

    Tagged sparkRust

    3.3K stars

  • MoRan1607/BigDataGuide

    大数据学习,从零开始学习大数据,包含大数据学习各阶段学习视频、面试资料

    Tagged spark

    3.2K stars

  • kubeflow/spark-operator

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

    Tagged apache-sparkPython

    3.2K stars

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

  • pyspark

    Apache Spark Python API

    Listed in the catalogPyPI

    Not published by PyPI
  • pyspark-client

    Python Spark Connect client for Apache Spark

    Published from apache/sparkPyPI

    Not published by PyPI
  • pyspark-connect

    Apache Spark Python API with Spark Connect by default

    Published from apache/sparkPyPI

    Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

  • semantic-link-sempy

    Semantic link for Microsoft Fabric

    Depends on pysparkPyPI

    Not published by PyPI
  • soda-core-spark-df

    Depends on pysparkPyPI

    Not published by PyPI
  • tinsel

    PySpark schema generator

    Depends on pysparkPyPI

    Not published by PyPI

Latest news the latest event that mention it