Get Started

Technology · Framework

Apache Spark

Framework · Catalog tech@1

Engine for large-scale data processing.

Categories
Matched as
  • apache spark
  • pyspark
  • spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Momentum

Collecting0 of 5 signals

No score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.

Snapshot OCT 24, 2026 · Scoring tech@1

Official repository stars
Collecting
Star growth needs repository snapshots 30 days apart.44,109 stars now
Member repository stars
Collecting
Star growth needs repository snapshots 30 days apart.0 new members in 30 days
Package adoption
Not published by its registries
Its packages’ registries publish no adoption figure, so there is nothing to grow.
Open models
No official models
No official model on Hugging Face, so this signal does not apply.
News
Collecting
News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days
1published events that mention it
Events · 30 days
1published events that mention it
Previous 30 days
0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

  • apache/spark

    Apache Spark - A unified analytics engine for large-scale data processing

    Official repositoryScala

    44.1K

Members 95repositories tagged with one of its aliases, most-starred first

  • yahoo/TensorFlowOnSpark

    TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

    Tagged sparkPython

    3.8K

  • awslabs/deequ

    Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

    Tagged sparkScala

    3.6K

  • lw-lin/CoolplaySpark

    酷玩 Spark: Spark 源代码解析、Spark 类库等

    Tagged apache-sparkScala

    3.5K

  • liyupi/sql-generator

    🔨 用 JSON 来生成结构化的 SQL 语句，基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现，项目简单（重逻辑轻页面）、适合练手~

    Tagged sparkVue

    3.4K

  • apache/paimon

    Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

    Tagged sparkJava

    3.4K

  • apache/linkis

    Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

    Tagged pysparkJava

    3.4K

  • lakehq/sail

    Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

    Tagged apache-sparkRust

    3.4K

  • databricks/koalas

    Koalas: pandas API on Apache Spark

    Tagged sparkPython

    3.4K

  • WeBankFinTech/DataSphereStudio

    DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

    Tagged sparkJava

    3.3K

  • lakesoul-io/LakeSoul

    LakeSoul is an end-to-end, realtime cloud-native Lakehouse framework for fast data ingestion, concurrent updates, incremental analytics, multimodal data processing and vector search — powering next-generation BI and AI workloads.

    Tagged sparkRust

    3.3K

  • MoRan1607/BigDataGuide

    大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

    Tagged spark

    3.2K

  • kubeflow/spark-operator

    Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

    Tagged apache-sparkPython

    3.2K

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

  • pyspark

    Apache Spark Python API

    Listed in the catalogPyPI

    Not published by PyPI
  • pyspark-client

    Python Spark Connect client for Apache Spark

    Published from apache/sparkPyPI

    Not published by PyPI
  • pyspark-connect

    Apache Spark Python API with Spark Connect by default

    Published from apache/sparkPyPI

    Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

  • apache-airflow-providers-apache-spark

    Provider package apache-airflow-providers-apache-spark for Apache Airflow

    Depends on pyspark-clientPyPI

    Not published by PyPI
  • dagster-pyspark

    Package for PySpark Dagster framework components.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataengine

    General purpose data engineering python package.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataproc-spark-connect

    Dataproc client library for Spark Connect

    Depends on pysparkPyPI

    Not published by PyPI
  • delta-spark

    Python APIs for using Delta Lake with Apache Spark

    Depends on pysparkPyPI

    Not published by PyPI
  • flytekitplugins-spark

    Spark 3 plugin for flytekit

    Depends on pysparkPyPI

    Not published by PyPI
  • hail

    Scalable library for exploring and analyzing genomic data.

    Depends on pysparkPyPI

    Not published by PyPI
  • hyperleaup

    Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

    Depends on pysparkPyPI

    Not published by PyPI
  • pbspark

    Convert between protobuf messages and pyspark dataframes

    Depends on pysparkPyPI

    Not published by PyPI
  • petastorm

    Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-stubs

    A collection of the Apache Spark stub files

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-test

    Check that left and right spark DataFrame are equal.

    Depends on pysparkPyPI

    Not published by PyPI

Latest news the latest event that mention it