Apache Spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Official repository stars

Collecting

Star growth needs repository snapshots 30 days apart.44,109 stars now

Member repository stars

Collecting

Star growth needs repository snapshots 30 days apart.0 new members in 30 days

Package adoption

—Not published by its registries

Its packages’ registries publish no adoption figure, so there is nothing to grow.

Open models

—No official models

No official model on Hugging Face, so this signal does not apply.

News

Collecting

News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days

1published events that mention it

Events · 30 days

1published events that mention it

Previous 30 days

0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

• apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing

  Official repositoryScala

  44.1K stars

Members 95repositories tagged with one of its aliases, most-starred first

• zio/zio-quill

  Compile-time Language Integrated Queries for Scala

  Tagged sparkScala

  2.2K stars

• dotnet/spark

  .NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

  Tagged apache-sparkC#

  2.1K stars

• big-data-europe/docker-spark

  Apache Spark docker image

  Tagged apache-sparkShell

  2K stars

• Qihoo360/Quicksql

  A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

  Tagged sparkJava

  2K stars

• broadinstitute/gatk

  Official code repository for GATK versions 4 and up

  Tagged sparkJava

  2K stars

• apache/cassandra-spark-connector

  Apache Spark to Apache Cassandra connector

  Tagged sparkScala

  2K stars

• endymecy/spark-ml-source-analysis

  spark ml 算法原理剖析以及具体的源码实现分析

  Tagged spark

  2K stars

• feathr-ai/feathr

  Feathr – A scalable, unified data and AI engineering platform for enterprise

  Tagged apache-sparkScala

  1.9K stars

• szilard/benchm-ml

  A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

  Tagged sparkR

  1.9K stars

• uber/petastorm

  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

  Tagged pysparkPython

  1.9K stars

• collabH/bigdata-growth

  大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

  Tagged sparkPython

  1.8K stars

• apache/auron

  Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.

  Tagged sparkRust

  1.8K stars

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

• pyspark

  Apache Spark Python API

  Listed in the catalogPyPI

  —Not published by PyPI
• pyspark-client

  Python Spark Connect client for Apache Spark

  Published from apache/sparkPyPI

  —Not published by PyPI
• pyspark-connect

  Apache Spark Python API with Spark Connect by default

  Published from apache/sparkPyPI

  —Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

• apache-airflow-providers-apache-spark

  Provider package apache-airflow-providers-apache-spark for Apache Airflow

  Depends on pyspark-clientPyPI

  —Not published by PyPI
• dagster-pyspark

  Package for PySpark Dagster framework components.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataengine

  General purpose data engineering python package.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataproc-spark-connect

  Dataproc client library for Spark Connect

  Depends on pysparkPyPI

  —Not published by PyPI
• delta-spark

  Python APIs for using Delta Lake with Apache Spark

  Depends on pysparkPyPI

  —Not published by PyPI
• flytekitplugins-spark

  Spark 3 plugin for flytekit

  Depends on pysparkPyPI

  —Not published by PyPI
• hail

  Scalable library for exploring and analyzing genomic data.

  Depends on pysparkPyPI

  —Not published by PyPI
• hyperleaup

  Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

  Depends on pysparkPyPI

  —Not published by PyPI
• pbspark

  Convert between protobuf messages and pyspark dataframes

  Depends on pysparkPyPI

  —Not published by PyPI
• petastorm

  Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-stubs

  A collection of the Apache Spark stub files

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-test

  Check that left and right spark DataFrame are equal.

  Depends on pysparkPyPI

  —Not published by PyPI

Latest news the latest event that mention it

• Netflix Bridges AWS IAM and Internal Identity with Workload Attestation1 source
  3d agoOCT 21, 2026