Apache Spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Official repository stars

Collecting

Star growth needs repository snapshots 30 days apart.44,109 stars now

Member repository stars

Collecting

Star growth needs repository snapshots 30 days apart.0 new members in 30 days

Package adoption

—Not published by its registries

Its packages’ registries publish no adoption figure, so there is nothing to grow.

Open models

—No official models

No official model on Hugging Face, so this signal does not apply.

News

Collecting

News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days

1published events that mention it

Events · 30 days

1published events that mention it

Previous 30 days

0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

• apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing

  Official repositoryScala

  44.1K stars

Members 95repositories tagged with one of its aliases, most-starred first

• HariSekhon/Dockerfiles

  50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak

  Tagged sparkShell

  1.4K stars

• jupyter-incubator/sparkmagic

  Jupyter magics and kernels for working with remote Spark clusters

  Tagged pysparkPython

  1.4K stars

• logicalclocks/hopsworks

  Hopsworks - Data-Intensive AI platform with a Feature Store

  Tagged pysparkJava

  1.3K stars

• DTStack/Taier

  Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

  Tagged sparkJava

  1.3K stars

• apache/datafusion-comet

  Apache DataFusion Comet Spark Accelerator

  Tagged sparkScala

  1.3K stars

• zinggAI/zingg

  Scalable master data management, identity resolution, entity resolution, and deduplication using ML

  Tagged sparkJava

  1.3K stars

• graphframes/graphframes

  GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

  Tagged apache-sparkScala

  1.2K stars

• apache/amoro

  Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.

  Tagged sparkJava

  1.2K stars

• twosigma/flint

  A Time Series Library for Apache Spark

  Tagged sparkScala

  1.2K stars

• apachecn/spark-doc-zh

  Apache Spark 官方文档中文版

  Tagged sparkJavaScript

  1.2K stars

• lensacom/sparkit-learn

  PySpark + Scikit-learn = Sparkit-learn

  Tagged apache-sparkPython

  1.2K stars

• abhishek-ch/around-dataengineering

  A Data Engineering & Machine Learning Knowledge Hub

  Tagged sparkPython

  1.1K stars

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

• pyspark

  Apache Spark Python API

  Listed in the catalogPyPI

  —Not published by PyPI
• pyspark-client

  Python Spark Connect client for Apache Spark

  Published from apache/sparkPyPI

  —Not published by PyPI
• pyspark-connect

  Apache Spark Python API with Spark Connect by default

  Published from apache/sparkPyPI

  —Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

• apache-airflow-providers-apache-spark

  Provider package apache-airflow-providers-apache-spark for Apache Airflow

  Depends on pyspark-clientPyPI

  —Not published by PyPI
• dagster-pyspark

  Package for PySpark Dagster framework components.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataengine

  General purpose data engineering python package.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataproc-spark-connect

  Dataproc client library for Spark Connect

  Depends on pysparkPyPI

  —Not published by PyPI
• delta-spark

  Python APIs for using Delta Lake with Apache Spark

  Depends on pysparkPyPI

  —Not published by PyPI
• flytekitplugins-spark

  Spark 3 plugin for flytekit

  Depends on pysparkPyPI

  —Not published by PyPI
• hail

  Scalable library for exploring and analyzing genomic data.

  Depends on pysparkPyPI

  —Not published by PyPI
• hyperleaup

  Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

  Depends on pysparkPyPI

  —Not published by PyPI
• pbspark

  Convert between protobuf messages and pyspark dataframes

  Depends on pysparkPyPI

  —Not published by PyPI
• petastorm

  Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-stubs

  A collection of the Apache Spark stub files

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-test

  Check that left and right spark DataFrame are equal.

  Depends on pysparkPyPI

  —Not published by PyPI

Latest news the latest event that mention it

• Netflix Bridges AWS IAM and Internal Identity with Workload Attestation1 source
  3d agoOCT 21, 2026