Apache Spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Official repository stars

Collecting

Star growth needs repository snapshots 30 days apart.44,109 stars now

Member repository stars

Collecting

Star growth needs repository snapshots 30 days apart.0 new members in 30 days

Package adoption

—Not published by its registries

Its packages’ registries publish no adoption figure, so there is nothing to grow.

Open models

—No official models

No official model on Hugging Face, so this signal does not apply.

News

Collecting

News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days

1published events that mention it

Events · 30 days

1published events that mention it

Previous 30 days

0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

• apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing

  Official repositoryScala

  44.1K stars

Members 95repositories tagged with one of its aliases, most-starred first

• oeljeklaus-you/UserActionAnalyzePlatform

  电商用户行为分析大数据平台

  Tagged sparkJava

  1.1K stars

• Teradata/kylo

  Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

  Tagged sparkJava

  1.1K stars

• mahmoudparsian/data-algorithms-book

  MapReduce, Spark, Java, and Scala for Data Algorithms Book

  Tagged apache-sparkJava

  1.1K stars

• jacksu/utils4s

  scala、spark使用过程中，各种测试用例以及相关资料整理

  Tagged sparkScala

  1.1K stars

• apache/celeborn

  Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

  Tagged sparkJava

  1.1K stars

• bigdatagenomics/adam

  ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

  Tagged sparkScala

  1.1K stars

• josonle/Coding-Now

  学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

  Tagged sparkPython

  1.1K stars

• pixiedust/pixiedust

  Python Helper library for Jupyter Notebooks

  Tagged sparkJupyter Notebook

  1K stars

• TIBCOSoftware/snappydata

  Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

  Tagged sparkScala

  1K stars

• metabrainz/listenbrainz-server

  Server for the ListenBrainz project, including the front-end (javascript/react) code that it serves and all of the data processing components that LB uses.

  Tagged sparkPython

  1K stars

• NVIDIA/cudf-spark

  NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs

  Tagged sparkScala

  1K stars

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

• pyspark

  Apache Spark Python API

  Listed in the catalogPyPI

  —Not published by PyPI
• pyspark-client

  Python Spark Connect client for Apache Spark

  Published from apache/sparkPyPI

  —Not published by PyPI
• pyspark-connect

  Apache Spark Python API with Spark Connect by default

  Published from apache/sparkPyPI

  —Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

• apache-airflow-providers-apache-spark

  Provider package apache-airflow-providers-apache-spark for Apache Airflow

  Depends on pyspark-clientPyPI

  —Not published by PyPI
• dagster-pyspark

  Package for PySpark Dagster framework components.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataengine

  General purpose data engineering python package.

  Depends on pysparkPyPI

  —Not published by PyPI
• dataproc-spark-connect

  Dataproc client library for Spark Connect

  Depends on pysparkPyPI

  —Not published by PyPI
• delta-spark

  Python APIs for using Delta Lake with Apache Spark

  Depends on pysparkPyPI

  —Not published by PyPI
• flytekitplugins-spark

  Spark 3 plugin for flytekit

  Depends on pysparkPyPI

  —Not published by PyPI
• hail

  Scalable library for exploring and analyzing genomic data.

  Depends on pysparkPyPI

  —Not published by PyPI
• hyperleaup

  Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

  Depends on pysparkPyPI

  —Not published by PyPI
• pbspark

  Convert between protobuf messages and pyspark dataframes

  Depends on pysparkPyPI

  —Not published by PyPI
• petastorm

  Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-stubs

  A collection of the Apache Spark stub files

  Depends on pysparkPyPI

  —Not published by PyPI
• pyspark-test

  Check that left and right spark DataFrame are equal.

  Depends on pysparkPyPI

  —Not published by PyPI

Latest news the latest event that mention it

• Netflix Bridges AWS IAM and Internal Identity with Workload Attestation1 source
  3d agoOCT 21, 2026