Get Started

Technology · Framework

Apache Spark

Framework · Catalog tech@1

Engine for large-scale data processing.

Categories
Matched as
  • apache spark
  • pyspark
  • spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Momentum

Collecting0 of 5 signals

No score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.

Snapshot OCT 24, 2026 · Scoring tech@1

Official repository stars
Collecting
Star growth needs repository snapshots 30 days apart.44,109 stars now
Member repository stars
Collecting
Star growth needs repository snapshots 30 days apart.0 new members in 30 days
Package adoption
Not published by its registries
Its packages’ registries publish no adoption figure, so there is nothing to grow.
Open models
No official models
No official model on Hugging Face, so this signal does not apply.
News
Collecting
News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days
1published events that mention it
Events · 30 days
1published events that mention it
Previous 30 days
0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

  • apache/spark

    Apache Spark - A unified analytics engine for large-scale data processing

    Official repositoryScala

    44.1K

Members 95repositories tagged with one of its aliases, most-starred first

  • narwhals-dev/narwhals

    Lightweight and extensible compatibility layer between dataframe libraries!

    Tagged pysparkPython

    1.7K

  • strapdata/elassandra

    Elassandra = Elasticsearch + Apache Cassandra

    Tagged sparkJava

    1.7K

  • almond-sh/almond

    A Scala kernel for Jupyter

    Tagged sparkScala

    1.6K

  • maxpumperla/elephas

    Distributed Deep learning with Keras & Spark

    Tagged sparkPython

    1.6K

  • japila-books/apache-spark-internals

    The Internals of Apache Spark

    Tagged apache-sparkShell

    1.6K

  • combust/mleap

    MLeap: Deploy ML Pipelines to Production

    Tagged sparkScala

    1.5K

  • san089/goodreads_etl_pipeline

    An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

    Tagged apache-sparkPython

    1.5K

  • hi-primus/optimus

    :truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

    Tagged pysparkPython

    1.5K

  • projectnessie/nessie

    Nessie: Transactional Catalog for Data Lakes with Git-like semantics

    Tagged sparkJava

    1.5K

  • SeldonIO/seldon-server

    Machine Learning Platform and Recommendation Engine built on Kubernetes

    Tagged sparkJava

    1.5K

  • apache/carbondata

    High performance data store solution

    Tagged sparkScala

    1.5K

  • databricks/LearningSparkV2

    This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

    Tagged apache-sparkScala

    1.4K

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

  • pyspark

    Apache Spark Python API

    Listed in the catalogPyPI

    Not published by PyPI
  • pyspark-client

    Python Spark Connect client for Apache Spark

    Published from apache/sparkPyPI

    Not published by PyPI
  • pyspark-connect

    Apache Spark Python API with Spark Connect by default

    Published from apache/sparkPyPI

    Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

  • apache-airflow-providers-apache-spark

    Provider package apache-airflow-providers-apache-spark for Apache Airflow

    Depends on pyspark-clientPyPI

    Not published by PyPI
  • dagster-pyspark

    Package for PySpark Dagster framework components.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataengine

    General purpose data engineering python package.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataproc-spark-connect

    Dataproc client library for Spark Connect

    Depends on pysparkPyPI

    Not published by PyPI
  • delta-spark

    Python APIs for using Delta Lake with Apache Spark

    Depends on pysparkPyPI

    Not published by PyPI
  • flytekitplugins-spark

    Spark 3 plugin for flytekit

    Depends on pysparkPyPI

    Not published by PyPI
  • hail

    Scalable library for exploring and analyzing genomic data.

    Depends on pysparkPyPI

    Not published by PyPI
  • hyperleaup

    Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

    Depends on pysparkPyPI

    Not published by PyPI
  • pbspark

    Convert between protobuf messages and pyspark dataframes

    Depends on pysparkPyPI

    Not published by PyPI
  • petastorm

    Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-stubs

    A collection of the Apache Spark stub files

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-test

    Check that left and right spark DataFrame are equal.

    Depends on pysparkPyPI

    Not published by PyPI

Latest news the latest event that mention it