Get Started

Technology · Framework

Apache Spark

Framework · Catalog tech@1

Engine for large-scale data processing.

Categories
Matched as
  • apache spark
  • pyspark
  • spark

Momentum

Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works

Momentum

Collecting0 of 5 signals

No score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.

Snapshot OCT 24, 2026 · Scoring tech@1

Official repository stars
Collecting
Star growth needs repository snapshots 30 days apart.44,109 stars now
Member repository stars
Collecting
Star growth needs repository snapshots 30 days apart.0 new members in 30 days
Package adoption
Not published by its registries
Its packages’ registries publish no adoption figure, so there is nothing to grow.
Open models
No official models
No official model on Hugging Face, so this signal does not apply.
News
Collecting
News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before

Adoption by registry

The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.

No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.

News activity

Events · 7 days
1published events that mention it
Events · 30 days
1published events that mention it
Previous 30 days
0events in the 30 days before

Momentum history

Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.

Repositories

Official 1

  • apache/spark

    Apache Spark - A unified analytics engine for large-scale data processing

    Official repositoryScala

    44.1K

Members 95repositories tagged with one of its aliases, most-starred first

  • donnemartin/data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

    Tagged sparkPython

    29.4K

  • getredash/redash

    Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

    Tagged sparkPython

    28.8K

  • mlflow/mlflow

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    Tagged apache-sparkPython

    28.2K

  • yeasy/docker_practice

    最新Docker容器技术，从真实案例中学习最佳实践！| Learn and understand Docker&Container technologies, with real DevOps practice!

    Tagged sparkGo

    26.3K

  • GaiZhenbiao/ChuanhuChatGPT

    GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

    Tagged sparkPython

    15.3K

  • zhisheng17/flink-learning

    flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

    Tagged sparkJava

    15.1K

  • aalansehaiyang/technology-talk

    【大厂面试专栏】一份Java程序员需要的技术指南，这里有面试题、系统架构、职场锦囊、主流中间件等，让你成为更牛的自己！

    Tagged spark

    14.7K

  • deeplearning4j/deeplearning4j

    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

    Tagged sparkJava

    14.3K

  • wangzhiwubigdata/God-Of-BigData

    专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

    Tagged spark

    10.6K

  • tobymao/sqlglot

    Python SQL Parser and Transpiler

    Tagged sparkPython

    9.7K

  • delta-io/delta

    An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

    Tagged sparkScala

    9K

  • mage-ai/mage-ai

    🧙 Build, run, and manage data pipelines for integrating and transforming data.

    Tagged sparkPython

    8.8K

Packages

“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.

Is 3the technology itself, most-adopted first

  • pyspark

    Apache Spark Python API

    Listed in the catalogPyPI

    Not published by PyPI
  • pyspark-client

    Python Spark Connect client for Apache Spark

    Published from apache/sparkPyPI

    Not published by PyPI
  • pyspark-connect

    Apache Spark Python API with Spark Connect by default

    Published from apache/sparkPyPI

    Not published by PyPI

Ecosystem 15packages that depend on it, most-adopted first

  • apache-airflow-providers-apache-spark

    Provider package apache-airflow-providers-apache-spark for Apache Airflow

    Depends on pyspark-clientPyPI

    Not published by PyPI
  • dagster-pyspark

    Package for PySpark Dagster framework components.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataengine

    General purpose data engineering python package.

    Depends on pysparkPyPI

    Not published by PyPI
  • dataproc-spark-connect

    Dataproc client library for Spark Connect

    Depends on pysparkPyPI

    Not published by PyPI
  • delta-spark

    Python APIs for using Delta Lake with Apache Spark

    Depends on pysparkPyPI

    Not published by PyPI
  • flytekitplugins-spark

    Spark 3 plugin for flytekit

    Depends on pysparkPyPI

    Not published by PyPI
  • hail

    Scalable library for exploring and analyzing genomic data.

    Depends on pysparkPyPI

    Not published by PyPI
  • hyperleaup

    Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.

    Depends on pysparkPyPI

    Not published by PyPI
  • pbspark

    Convert between protobuf messages and pyspark dataframes

    Depends on pysparkPyPI

    Not published by PyPI
  • petastorm

    Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-stubs

    A collection of the Apache Spark stub files

    Depends on pysparkPyPI

    Not published by PyPI
  • pyspark-test

    Check that left and right spark DataFrame are equal.

    Depends on pysparkPyPI

    Not published by PyPI

Latest news the latest event that mention it

Apache Spark · Framework — Crest of Tech