Technology · Framework
Apache Spark
Framework · Catalog tech@1
Engine for large-scale data processing.
- Categories
- Matched as
- apache spark
- pyspark
- spark
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.44,109 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before
Adoption by registry
The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 1published events that mention it
- Events · 30 days
- 1published events that mention it
- Previous 30 days
- 0events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
44.1K stars
Members 95repositories tagged with one of its aliases, most-starred first
- spark-notebook/spark-notebook
Interactive and Reactive Data Science using Scala and Spark.
3.1K stars
- Luce-Org/lucebox
LLM speculative inference server for heterogeneous hardware & consumer GPUs
2.9K stars
- spark-jobserver/spark-jobserver
REST job server for Apache Spark
2.8K stars
- vector4wang/spring-boot-quick
:herb: 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、k3s、k3d、k8s、mybatis加解密插件、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等:pushpin:
2.8K stars
- geekyouth/SZT-bigdata
深圳地铁大数据客流分析系统🚇🚄🌟
2.5K stars
- moj-analytical-services/splink
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
2.5K stars
- XZB-1248/Spark
✨Spark is a web-based, cross-platform and full-featured Remote Administration Tool (RAT) written in Go that allows you control all your devices anywhere. Spark是一个Go编写的，网页UI、跨平台以及多功能的远程控制和监控工具，你可以随时随地监控和控制所有设备。
2.4K stars
- apache/kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
2.4K stars
- salesforce/TransmogrifAI
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
2.3K stars
- o-gs/dji-firmware-tools
Tools for handling firmwares of DJI products, with focus on quadcopters.
2.2K stars
- ytsaurus/ytsaurus
YTsaurus is a scalable and fault-tolerant open-source big data platform.
2.2K stars
- fugue-project/fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
2.2K stars
Packages
“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 3the technology itself, most-adopted first
- pyspark
Apache Spark Python API
Not published by PyPI - pyspark-client
Python Spark Connect client for Apache Spark
Not published by PyPI - pyspark-connect
Apache Spark Python API with Spark Connect by default
Not published by PyPI
Ecosystem 15packages that depend on it, most-adopted first
- apache-airflow-providers-apache-spark
Provider package apache-airflow-providers-apache-spark for Apache Airflow
Not published by PyPI - dagster-pyspark
Package for PySpark Dagster framework components.
Not published by PyPI - dataengine
General purpose data engineering python package.
Not published by PyPI - dataproc-spark-connect
Dataproc client library for Spark Connect
Not published by PyPI - delta-spark
Python APIs for using Delta Lake with Apache Spark
Not published by PyPI - flytekitplugins-spark
Spark 3 plugin for flytekit
Not published by PyPI - hail
Scalable library for exploring and analyzing genomic data.
Not published by PyPI - hyperleaup
Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.
Not published by PyPI - pbspark
Convert between protobuf messages and pyspark dataframes
Not published by PyPI - petastorm
Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.
Not published by PyPI - pyspark-stubs
A collection of the Apache Spark stub files
Not published by PyPI - pyspark-test
Check that left and right spark DataFrame are equal.
Not published by PyPI
Latest news the latest event that mention it
- 3d agoOCT 21, 2026