Technology · Framework
Apache Spark
Framework · Catalog tech@1
Engine for large-scale data processing.
- Categories
- Matched as
- apache spark
- pyspark
- spark
Momentum
Each signal is ranked as a percentile among the technologies that have it. A signal without enough history is not counted, and never shown as zero. How momentum works
Momentum
Collecting0 of 5 signalsNo score yet. Momentum is published only when at least 2 of the 5 signals have history. Apache Spark has 0, so there is no single number: each signal is shown on its own below. It is not a zero, and nothing is estimated in its place.
Snapshot OCT 24, 2026 · Scoring tech@1
- Official repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.44,109 stars now
- Member repository stars
- Collecting
- Star growth needs repository snapshots 30 days apart.0 new members in 30 days
- Package adoption
- Not published by its registries
- Its packages’ registries publish no adoption figure, so there is nothing to grow.
- Open models
- No official models
- No official model on Hugging Face, so this signal does not apply.
- News
- Collecting
- News counts once there are 3 events across the last 60 days; it has 1.1 in the last 30 days · 0 in the 30 before
Adoption by registry
The growth of Apache Spark’s own packages, one row per registry in that registry’s own unit. Registries count different things over different windows, so they are never added together.
No registry has two observations of Apache Spark’s own packages about 30 days apart yet, so there is no growth to show. Nothing is estimated in its place.
News activity
- Events · 7 days
- 1published events that mention it
- Events · 30 days
- 1published events that mention it
- Previous 30 days
- 0events in the 30 days before
Momentum history
Momentum history starts OCT 8, 2026. A chart appears once two daily snapshots carry a score; none does so far.
Repositories
Official 1
- apache/spark
Apache Spark - A unified analytics engine for large-scale data processing
44.1K stars
Members 95repositories tagged with one of its aliases, most-starred first
- Alluxio/alluxio
Alluxio, data orchestration for analytics and machine learning in the cloud
7.2K stars
- Angel-ML/angel
A Flexible and Powerful Parameter Server for large-scale machine learning
6.8K stars
- ibis-project/ibis
the portable Python dataframe library
6.7K stars
- apache/zeppelin
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
6.7K stars
- donnemartin/dev-setup
macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.
6.3K stars
- treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
5.5K stars
- microsoft/SynapseML
Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark
5.2K stars
- tencentmusic/cube-studio
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持国产cpu/gpu/npu 昇腾生态，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/ray/volcano等分布式
5.1K stars
- apache/streampark
The Open Control Plane for Real-Time Data
4.3K stars
- JohnSnowLabs/spark-nlp
State of the Art Natural Language Processing
4.2K stars
- RoaringBitmap/RoaringBitmap
A better compressed bitset in Java: used by Apache Spark, Netflix Atlas, Apache Pinot, Tablesaw, and many others
3.9K stars
- Cyb3rWard0g/HELK
The Hunting ELK
3.9K stars
Packages
“Is” packages are Apache Spark itself; ecosystem packages depend on them. The two are counted separately and never added together. Adoption is each registry’s own figure, with its percentile within that registry.
Is 3the technology itself, most-adopted first
- pyspark
Apache Spark Python API
Not published by PyPI - pyspark-client
Python Spark Connect client for Apache Spark
Not published by PyPI - pyspark-connect
Apache Spark Python API with Spark Connect by default
Not published by PyPI
Ecosystem 15packages that depend on it, most-adopted first
- apache-airflow-providers-apache-spark
Provider package apache-airflow-providers-apache-spark for Apache Airflow
Not published by PyPI - dagster-pyspark
Package for PySpark Dagster framework components.
Not published by PyPI - dataengine
General purpose data engineering python package.
Not published by PyPI - dataproc-spark-connect
Dataproc client library for Spark Connect
Not published by PyPI - delta-spark
Python APIs for using Delta Lake with Apache Spark
Not published by PyPI - flytekitplugins-spark
Spark 3 plugin for flytekit
Not published by PyPI - hail
Scalable library for exploring and analyzing genomic data.
Not published by PyPI - hyperleaup
Create and publish Tableau Hyper files from Apache Spark DataFrames and Spark SQL.
Not published by PyPI - pbspark
Convert between protobuf messages and pyspark dataframes
Not published by PyPI - petastorm
Petastorm is a library enabling the use of Parquet storage from Tensorflow, Pytorch, and other Python-based ML training frameworks.
Not published by PyPI - pyspark-stubs
A collection of the Apache Spark stub files
Not published by PyPI - pyspark-test
Check that left and right spark DataFrame are equal.
Not published by PyPI
Latest news the latest event that mention it
- 3d agoOCT 21, 2026