Domain
Data Engineering
502 repositories970 packages12 news events
Technologies in Data Engineering
13 technologies · Momentum
No technology here has a momentum score yet, so this order is not a ranking: it follows news events in 30 days, then the name. A score needs at least 2 of its 5 signals to have history; until then it is not estimated. How momentum works
| Technology | Category | Momentum | Members | Packages · Is / Ecosystem | News · 30d | Official repository |
|---|---|---|---|---|---|---|
Apache Iceberg Open table format for analytic datasets. | Data Engineering | Collecting1 of 5 signals | 23repositories |
| 3events | apache/iceberg |
Databricks Data and AI platform built on Apache Spark. | Data Engineering | Collecting1 of 5 signals | 16repositories |
| 3events | None listed |
Apache Kafka Distributed event streaming platform. | Data Engineering | Collecting0 of 5 signals | 131repositories |
| 2events | apache/kafka |
DuckDB In-process analytical SQL database. | Databases | Collecting0 of 5 signals | 37repositories |
| 1events | duckdb/duckdb |
Apache Airflow Workflow orchestration for data pipelines. | Data Engineering | Collecting0 of 5 signals | 12repositories |
| 0events | apache/airflow |
Apache Spark Engine for large-scale data processing. | Data Engineering | Collecting0 of 5 signals | 95repositories |
| 0events | apache/spark |
ClickHouse Column-oriented analytical database. | Databases | Collecting0 of 5 signals | 64repositories |
| 0events | ClickHouse/ClickHouse |
Elasticsearch Distributed search and analytics engine. | Databases | Collecting0 of 5 signals | 136repositories |
| 0events | elastic/elasticsearch |
Polars Fast DataFrame library written in Rust. | Data Science & Visualization | Collecting0 of 5 signals | 7repositories |
| 0events | pola-rs/polars |
RabbitMQ Message broker. | Backend | Collecting0 of 5 signals | 69repositories |
| 0events | rabbitmq/rabbitmq-server |
Scala Functional and object-oriented language for the JVM. | Programming Languages & Compilers | Collecting0 of 5 signals | 118repositories |
| 0events | scala/scala3 |
Snowflake Cloud data platform. | Data Engineering | Collecting0 of 5 signals | 36repositories |
| 0events | None listed |
dbt SQL transformations for analytics engineering. | Data Engineering | Collecting0 of 5 signals | 12repositories |
| 0events | dbt-labs/dbt |