In the Crest catalog
spider-rs/spider
Foundational low latency web data collecting in Rust
- Stars
- 2.8K
- Forks
- 307
- Language
- Rust
- Last push
- 23d ago
- Last release
- 7mo ago
Linked by the package’s own registry metadata.GitHub (opens in a new tab)
Package · crates.io
spider
crates.io · v2.53.9 · MIT
A web crawler and scraper, building blocks for data curation workloads.
Technologies
Install
cargo add spiderAdoption
- Downloads (90 days)
- 49.4K
- Observeddownloads / 90 days
- Popularity
- Lower half on crates.io
- Derived13th percentile within crates.io
- Dependents
- Collectinghistory
- Collecting
- All-time downloads
- 2.1M
- Observedsince first publish
- Maintenance
- 0.90
- DerivedRelease cadence and recency, 0 to 1
- Releases per year
- 259
- 2,227 versions over its life
Growth by period
Derived by Crest of Tech from two observations of crates.io’s own figure, a period apart. Nothing is stored or estimated: without an observation near the period’s start, the period is still collecting.
- 7 days
- Collectinghistory
- Collecting
- 30 days
- Collectinghistory
- Collecting
- 90 days
- Collectinghistory
- Collecting
- 1 year
- Collectinghistory
- Collecting
Adoption history
Adoption historydownloads / 90 days
Observations in this range began OCT 6, 2026. The chart appears after 7 observations; 1 so far. Collecting history.
Table of observations (31)
| Day | downloads / 90 days | Dependents |
|---|---|---|
| OCT 6, 2026 | 49,352 | Not observed |
| OCT 5, 2026 | Not observed | Not observed |
| OCT 4, 2026 | Not observed | Not observed |
| OCT 3, 2026 | Not observed | Not observed |
| OCT 2, 2026 | Not observed | Not observed |
| OCT 1, 2026 | Not observed | Not observed |
| SEP 30, 2026 | Not observed | Not observed |
| SEP 29, 2026 | Not observed | Not observed |
| SEP 28, 2026 | Not observed | Not observed |
| SEP 27, 2026 | Not observed | Not observed |
| SEP 26, 2026 | Not observed | Not observed |
| SEP 25, 2026 | Not observed | Not observed |
| SEP 24, 2026 | Not observed | Not observed |
| SEP 23, 2026 | Not observed | Not observed |
| SEP 22, 2026 | Not observed | Not observed |
| SEP 21, 2026 | Not observed | Not observed |
| SEP 20, 2026 | Not observed | Not observed |
| SEP 19, 2026 | Not observed | Not observed |
| SEP 18, 2026 | Not observed | Not observed |
| SEP 17, 2026 | Not observed | Not observed |
| SEP 16, 2026 | Not observed | Not observed |
| SEP 15, 2026 | Not observed | Not observed |
| SEP 14, 2026 | Not observed | Not observed |
| SEP 13, 2026 | Not observed | Not observed |
| SEP 12, 2026 | Not observed | Not observed |
| SEP 11, 2026 | Not observed | Not observed |
| SEP 10, 2026 | Not observed | Not observed |
| SEP 9, 2026 | Not observed | Not observed |
| SEP 8, 2026 | Not observed | Not observed |
| SEP 7, 2026 | Not observed | Not observed |
| SEP 6, 2026 | Not observed | Not observed |
Facts from the registry
- Latest version
- v2.53.9
- 2,227 versions
- First published
- FEB 5, 2018
- Last release
- SEP 5, 2026
- 50d ago
- Licence
- MIT
Repository
Dependencies latest version · v2.53.9
Runtime 26
- ahash
^0.8 - aho-corasick
^1 - arc-swap
^1 - async-trait
^0.1 - auto_encoder
^0.2 - bytes
^1 - case_insensitive_string
^0.2 - dashmap
^6 - h2
^0.4 - hashbrown
^0.17 - lazy_static
^1 - libc
^0.2 - log
^0.4 - lol_html
^2 - memchr
^2 - num_cpus
^1 - percent-encoding
^2 - phf
^0.13 - pin-project-lite
^0.2 - quick-xml
^0.41 - regex
^1 - reqwest
^0.13 - simdutf8
^0.1 - smallvec
^1 - spider_agent_types
^2.53.9 - spider_fingerprint
^2
Optional 34
- async-openai
^0.35 - async_job
^0.1 - base64
^0.22 - chromey
^2.54 - chrono
^0.4 - const_format
^0.2 - cookie
^0.18 - cron
^0.16 - crossbeam-queue
^0.3 - fastrand
^2 - flexbuffers
^25 - gemini-rust
^1.7 - hickory-resolver
^0.26 - home
^0.5 - http
^1 - http-cache
^1.0.0-alpha.5 - http-cache-semantics
^3 - http-global-cache
^0.2.0 - httpdate
^1 - io-uring
^0.7 - itertools
^0.14 - llm_json
^1 - mimalloc
^0.1 - moka
^0.12 - rand
^0.9 - reqwest-middleware
^0.5 - serde
^1 - serde_json
^1 - serde_regex
^1 - sitemap
^0.4 - sonic-rs
^0.5 - spider-http-cache-reqwest
^1.0.0-alpha.7 - spider_agent
^2.53.9 - spider_firewall
^2
Related packages
- http_global_cacheA global cache to use for http.Published from the same repository
- matrx-scraperWeb scraping engine, HTML parsing, and search integration for the Matrx ecosystemSame primary category
- tg-signer-plusAutomated Telegram tasks (check-ins, sending messages, keyboard clicks, AI replies, etc.); automation rules for forwarding, and auto-replying to private, group, and channel messages.Same primary category
- abx-dlAll-in-one CLI tool to download and extract content from URLsSame primary category
- abx-pluginsArchiveBox-compatible plugin suite (hooks, configs, binaries manifests)Same primary category
- stagehandBrowserbase's SDK for building browser agentsSame primary category
- cloakbrowserStealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches.Same primary category
Related news
No published news event mentions this package or its repository yet.