Labels

REST api server

CDX url index

CI and release

Command surface, flags, config

Columnar parquet index

Frontier, robots, scheduler

HuggingFace client and upload

BM25 inverted index

Publish and export pipelines

HTTP client, S3, rate limiting

WARC read and write

Something isn't working

Improvements or additions to documentation

This issue or pull request already exists

New feature or request

Good for newcomers

Extra attention is needed

This doesn't seem right

Integrity, the binary must keep the claims it makes

Corpus work, needed by the gao program

Crawl engine

Durability and polish

Further information is requested

Something is wrong

Needs a scope decision before work starts

Documentation

New capability

Tests and coverage

Milestone tracking issue

This will not be worked on