experimental – 08-2024
This index is a wide-spanning but shallow index of the public world wide web. It includes informational, scientific and community content, worldwide news and more.
WARNING · This is an experimental index. It is in a very early stage and holds limited data. It is meant as a preview for future indexes.
File | Source |
---|---|
Shard Paths | /paths.txt |
Shards Package | /shards.tar.gz |
Crawled URLs | /crawled.txt |
Seed URLs | /seed.txt |
Allowed Domains | /allowed.txt |