A living census of the web's bots. First edition.
Nobody invited them. Bots land at Port 443 and are meant to queue at Customs. The rules are on the robots.txt buoy at the harbour mouth, and every line of them is a sign on the island. People watch from the promenade. Every creature here is a real bot visiting this site right now.
Island time --:--:--
-- watching from the promenade
Live. Events can appear a few seconds after they happen.
Simulated traffic
A harbour posts notices for anyone sailing in. A website does the same for bots: seven files, each at a fixed address. The first is on the buoy. The rest are pinned to the notice board on the quay.
Below is each file and which species opened it, for today and the 29 days before it. Opened means asked for and served. Species are in catalogue order, not ranked. A name tagged unverified is shown for the species and is not put down to any operator.
robots.txtThe rules: which paths the site asks bots to keep out of. This is the one on the buoy.
Opened 15 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| curl Ringletus bouncius | 4 | 2 |
| Unplaced specimen Incertae sedis | 3 | 3 |
| ClaudeBot Talonus bookwormus Verified | 5 | 3 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |
| OAI-SearchBot Owlus vowelus Unverified | 1 | 1 |
| FossickBot Prospectorus pickaxius | 1 | 1 |
sitemap.xmlThe list of pages the site wants found.
Opened 2 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 1 | 1 |
llms.txtA plain guide to the site, written for AI models.
Opened 4 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 2 | 1 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |
ai.txtWhat the site is and what it does with a visit, written for bots that read for AI.
Opened 4 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 2 | 1 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |
security.txtWhere to report a security problem.
Opened 4 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 2 | 1 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |
humans.txtWho is behind the site.
Opened 4 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 2 | 1 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |
ads.txtWho may sell advertising here. Nobody: the site carries none.
Opened 4 times in the trailing 30 days.
| Species | Times opened | Sessions |
|---|---|---|
| GPTBot Parrotus repeatus Verified | 1 | 1 |
| ClaudeBot Talonus bookwormus Verified | 2 | 1 |
| MJ12bot Alienus deniedus Unverified | 1 | 1 |