Systema Machinae

A living census of the web's bots. First edition.
Nobody invited the bots. They arrive at Port 443, where they’re supposed to queue at Passport Control. Some don’t. The robots.txt buoy at the harbour mouth states the rules. The island shows which bots read them and which don’t obey. You watch from the promenade. Every creature is a real bot visiting this website.

Alignment

Each species gets a Lawful score and a Good score from 0 to 100, from what it did here in the trailing 30 days.

How to read this page

This chart places every bot on two scales.

Left to right runs from Lawful to Chaotic: how well it follows the signs. Top to bottom runs from Good to Evil: how honest it is about who it is and how gentle it is on the island.

Each small picture is a bot, and the square it stands in is its alignment.

Choose a bot to read its score, or choose a square to zoom into it. The scores are also in a list below the chart.

Lawful: follows the signs

Good: honest about who it is and gentle on the island

Pixel drawing of curlcurl: Confidence: Low. Seen 85 requests in 14 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of python-requestspython-requests: Confidence: Low. Seen 5 requests in 4 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of HeadlessChromeHeadlessChrome: Confidence: Low. Seen 5 requests in 2 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of Unplaced specimenUnplaced specimen: Confidence: Medium. Seen 450 requests in 101 sessions in the last 30 days. Neutral GoodPixel drawing of GPTBotGPTBot: Confidence: Low. Seen 41 requests in 1 session in the last 30 days; this can move a lot. Lawful GoodPixel drawing of ClaudeBotClaudeBot: Confidence: Low. Seen 101 requests in 13 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of MJ12botMJ12bot: Confidence: Low. Seen 54 requests in 4 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of ApplebotApplebot: Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of archive.org_botarchive.org_bot: Confidence: Low. Seen 2 requests in 2 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of OAI-SearchBotOAI-SearchBot: Confidence: Low. Seen 3 requests in 3 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of CMS-CheckerCMS-Checker: Confidence: Low. Seen 6 requests in 2 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of aiohttpaiohttp: Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of FossickBotFossickBot: Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot. Lawful GoodPixel drawing of Go-http-clientGo-http-client: Confidence: Low. Seen 7 requests in 4 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of InternetMeasurementInternetMeasurement: Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of okhttpokhttp: Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of python-httpxpython-httpx: Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of srchs-research-botsrchs-research-bot: Confidence: Low. Seen 3 requests in 1 session in the last 30 days; this can move a lot. Lawful GoodPixel drawing of Secrets seekerSecrets seeker: Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot. Neutral GoodPixel drawing of Login knockerLogin knocker: Confidence: Low. Seen 18 requests in 1 session in the last 30 days; this can move a lot. Neutral GoodPixel drawing of History diggerHistory digger: Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot. Neutral GoodPixel drawing of Hatch lifterHatch lifter: Confidence: Low. Seen 10 requests in 3 sessions in the last 30 days; this can move a lot. Neutral GoodPixel drawing of Panel prodderPanel prodder: Confidence: Low. Seen 12 requests in 3 sessions in the last 30 days; this can move a lot. Neutral Good

Choose a square to zoom in and see every bot in it.

Choose a creature on the chart to read its score.

curl (Ringletus bouncius): Lawful Good. Lawful 85, good 100, all sessions. Confidence: Low. Seen 85 requests in 14 sessions in the last 30 days; this can move a lot. Read its page

python-requests (Constrictus pleasius): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 5 requests in 4 sessions in the last 30 days; this can move a lot. Read its page

HeadlessChrome (Chickenus noheadus): Lawful Good. Lawful 67, good 100, all sessions. Confidence: Low. Seen 5 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

Unplaced specimen (Incertae sedis): Neutral Good. Lawful 52, good 99, all sessions. Confidence: Medium. Seen 450 requests in 101 sessions in the last 30 days. Read its page

GPTBot (Parrotus repeatus): Lawful Good. Lawful 67, good 100, verified sessions only. Confidence: Low. Seen 41 requests in 1 session in the last 30 days; this can move a lot. Read its page

ClaudeBot (Pincerus bookwormus): Lawful Good. Lawful 95, good 100, verified sessions only. Confidence: Low. Seen 101 requests in 13 sessions in the last 30 days; this can move a lot. Read its page

MJ12bot (Alienus deniedus): Lawful Good. Lawful 92, good 100, unverified: the species only, no operator. Confidence: Low. Seen 54 requests in 4 sessions in the last 30 days; this can move a lot. Read its page

Applebot (Fruitus walkaboutus): Lawful Good. Lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

archive.org_bot (Cratus neverforgetus): Neutral Good. Lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 2 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

OAI-SearchBot (Owlus vowelus): Lawful Good. Lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 3 requests in 3 sessions in the last 30 days; this can move a lot. Read its page

CMS-Checker (Clipboardus tickedus): Neutral Good. Lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 6 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

aiohttp (Constrictus loopius): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

FossickBot (Prospectorus pickaxius): Lawful Good. Lawful 75, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

Go-http-client (Gopherus hurryus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 7 requests in 4 sessions in the last 30 days; this can move a lot. Read its page

InternetMeasurement (Rulerus tickbytickus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot. Read its page

okhttp (Signholderus allfineus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot. Read its page

python-httpx (Constrictus crisscrossus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot. Read its page

srchs-research-bot (Labcoatus forscienceus): Lawful Good. Lawful 67, good 100, all sessions. Confidence: Low. Seen 3 requests in 1 session in the last 30 days; this can move a lot. Read its page

Secrets seeker (Pocketus picksecretus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot. Read its page

Login knocker (Knockus wordpressus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 18 requests in 1 session in the last 30 days; this can move a lot. Read its page

History digger (Shovelus historius): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot. Read its page

Hatch lifter (Hatchus cellarius): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 10 requests in 3 sessions in the last 30 days; this can move a lot. Read its page

Panel prodder (Buttonus pressus): Neutral Good. Lawful 50, good 100, all sessions. Confidence: Low. Seen 12 requests in 3 sessions in the last 30 days; this can move a lot. Read its page

Scores as a list
  1. aiohttp: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot.
  2. Applebot: Lawful Good. lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot.
  3. archive.org_bot: Neutral Good. lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 2 requests in 2 sessions in the last 30 days; this can move a lot.
  4. ChatGPT-User: Good, one axis. good 100, unverified: the species only, no operator. Confidence: Low. Seen 7 requests in 1 session in the last 30 days; this can move a lot.
  5. ClaudeBot: Lawful Good. lawful 95, good 100, verified sessions only. Confidence: Low. Seen 101 requests in 13 sessions in the last 30 days; this can move a lot.
  6. CMS-Checker: Neutral Good. lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 6 requests in 2 sessions in the last 30 days; this can move a lot.
  7. curl: Lawful Good. lawful 85, good 100, all sessions. Confidence: Low. Seen 85 requests in 14 sessions in the last 30 days; this can move a lot.
  8. facebookexternalhit: Good, one axis. good 100, unverified: the species only, no operator. Confidence: Low. Seen 10 requests in 7 sessions in the last 30 days; this can move a lot.
  9. FossickBot: Lawful Good. lawful 75, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot.
  10. Go-http-client: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 7 requests in 4 sessions in the last 30 days; this can move a lot.
  11. GPTBot: Lawful Good. lawful 67, good 100, verified sessions only. Confidence: Low. Seen 41 requests in 1 session in the last 30 days; this can move a lot.
  12. Hatch lifter: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 10 requests in 3 sessions in the last 30 days; this can move a lot.
  13. HeadlessChrome: Lawful Good. lawful 67, good 100, all sessions. Confidence: Low. Seen 5 requests in 2 sessions in the last 30 days; this can move a lot.
  14. History digger: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot.
  15. InternetMeasurement: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot.
  16. Login knocker: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 18 requests in 1 session in the last 30 days; this can move a lot.
  17. MJ12bot: Lawful Good. lawful 92, good 100, unverified: the species only, no operator. Confidence: Low. Seen 54 requests in 4 sessions in the last 30 days; this can move a lot.
  18. OAI-SearchBot: Lawful Good. lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 3 requests in 3 sessions in the last 30 days; this can move a lot.
  19. okhttp: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot.
  20. Panel prodder: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 12 requests in 3 sessions in the last 30 days; this can move a lot.
  21. python-httpx: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot.
  22. python-requests: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 5 requests in 4 sessions in the last 30 days; this can move a lot.
  23. Secrets seeker: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot.
  24. srchs-research-bot: Lawful Good. lawful 67, good 100, all sessions. Confidence: Low. Seen 3 requests in 1 session in the last 30 days; this can move a lot.
  25. Unplaced specimen: Neutral Good. lawful 52, good 99, all sessions. Confidence: Medium. Seen 450 requests in 101 sessions in the last 30 days.

Scored on one axis

An order scored on identity and rate only has a Good score and no place on the Lawful axis. Their confidence is Low below 200 requests or 5 sessions.

SpeciesGoodLabel
facebookexternalhit Goatus headbuttus Unverified100Good
ChatGPT-User Budgius messengerus Unverified100Good
Additional info

Confidence

Confidence: Low
Below 200 requests or 5 sessions in the last 30 days. The place can move a lot.
Confidence: Medium
200 requests and 5 sessions or more, up to 1,000 requests and 25 sessions.
Confidence: High
1,000 requests and 25 sessions or more.

Provisional thresholds

Provisional

  • 10%of sessions asked for a disallowed path: cannot be labelled Lawful
  • 10%of sessions failed Passport Control: cannot be labelled Good

Both thresholds will be set from the first 30 days of real traffic.

How the scores are worked out

Each score is the share of opportunities a species handled well. The share is worked out for each input and the inputs on an axis are averaged, so each counts the same. 67 or more earns the top label, 34 to 66 the middle one, and anything lower the bottom one.

  • A named operator is scored from verified sessions only. A session that failed Passport Control is scored as the impostor and never as the name it used.
  • Where an operator documents no check, nothing can be verified. The species is then scored on its own, marked unverified, and nothing is said about the operator.
  • A species is placed from its first session. Below 200 requests or 5 sessions in the 30 days its confidence is Low, and its place can move a lot.
  • A species with no session it can be judged on yet is not placed.
  • The Alignment verdict on a species’ own page still waits for 200 requests and 5 sessions.
  • A fetch sent on someone’s behalf is never counted as breaking a rule, and the order that makes them is scored on identity and rate only.

The counts behind each score

curl: Lawful Good. lawful 85, good 100, all sessions. Confidence: Low. Seen 85 requests in 14 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic71354%Yes
Stays out of disallowed pathsLawful to Chaotic1414100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic66100%Yes
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil1414100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 14 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 14 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

python-requests: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 5 requests in 4 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic040%Yes
Stays out of disallowed pathsLawful to Chaotic44100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil44100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 4 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 4 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

HeadlessChrome: Lawful Good. lawful 67, good 100, all sessions. Confidence: Low. Seen 5 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic020%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic11100%Yes
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

Unplaced specimen: Neutral Good. lawful 52, good 99, all sessions. Confidence: Medium. Seen 450 requests in 101 sessions in the last 30 days.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic9979%Yes
Stays out of disallowed pathsLawful to Chaotic101101100%Yes
Waits out Retry-After on a 429Lawful to Chaotic11100%Yes
Honours nofollowLawful to Chaotic030%Yes
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil10010199%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 101 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 101 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

GPTBot: Lawful Good. lawful 67, good 100, verified sessions only. Confidence: Low. Seen 41 requests in 1 session in the last 30 days; this can move a lot.

Verified sessions of OpenAI’s bot.

InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%Yes
Stays out of disallowed pathsLawful to Chaotic11100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic11100%Yes
Claimed identity verifiesGood to Evil11100%Yes
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

ClaudeBot: Lawful Good. lawful 95, good 100, verified sessions only. Confidence: Low. Seen 101 requests in 13 sessions in the last 30 days; this can move a lot.

Verified sessions of Anthropic’s bot.

InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic1313100%Yes
Stays out of disallowed pathsLawful to Chaotic1313100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic6786%Yes
Claimed identity verifiesGood to Evil1313100%Yes
Keeps within the published rate limitGood to Evil1313100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 13 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 13 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

MJ12bot: Lawful Good. lawful 92, good 100, unverified: the species only, no operator. Confidence: Low. Seen 54 requests in 4 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic44100%Yes
Stays out of disallowed pathsLawful to Chaotic44100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic3475%Yes
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil44100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 4 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 4 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

facebookexternalhit: Good, one axis. good 100, unverified: the species only, no operator. Confidence: Low. Seen 10 requests in 7 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic070%No: not in this order’s rubric
Stays out of disallowed pathsLawful to Chaotic77100%No: not in this order’s rubric
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic33100%No: not in this order’s rubric
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil77100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 7 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 7 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

Applebot: Lawful Good. lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic22100%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

archive.org_bot: Neutral Good. lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 2 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic020%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

OAI-SearchBot: Lawful Good. lawful 100, good 100, unverified: the species only, no operator. Confidence: Low. Seen 3 requests in 3 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic00No opportunityNo: nothing to count
Stays out of disallowed pathsLawful to Chaotic33100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil33100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 3 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 3 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

CMS-Checker: Neutral Good. lawful 50, good 100, unverified: the species only, no operator. Confidence: Low. Seen 6 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic020%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

ChatGPT-User: Good, one axis. good 100, unverified: the species only, no operator. Confidence: Low. Seen 7 requests in 1 session in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%No: not in this order’s rubric
Stays out of disallowed pathsLawful to Chaotic11100%No: not in this order’s rubric
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic010%No: not in this order’s rubric
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

aiohttp: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 11 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic020%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

FossickBot: Lawful Good. lawful 75, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic1250%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

Go-http-client: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 7 requests in 4 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic040%Yes
Stays out of disallowed pathsLawful to Chaotic44100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil44100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 4 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 4 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

InternetMeasurement: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic050%Yes
Stays out of disallowed pathsLawful to Chaotic55100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil55100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 5 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 5 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

okhttp: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 6 requests in 5 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic050%Yes
Stays out of disallowed pathsLawful to Chaotic55100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil55100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 5 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 5 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

python-httpx: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 3 requests in 2 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic020%Yes
Stays out of disallowed pathsLawful to Chaotic22100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil22100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 2 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 2 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

srchs-research-bot: Lawful Good. lawful 67, good 100, all sessions. Confidence: Low. Seen 3 requests in 1 session in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%Yes
Stays out of disallowed pathsLawful to Chaotic11100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic11100%Yes
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

Secrets seeker: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%Yes
Stays out of disallowed pathsLawful to Chaotic11100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

Login knocker: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 18 requests in 1 session in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%Yes
Stays out of disallowed pathsLawful to Chaotic11100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

History digger: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 1 request in 1 session in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic010%Yes
Stays out of disallowed pathsLawful to Chaotic11100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil11100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 1 session (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 1 session (0%). At 10% or more the Good label is ruled out: not applied here.

Hatch lifter: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 10 requests in 3 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic030%Yes
Stays out of disallowed pathsLawful to Chaotic33100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil33100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 3 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 3 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

Panel prodder: Neutral Good. lawful 50, good 100, all sessions. Confidence: Low. Seen 12 requests in 3 sessions in the last 30 days; this can move a lot.
InputAxisHandled wellOpportunitiesShareCounted
Reads robots.txt before anything elseLawful to Chaotic030%Yes
Stays out of disallowed pathsLawful to Chaotic33100%Yes
Waits out Retry-After on a 429Lawful to Chaotic00No opportunityNo: nothing to count
Honours nofollowLawful to Chaotic00No opportunityNo: nothing to count
Claimed identity verifiesGood to Evil00No opportunityNo: nothing to count
Keeps within the published rate limitGood to Evil33100%Yes
Pages taken in the Pitfall and the Climb before leavingGood to Evil00No opportunityNo: nothing to count

Asked for a disallowed path: 0 of 3 sessions (0%). At 10% or more the Lawful label is ruled out: not applied here.

Failed Passport Control: 0 of 3 sessions (0%). At 10% or more the Good label is ruled out: not applied here.

The inputs

InputAxisMeasured atOne opportunityHandled well
Reads robots.txt before anything elseLawful to ChaoticThe buoyA session that asked for anything other than robots.txtIt had read the file first, in that visit or in the 24 hours before it
Stays out of disallowed pathsLawful to ChaoticThe Forbidden DoorA sessionIt asked for no path that robots.txt disallows for it
Waits out Retry-After on a 429Lawful to ChaoticThe TurnstileA return to the Turnstile after it answered 429The return came after the wait it was given
Honours nofollowLawful to ChaoticThe Side gateA session served a page that carries the nofollow linkIt did not follow the link
Claimed identity verifiesGood to EvilPassport ControlA session whose claim Passport Control could checkThe claim passed
Keeps within the published rate limitGood to EvilQuarantineA sessionIt never made more than the limit allows inside one minute
Pages taken in the Pitfall and the Climb before leavingGood to EvilThe ClimbEach of 500 chances to leave, for a session that fell inThe session left without taking it

Not measured yet

These are in the method and take no part in any score, because the log cannot answer them yet.

InputAxisMeasured atWhy not yet
Honours Crawl-delay, where the operator claims supportLawful to ChaoticThe Slow pathThe site has no checked list yet of which operators say they support Crawl-delay. Request spacing is recorded for everyone and shown on the Rules page.
User agent names an operator and a contact addressGood to EvilPort 443An event carries the species a user agent matched and nothing else about it, so whether it gave a contact address is not in the log.
Offends again after QuarantineGood to EvilQuarantineThe warden holds and releases a bot from what the log says, but a hold and a release are not themselves written to the log yet.