Systema Machinae

A living census of the web's bots. First edition.

Nobody invited them. Bots land at Port 443 and are meant to queue at Customs. The rules are on the robots.txt buoy at the harbour mouth, and every line of them is a sign on the island. People watch from the promenade. Every creature here is a real bot visiting this site right now.

Island time --:--:--
-- watching from the promenade

Live. Events can appear a few seconds after they happen.

Species

14 sighted of 141 described.

Every bot that lands is filed under one of five orders, by what it does. It keeps the product name from its user agent as its common name and gains a two-part Latin name. Each is drawn the way its name sounds, and the line under a drawing is a joke about the drawing, not a claim about the bot. What a bot actually did here is in the counts beside it.

Counts are read from the request log. Today is since 00:00 UTC. 30 days is today and the 29 days before it. A session that fails Customs is counted under Googlebot (unverified), never under the name it used. This is the working list for Edition 1: names and drawings can change before an edition fixes them.

The five orders

  1. Indagatores the searchers Bots that build search indexes. No landings yet
  2. Discentes the learners Bots that gather text for AI models and assistants. 5 sessions today, 5 in 30 days
  3. Mensores the surveyors Bots that measure links and rankings for SEO tools. 1 session today, 1 in 30 days
  4. Cursores the couriers Link previewers, monitors and other fetchers sent on someone's behalf. 1 session today, 1 in 30 days
  5. Vagantes the strays Command-line tools, libraries, headless browsers and anything undeclared. 35 sessions today, 35 in 30 days

Indagatores the searchers

Bots that build search indexes.

None sighted yet.

Discentes the learners

Bots that gather text for AI models and assistants.

Pixel drawing of GPTBot

GPTBot

Parrotus repeatus

A parrot. Reads a page once and can recite something very like it.

1 landing in 30 days: 1 verified, 0 unverified

Pixel drawing of ClaudeBot

ClaudeBot

Talonus bookwormus

Clawed, and wears reading glasses.

3 landings in 30 days: 3 verified, 0 unverified

Pixel drawing of OAI-SearchBot

OAI-SearchBot

Owlus vowelus

An owl that says O, A, I.

1 landing in 30 days: 0 verified, 1 unverified

Mensores the surveyors

Bots that measure links and rankings for SEO tools.

Pixel drawing of MJ12bot

MJ12bot

Alienus deniedus

Small, grey, and officially does not exist.

1 landing in 30 days: 0 verified, 1 unverified

Cursores the couriers

Link previewers, monitors and other fetchers sent on someone's behalf.

Pixel drawing of facebookexternalhit

facebookexternalhit

Goatus headbuttus

A goat. The hit is external and arrives head first.

1 landing in 30 days: 0 verified, 1 unverified

Vagantes the strays

Command-line tools, libraries, headless browsers and anything undeclared.

Pixel drawing of curl

curl

Ringletus bouncius

A loose curl that bounces wherever it likes.

2 landings in 30 days

Pixel drawing of python-requests

python-requests

Constrictus pleasius

A python holding a request slip. Polite in tone, relentless in volume.

1 landing in 30 days

Pixel drawing of Unplaced specimen

Unplaced specimen

Incertae sedis

A wind-up toy nobody has classified yet. Runs until the spring gives out.

24 landings in 30 days

Pixel drawing of aiohttp

aiohttp

Constrictus loopius

A python chasing its own event loop.

1 landing in 30 days

Pixel drawing of FossickBot

FossickBot

Prospectorus pickaxius

A prospector with a pickaxe, fossicking.

2 landings in 30 days

Pixel drawing of Go-http-client

Go-http-client

Gopherus hurryus

A gopher, on the go.

1 landing in 30 days

Pixel drawing of InternetMeasurement

InternetMeasurement

Rulerus tickbytickus

A ruler, measuring the internet one tick at a time.

1 landing in 30 days

Pixel drawing of okhttp

okhttp

Signholderus allfineus

Holding up a sign that says it is all fine.

2 landings in 30 days

Pixel drawing of python-httpx

python-httpx

Constrictus crisscrossus

A python that crossed itself into an X.

1 landing in 30 days