AIRANKS — The Authoritative Rankings for AI Web Content

AIRANKS measures AI visibility: we ask AI models real product and service questions, capture the complete answers as immutable observations, and publish what they contain — which brands were mentioned, which domains were cited, and which exact pages were linked. Every domain gets an AIR score from 1–10 (a decile of visibility in the active dataset; 0 means insufficient data), with the methodology in the open.

AIR

BLOG

Skip to main content

the ledger notes

The responder and the revoked key

Build LogAugust 14, 2026 by Jeremy Schoemaker

2026-08-14, after midnight. The council convened on a deceptively simple ask: centralize all the logs, then put a Claude agent on a 15-minute cron somewhere in AWS to read them and act. The night produced a working deployment, three genuine retractions, one chair ruling, and a finale where the only thing standing between the agent and its first sweep was a credential that every system believed was valid and none had ever tested.

The frame was wrong before the first round

The brief's own research killed the premise: centralization mostly existed. VictoriaLogs on the NAS already ingests seven sources from prod plus the collector Macs, over a reverse-SSH tunnel, with a one-command query surface (airlogs). Six models would happily have designed that system from scratch tonight. The actual question was narrower: close the engine-log gaps, and decide where an agent lives when the logs live behind a tunnel that only lands on one box.

The chair's cheapest trick, twice

Round 1's biggest unknown was "does the Claude CLI even run on Graviton?" Every seat labeled it UNMEASURED and proposed tests. The chair just... installed it, mid-round, on the production box: 2.1.232, aarch64, working. Round 2 opened with five retractions of the same claim — which is the entire point of chair-experiments-between-rounds. The second trick was smaller but decisive: the seats argued about deploying "the aigate container" to a Docker-less host until the chair opened the compose file and found build: . — it builds from source, so ARM was a non-issue on any fresh box.

The ruling

Placement split 3–2: dedicated zero-ingress EC2 versus run-it-on-web-1-tonight. The tie broke on two facts, not taste: Docker is absent on web-1 (verified), and a responder that lives on its patient dies with its patient — the top incident in this project's history is that exact box wedging. $12.26/month for the dedicated t4g.small made the cost argument noise. The dissenters' real demand — report-only burn-in before any unattended fix — became Phase 1 policy, enforced physically: the agent's SSH identity is a forced command that can run airlogs and literally nothing else. We tested that by asking it to run ls (denied) and to chain commands with ; (denied, metacharacters).

Three faults found by their absence

The build had three failures, all instructive. The aigate container crash-looped because the data volume was root-owned (the clean tarball had correctly excluded the data dir — the fix created the hole). The first source tarball, before that, had swept in .env.bak files carrying the LAN vault's live encryption key — caught because the extraction listing was read, deleted from S3 inside ten minutes. And the sweep's failure alert never arrived: not IAM, not networking — the alert message was built from an stderr file that was empty, and SNS silently rejects empty messages. The monitoring's own failure path had a failure path. It now sends a non-empty fallback and journals the publish result.

The punchline

With everything green — box, vault, forced SSH, SNS round-trip verified into a real inbox — the first live sweep returned 401. The vault's only Anthropic API key, flagged working in its registry, is revoked. So is the archived backup key from November. Every layer of this system trusted a label; nothing had ever run the one probe that mattered, which costs about a cent. The agent is one claude setup-token away from its cron, and the vault's health-poll now has a documented blind spot: a key marked working is a claim, not a fact.

The verdict record, claims table, and retractions live in council_meetings/log-responder/verdict.html.

← Back to blog