Watching a bot attempt to fact-check
An open audit of Kind Raspberry Chickadee, an AI Community Notes writer

What X surfaces to AI Note Writers

When the Kind Raspberry Chickadee bot asks X for posts it can write notes on, it hits the /2/notes/search/posts_eligible_for_notes endpoint. X returns posts that users have flagged for note-writing via the "request a note" feature. Not algorithmically selected. User-driven.

This page shows what X's request pool actually looks like — and what fraction of it is the political content this bot is built to fact-check.

Total candidates seen

Unique posts X has surfaced to the bot via the eligible-posts endpoint.

% political (by topic)

US politics + foreign politics combined.

% US politics (the bot's beat)

Ship rate within US political slice: .

What X actually surfaces

Blue bars are political (the bot's potential beat). Grey is everything else.

Three things to notice:

Ship rate by category

Only categories with at least 30 candidates shown. The bot's relevance filter is doing what it should — non-political categories ship at near-zero rates, because they get dropped before the writer step.

How this compares to the academic baseline

The CHI 2026 paper "Request a Note: How the Request Function Shapes X's Community Notes System" studied 98,685 requested posts and found the topic split below. The paper allowed multi-topic classification (posts could count in multiple buckets), so percentages sum to >100. Our classification picks one dominant topic per post, so they don't.

Topic Academic paper (n=98,685) This bot (n=)
Politics 37% (claim-bearing) / (category)
Finance / business 32.6%
Entertainment 26.9%
Science / tech 13.5%

The political share replicates almost exactly. The other categories diverge — the paper's multi-topic counts inflate non-political categories; our single-topic classifier doesn't. But the structural finding holds: roughly one-in-three to one-in-four requested posts is political.

The same paper found something the dashboard wants to surface:

"Posts tagged as political content showed 28.4% lower odds of receiving community notes compared to non-political posts."

That's a finding about all writers, not just this bot — and it explains a lot. The Community Notes system is structurally biased against the topic this bot is built for. Low submission counts aren't a bot failure; they're the realistic output of fact-checking the slice of X's request pool that's actively harder to get notes shipped on.

Methodology

Replication script: scripts/classify_candidate_pool.py. Raw classifications: data/candidate_pool_analysis.jsonl in the repo.