USA Today Co. is restructuring how its content is built for a reader that never sees a headline: the AI crawler. The company is converting pages into markdown, restructuring templates into guides and multi-module stories, and rewriting metadata specifically to make its content easier for AI systems to parse — moves confirmed by CEO Mike Reed and SVP of Product Management Kara Chiles, both on the record. Reed’s framing is blunt about the goal: “We do see more AI licensing deals coming this year. Our objective here is not just to sign more agreements, but it’s really to build recurring, long-term relationships where we get proper recognition.” Chiles is equally blunt about what the work actually looks like day to day: “A lot of what we’re doing right now is probably not going to be recognizable to the human end user. It’s a lot of the infrastructure.”
The catch is that USA Today is doing this while still keeping most bots out. The company blocks roughly 99% of self-identified AI bots by default. It whitelists only approved partners — the same posture Atlantic, People Inc., Reuters and Time have already taken. That is the actual operator move underneath the headline: reformatting content isn’t an invitation to every crawler, it’s infrastructure built for the ones you’ve already decided to let in and get paid by. Outside consultant Ameet Shah’s read is that this pattern will stay concentrated among large publishers with genuinely unique content, and will spread fastest during site redesigns that were happening anyway.
01Why this matters for publishers
| The default-block-then-whitelist pattern is now a five-publisher consensus | USA Today joins Atlantic, People Inc., Reuters and Time in blocking roughly 99% of bots by default. That's no longer one company's experiment — it's becoming the operating norm for publishers big enough to negotiate. |
|---|---|
| This directly collides with GAM/AdX traffic economics | The same crawler-control decisions that gate AI licensing revenue also gate the referral traffic that funds programmatic yield — a publisher tightening bot access for licensing leverage is making the same infrastructure choice that determines what AI search sends back to the site. |
| The reformatting spend has no clean payback yet | Reed's own framing — "not just to sign more agreements" but "recurring, long-term relationships" — is an admission that today's licensing deals are still ad hoc, not a repeatable revenue line with a defined rate card. |
| Scale is the gate | Shah's read — concentrated among large publishers with unique content — means this is a strategy for operators with real negotiating leverage over AI companies, not a template a mid-sized publisher can copy directly. |
02What publishers should do
03The bottom line
USA Today’s move is a tell about where publisher AI strategy is actually heading: not “block everything” or “open everything,” but a curated gate — 99% blocked by default, a whitelist of paying partners, and real engineering spend making the content legible to exactly those partners. For GAM operators, the crawler-access decision underneath this story is the same one that shapes referral traffic and programmatic yield, which means it can’t be delegated to whoever owns the licensing relationship alone.