July 2, 2026

Cloudflare gives AI crawlers a September deadline: pay publishers or get blocked

a view of a basketball court from inside a building
JIRAN FAMILY / Unsplash

Cloudflare has set the AI industry a deadline. From September, it will block the crawlers that hoover up content for AI training. Any page that carries ads becomes off-limits, unless the site’s owner says otherwise. The pitch is simple: stop giving t...