Anti-Bot
Search, Agent, or Training? Cloudflare's New Bot Rules and Your Scraper
Cloudflare announced that Training and Agent bots would be blocked by default on ad-supported pages from September 15 — then quietly revised it six weeks later. Here is what the rule actually says now, and the 20-minute audit worth running on your pipeline.