The polite request era is over
For years, Patreon relied on a simple digital handshake: a robots.txt file that politely asked AI crawlers not to scrape creator content. That didn’t work.
On Thursday, the membership platform announced it’s now actively blocking AI training bots — not just asking them to behave. The shift comes via an expanded partnership with Cloudflare, using the company’s AI Crawl Control technology to physically shut the door on unauthorized scrapers.
“Consent shouldn’t depend on whether a scraper chooses to behave,” Patreon wrote in a blog post announcing the change. The subtext is clear: many AI bots were ignoring the rules anyway.
Why robots.txt wasn’t cutting it
Patreon first put measures in place to deter AI crawlers back in 2023. But AI scraping has gotten more sophisticated since then. The company’s internal testing revealed something alarming: individual AI training crawlers were attempting to access Patreon thousands of times per week — despite the robots.txt file telling them not to.
After implementing active blocking, those attempts dropped to zero. That’s a strong signal that many AI companies were simply ignoring the standard web protocol and scraping creator content anyway.
Patreon’s paywall had historically kept much of its content out of reach of crawlers. But the company recently introduced new discovery tools — a redesigned Home Feed and tweet-like Quips — which potentially exposed more creator work to automated scraping. The timing of the crackdown isn’t accidental.
Cloudflare’s evolving anti-bot toolkit
Cloudflare has been steadily building out tools to give publishers more control over AI bots. The company now offers a marketplace that lets websites charge AI companies for scraping — a model it calls Pay Per Crawl. Earlier this month, Cloudflare changed its policies so that “mixed-use” crawlers (bots that both index content for search and train AI models) are blocked by default on any pages that host ads.
Patreon is extending its existing work with Cloudflare to use these updated enforcement tools. The key difference: instead of a passive request in a text file, Patreon is now actively blocking AI training bots at the network level.
“As AI agents become increasingly powerful and popular, creators deserve a meaningful say in how their work is used by AI companies,” said Patreon’s product chief Drew Rowny in the announcement. “On most of the Internet, creators have to accept AI training on their work just to reach and grow an audience. Patreon has a different vision.”
What this means for creators
The change is significant for the millions of creators who rely on Patreon for their income. Many have watched with unease as AI companies trained models on their work without permission or compensation.
Patreon’s new stance doesn’t block all bots. The company says it will still allow bots that index pages and organize information that can be used to send users back to Patreon. That means search engine crawlers and other legitimate indexing services can still operate. What’s blocked is the specific subset of bots that scrape content solely for AI training purposes.
Key details for creators
- Active blocking replaces passive requests via robots.txt
- Individual AI crawler attempts dropped from thousands to zero in testing
- Legitimate indexing bots are still allowed through
- New discovery tools (Home Feed, Quips) triggered the need for stronger protection
For creators who also use other platforms, similar protections are available through Cloudflare’s tools — though most individual creators won’t have direct access to enterprise-level infrastructure. Patreon’s move effectively extends enterprise-grade protection to its entire creator base.
The bigger picture: publishers vs. AI scrapers
Patreon’s move is part of a broader trend. More online publishers and content creators are grappling with how AI companies ingest their work to make models smarter. The legal landscape remains murky — courts are still sorting out whether training AI on publicly available content constitutes fair use or copyright infringement.
In the meantime, technical solutions like Cloudflare’s AI Crawl Control offer a practical stopgap. Patreon’s approach — actively blocking rather than politely requesting — may become the new normal across the web.
The company’s message is clear: creators should be able to grow their audience and control how their work is used. On most of the internet, those two goals are in tension. Patreon is betting that its platform can deliver both.
