测试显示，单个 AI 训练爬虫的每周访问尝试从"数千次降至零"，表明此前爬虫无视了 robots.txt。 Patreon 表示将允许用于索引并引导用户返回平台的爬虫。
Patreon：https://www.patreon.com，作为一个面向创作者的会员平台，正在打击用于训练人工智能的内容抓取行为。周四，该公司表示，它正在与互联网基础设施提供商 Cloudflare 合作，直接阻止旨在未经允许训练其 AI 模型的 AI 机器人访问创作者作品。
该公司表示，由于自 2023 年首次采取措施阻止 AI 爬虫以来，AI 抓取技术已变得更为复杂，因此加强措施是必要的。此外，Patreon 的付费墙长期以来已经将大部分创作者内容锁在爬虫触及不到的范围内。但近来，该公司推出了新的内容发现工具，如重新设计的首页信息流和类似推文的 Quips：https://www.theverge.com/tech/920988/patreons-tweet-like-quips-are-now-widely-available，这可能会将更多内容暴露给爬虫。
这些变化发生之际，越来越多的在线出版商和内容创作者正逐渐意识到 AI 正在吞噬他们的作品以提升 AI 模型的智能。为应对这一问题，Cloudflare 现提供工具，允许网站发布商限制 AI 机器人访问：https://techcrunch.com/2024/07/03/cloudflare-launches-a-tool-to-combat-ai-bots/，包括一个让网站向 AI 机器人收取抓取费用的市场：https://techcrunch.com/2025/07/01/cloudflare-launches-a-marketplace-that-lets-websites-charge-ai-bots-for-scraping/，称为 “按抓取付费”（Pay Per Crawl）。本月早些时候，Cloudflare 修改了其政策：https://techcrunch.com/2026/07/01/cloudflares-new-policy-pushes-ai-companies-to-pay-for-publishers-content/，使“混合用途”爬虫，即同时索引和训练网站内容的爬虫，在任何包含广告的页面上默认被阻止。
Patreon 表示，它正在扩大与 Cloudflare 的现有合作，使用该公司的 AI 爬虫控制技术来更新其 AI 政策和执行工具。不同之处在于，Patreon 现在不仅仅是通过 robots.txt 文件——一种向机器人提供网站使用指导的标准方式——请求 AI 爬虫不要抓取内容，而是主动阻止 AI 训练机器人。
Patreon 在一篇博客中写道：https://www.patreon.com/patreon/posts/patreon-to-ai-164027757，“同意不应该取决于抓取者是否选择遵守行为规范”，并提到了更严格的措施。
在测试这些功能时，帖子指出，各个 AI 训练爬虫每周尝试访问 Patreon 的次数从“数千次尝试降至零”。这表明 AI 抓取工具无视 Patreon 的 robots.txt 文件，仍然抓取网站内容，尽管该网站提出了请求。
然而，该公司表示，它将允许那些索引页面并整理信息的机器人，这些信息可用于将用户重新导回 Patreon。
Patreon 产品主管 Drew Rowny 在公告中表示：“随着 AI 代理变得越来越强大和流行，创作者应当对自己的作品如何被 AI 公司使用拥有实质性发言权。 在互联网上的大多数地方，创作者必须接受对其作品进行 AI 训练，以便触达和扩大观众群。Patreon 有不同的愿景：创作者应能够扩大自己的观众群，并控制作品的使用方式。”
当您通过我们文章中的链接购买时，我们可能会获得少量佣金：https://techcrunch.com/techcrunch-affiliate-monetization-standards/。这不会影响我们的编辑独立性。
抢救最后机会，在 TechCrunch 创始人峰会上节省高达 190 美元。加入 1,000 名不同时阶段的创始人和风险投资人，获取实际可行的扩展见解和推动进展的人脉网络。优惠截止时间为 6 月 26 日太平洋时间晚上 11:59。
德克萨斯州致命车祸中的特斯拉司机踩下油门 100%，NTSB 确认：https://techcrunch.com/2026/07/15/tesla-driver-in-fatal-texas-crash-pressed-accelerator-100-ntsb-confirms/ Sean O'Kane：https://techcrunch.com/author/sean-okane/
在硬件法律纠纷中，OpenAI 发布了一款售价 230 美元的 Codex 键盘：https://techcrunch.com/2026/07/15/amid-hardware-legal-battle-openai-releases-a-230-keyboard-for-codex/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
据报道，OpenAI 的首款硬件设备是一款无屏扬声器，能够移动：https://techcrunch.com/2026/07/14/openais-first-hardware-device-is-reportedly-a-screenless-speaker-that-can-move/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
Anthropic 最新的广告让人感到毛骨悚然：https://techcrunch.com/2026/07/14/anthropics-newest-ad-is-creeping-people-out/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
萨蒂亚·纳德拉对使用人工智能的公司发出了令人震惊的警告：https://techcrunch.com/2026/07/13/satya-nadella-has-issued-a-shocking-warning-to-companies-using-ai/ 朱莉·博特：https://techcrunch.com/author/julie-bort/
苹果针对OpenAI的商业机密诉讼中最疯狂的指控：https://techcrunch.com/2026/07/13/the-wildest-allegations-in-apples-trade-secrets-lawsuit-against-openai/ 莎拉·佩雷斯：https://techcrunch.com/author/sarah-perez/
Anthropic开始为印度本地化Claude的定价，这是继美国之后最大的市场：https://techcrunch.com/2026/07/13/anthropic-starts-localizing-claude-pricing-for-india-its-biggest-market-after-the-us/ 贾格米特·辛格：https://techcrunch.com/author/jagmeet-singh/
Patreon：https://www.patreon.com, the membership platform for creators, is cracking down on AI scraping its content for training purposes. On Thursday, the company shared that it’s working with internet infrastructure provider Cloudflare to directly block access to AI bots designed to train their AI models on creators’ work without permission.
The strengthened measures were necessary because AI scraping has become more sophisticated since it first put measures in place to deter AI crawlers in 2023, the company says. In addition, Patreon’s paywall has long locked much of creators’ content out of reach of crawlers. But more recently, the company introduced new discovery tools like a redesigned Home Feed and its tweet-like Quips：https://www.theverge.com/tech/920988/patreons-tweet-like-quips-are-now-widely-available, which could expose more content to crawlers.
The changes come about as more online publishers and content creators are coming to grips with how AI is ingesting their work for the purpose of making their AI models smarter. To combat this, Cloudflare now offers tools that allow website publishers to restrict AI bots：https://techcrunch.com/2024/07/03/cloudflare-launches-a-tool-to-combat-ai-bots/, including a marketplace that lets websites charge AI bots for scraping：https://techcrunch.com/2025/07/01/cloudflare-launches-a-marketplace-that-lets-websites-charge-ai-bots-for-scraping/, dubbed Pay Per Crawl. Earlier this month, it changed its policies：https://techcrunch.com/2026/07/01/cloudflares-new-policy-pushes-ai-companies-to-pay-for-publishers-content/ so that “mixed-use” crawlers, meaning those that both index and train on a website’s content, are blocked by default on any pages that host ads.
Patreon says that it’s extending its existing work with Cloudflare to use the company’s AI Crawl Control technology to update its AI policies and enforcement tools. The difference here is that instead of simply asking AI crawlers not to scrape content using the robots.txt files — a standard way to provide bots with instructions on how they can use its site — Patreon is now actively blocking AI training bots.
“Consent shouldn’t depend on whether a scraper chooses to behave,” a Patreon blog post：https://www.patreon.com/patreon/posts/patreon-to-ai-164027757 explains, referencing the stricter measures.
When testing the features, individual AI training crawlers’ weekly attempts to access Patreon went from “thousands of attempts to zero,” the post noted. That indicates that the AI scrapers were ignoring Patreon’s robots.txt file and scraping the site anyway, despite its requests.
However, the company said that it will allow bots that index pages and organize information that can be used to send users back to Patreon.
“As AI agents become increasingly powerful and popular, creators deserve a meaningful say in how their work is used by AI companies,” remarked Patreon’s product chief Drew Rowny in the announcement. “On most of the Internet, creators have to accept AI training on their work just to reach and grow an audience. Patreon has a different vision: creators should be able to grow their audience and control how their work is used.”
When you purchase through links in our articles, we may earn a small commission：https://techcrunch.com/techcrunch-affiliate-monetization-standards/. This doesn’t affect our editorial independence.
Last chance to save up to $190 on TechCrunch Founder Summit. Join 1,000+ founders and VCs at all stages for real-world scaling insights and connections that move the needle. Savings end June 26, 11:59 p.m. PT .
Tesla driver in fatal Texas crash pressed accelerator 100%, NTSB confirms：https://techcrunch.com/2026/07/15/tesla-driver-in-fatal-texas-crash-pressed-accelerator-100-ntsb-confirms/ Sean O'Kane：https://techcrunch.com/author/sean-okane/
Amid hardware legal battle, OpenAI releases a $230 keyboard for Codex：https://techcrunch.com/2026/07/15/amid-hardware-legal-battle-openai-releases-a-230-keyboard-for-codex/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
OpenAI’s first hardware device is reportedly a screenless speaker that can move：https://techcrunch.com/2026/07/14/openais-first-hardware-device-is-reportedly-a-screenless-speaker-that-can-move/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
Anthropic’s newest ad is creeping people out：https://techcrunch.com/2026/07/14/anthropics-newest-ad-is-creeping-people-out/ Lucas Ropek：https://techcrunch.com/author/lucas-ropek/
Satya Nadella has issued a shocking warning to companies using AI：https://techcrunch.com/2026/07/13/satya-nadella-has-issued-a-shocking-warning-to-companies-using-ai/ Julie Bort：https://techcrunch.com/author/julie-bort/
The wildest allegations in Apple’s trade secrets lawsuit against OpenAI：https://techcrunch.com/2026/07/13/the-wildest-allegations-in-apples-trade-secrets-lawsuit-against-openai/ Sarah Perez：https://techcrunch.com/author/sarah-perez/
Anthropic starts localizing Claude pricing for India, its biggest market after the US：https://techcrunch.com/2026/07/13/anthropic-starts-localizing-claude-pricing-for-india-its-biggest-market-after-the-us/ Jagmeet Singh：https://techcrunch.com/author/jagmeet-singh/
扫码直达文章详情