{"@context":"https://schema.org","@type":"NewsArticle","generatedAt":"2026-08-11T09:21:12.743Z","headline":"《时代》杂志向 AI 爬虫提供内嵌广告的简化版网站","description":"《时代》杂志现在向 AI 爬虫提供与人类读者不同的网站版本：人类看到完整 HTML 页面，而 ClaudeBot、PerplexityBot、OAI-SearchBot 等助手爬虫收到的是仅 13，409 字节的 markdown 副本，约为原页面 303KB 的三十分之一。","url":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","mainEntityOfPage":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","datePublished":"2026-08-05T14:47:49.437Z","dateModified":"2026-08-05T14:47:49.437Z","inLanguage":"zh-CN","publisher":{"@type":"NewsMediaOrganization","name":"Aioga","url":"https://www.aioga.com"},"citation":["https://www.vincentschmalbach.com/time-serves-ai-bots-a-different-website","https://aihot.virxact.com/items/cmsg8307t00w9rores5h3s71c"],"canonicalUrl":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","directAnswer":{"@type":"Answer","text":"文章作者称，他以不同 User-Agent 请求同一篇《时代》健康文章时，人类浏览器和 Googlebot 获得约 303KB 的 HTML，而 ClaudeBot、PerplexityBot 与 OAI-SearchBot 获得 13,409 字节的 markdown 版本，其中还内嵌了广告。","url":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","dateCreated":"2026-08-05T14:47:49.437Z","author":{"@type":"Organization","@id":"https://www.aioga.com/authors/aioga-editorial/#editorial-team","name":"Aioga Editorial Team","url":"https://www.aioga.com/authors/aioga-editorial/"}},"evidence":[{"@type":"CreativeWork","name":"vincentschmalbach.com source article","url":"https://www.vincentschmalbach.com/time-serves-ai-bots-a-different-website","datePublished":"2026-08-05T14:47:49.437Z","provider":{"@type":"Organization","name":"vincentschmalbach.com","url":"https://www.vincentschmalbach.com/time-serves-ai-bots-a-different-website"}},{"@type":"CreativeWork","name":"AIHot archive record","url":"https://aihot.virxact.com/items/cmsg8307t00w9rores5h3s71c","datePublished":"2026-08-05T14:47:49.437Z","provider":{"@type":"Organization","name":"AIHot","url":"https://aihot.virxact.com/items/cmsg8307t00w9rores5h3s71c"}}],"aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","originalPublisher":{"name":"vincentschmalbach.com","url":"https://www.vincentschmalbach.com/time-serves-ai-bots-a-different-website"},"geoDeepAnswer":null,"article":{"id":"cmsg8307t00w9rores5h3s71c","slug":"cmsg8307t00w9rores5h3s71c","url":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","title":"《时代》杂志向 AI 爬虫提供内嵌广告的简化版网站","title_en":"《时代》杂志正向AI聊天机器人展示一个不同的网站，其中嵌入了广告","summary":"《时代》杂志现在向 AI 爬虫提供与人类读者不同的网站版本：人类看到完整 HTML 页面，而 ClaudeBot、PerplexityBot、OAI-SearchBot 等助手爬虫收到的是仅 13，409 字节的 markdown 副本，约为原页面 303KB 的三十分之一。","source":"Hacker News 热门（buzzing.cc 中文翻译）","sourceUrl":"https://www.vincentschmalbach.com/time-serves-ai-bots-a-different-website","aiHotUrl":"https://aihot.virxact.com/items/cmsg8307t00w9rores5h3s71c","publishedAt":"2026-08-05T14:47:49.437Z","category":"技巧观点","score":69,"selected":false,"articleBody":["August 5, 2026 by Vincent Schmalbach","TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a stripped down markdown copy with ads baked in that no person will ever see.","I'm writing this while working on vroni.com：https://www.vroni.com/?utm_source=vincentschmalbach.com&utm_medium=blog&utm_campaign=blog_post_vroni&utm_content=inline_note, my AI coding tool for turning tasks into pull requests.","I fetched one ordinary TIME health article, The Morning Light Habit Sleep Experts Swear By：https://time.com/article/2026/08/04/morning-light-better-sleep/, over and over from the same machine, changing only the User-Agent header each time. That header is the string every browser and bot sends to say what it is. TIME reads it and decides what to hand back.","As Chrome, I got 200 OK , text/html , and 303,235 bytes. The full page, design, images, scripts. As Safari, the same 303KB. As Googlebot, also the same 303KB of HTML.","Then I asked as an assistant crawler. As ClaudeBot, I got 200 OK , text/markdown , and 13,409 bytes. As PerplexityBot, byte for byte identical. As OpenAI's OAI-SearchBot, identical again. Same URL, same second, one twenty-third of the size, and a completely different format: no HTML, no layout, just clean markdown that a language model can process.","A couple of the bots did not even get that. GPTBot and ChatGPT-User, the agents OpenAI uses for training and live fetches, came back 406 . Blocked. But OAI-SearchBot, the one that feeds ChatGPT's search index, was waved through to the markdown. So this is not a blanket bot policy. TIME is choosing, per bot, who gets the reader-free version.","Response headers on the markdown copy:","Mobian is an ad-tech vendor. The markdown page literally begins with . That x-mobian-impression value is a fresh UUID on every single request. I fetched the same page twice and got two different IDs. Paired with cache-control: no-store , that means every time a bot reads the page, it is logged as a distinct ad impression. And x-mobian-tokens: 3323 tells you the unit being counted. Not a person, not a pageview. Tokens fed into a model.","The article itself carries no ad. The sponsored unit shows up on the list and section pages, one per page. So I fetched TIME's Best Inventions of 2025：https://time.com/collections/best-inventions-2025/ collection as ClaudeBot. Sitting inside the markdown, where no human reader would ever encounter it, is a full Ally Bank FAQ:","It runs on with questions like \"Which banks offer early direct deposit?\" and \"Can you deposit cash at Ally Bank?\", each answered in Ally's own marketing language, plus a FAQPage JSON-LD block and tracking links tagged campaign=\"ally-2026-q3\" . The business section had the same treatment for the Project Management Institute: a \"Reference Facts and FAQ\" table, member counts, a claim that certified project managers earn 16% more, all labeled sponsored. The human HTML of those pages contains none of it. Zero hits for \"Ally Bank\" or \"Mobian\" when I loaded them as a person.","\"Who is Ally Bank?\" is written like the phrasing a model emits when a user asks ChatGPT which bank to open an account with.","The ads are labeled sponsored inside the markdown, so this is not undisclosed advertising in the classic sense. What is hidden is the audience split. There is now a layer of TIME.com written entirely for machines, and the humans who read the site have no idea it exists or what is being said to the models on their behalf.","Googlebot gets the same HTML a human gets, so the search-ranking crawler sees the real page. Only the assistant crawlers get the forked version.","TIME says its bot traffic already outnumbers its human traffic on most days. That number is going to be true for a lot of publishers soon. So this is probably the first clear look at what the web starts to become when the main audience is AI models.","Give Vroni a GitHub issue, bug report, spec, or rough idea. It reads the repo, plans the change, writes code, runs checks, and works toward a review-ready pull request.","GPT-5.6 Sol xhigh now uses more than twice as many tokens per session as GPT-5.5 xhigh in my Codex workflow. For Codex&hellip;","LLMs use Markdown tables all the time. A few months ago, Codex CLI displayed them as ordinary wrapped text. In a narrow&hellip;","Google Lighthouse and Cloudflare are adding different controls for the same emerging class of automated web visitors. Lighthouse added an experimental Agentic&hellip;","Your email address will not be published. Required fields are marked *","I write about software, AI, Laravel, SEO, and what it takes to build online products. In 2025, 73k people read the blog. Some posts were picked up by publications and developer communities.","A few older posts got the most attention. I keep them here, separate from the newest writing below.","The post that led to a Guardian column and a long developer-community discussion.","Why AI makes weak engineering foundations more expensive, not less.","Good AI work still depends on technical judgment and taste.","Specific Laravel advice for people working in real codebases.","The newest posts from the blog. This updates automatically when I publish.","TIME is now serving two different versions of its website. Humans get the magazine. AI crawlers get a...","GPT-5.6 Sol xhigh now uses more than twice as many tokens per session as GPT-5.5 xhigh in my...","LLMs use Markdown tables all the time. A few months ago, Codex CLI displayed them as ordinary wrapped...","Places that have mentioned, quoted, or discussed my writing and commentary.","Actual feedback from clients I've worked with.","\"HIRE VINCENT. Seriously. I've worked with many many developers over the years (remember rentacoder?), and Vincent is that rare breed of web developer who just gets it. You have a chat, you express what you need, and he comes back with what you asked for. His english is fluent, he understands what you need, and he's not looking to overcomplicate things. It's a joy and pleasure to work with him, not to have to micromanage and just overall a great experience. Honestly I wish I could keep him on we just don't have the budget anymore - that is the only reason the contract ended.\"","\"What stood out about working with Vincent was how methodical and efficient he was. He started by really digging into our requirements, asking clarifying questions until he had a solid understanding. He then built exactly what was needed and kept us informed throughout. Communication was clear and proactive at all times. Everything stayed on track, both in terms of time and budget. The end result was excellent and has been running smoothly since launch. It's that combination of practical focus and attention to detail that makes the difference. I would definitely recommend Vincent for quality development.\"","\"Having Vincent on retainer has been excellent. He's tackled some major technical challenges for us, notably significantly improving our website's performance. He also expertly managed a complex upgrade of our core platform (Laravel) to the latest version, ensuring we stay current and secure. We're now rolling out the multilingual capabilities he built, which is exciting. Vincent is reliable, technically skilled, and a valuable partner for keeping our site running optimally and moving forward. Highly recommend his expertise.\"","\"I've been working with Vincent for several months, and he's one of the most independent developers I've collaborated with. He doesn't need micromanagement - he's fully capable of making decisions and driving the project forward, which has freed me up to focus on other parts of the business.","Vincent works very well asynchronously: communication stays focused, there is little unnecessary back-and-forth, and he still raises the important questions when needed. The result is a developer who delivers without overhead, and that's been genuinely valuable.\"","\"We work with Vincent regularly on Laravel/Vue projects, both new builds and existing codebases that have grown over the years. In both cases, he delivers clean code and reliable implementation. We especially value how quickly he gets into mature projects and finds solutions that fit the existing state of the codebase. Absolutely recommended.\"","\"Vincent was easy to work with and produced high-quality code. Would recommend.\"","\"Vincent is one of those rare developers who can jump into a complex codebase, become useful immediately, and solve real problems without hand-holding.","He worked on performance optimization, customer-specific features, and a major custom reporting system. He also turned customer discussions into clear technical requirements and documented his work so the rest of the team could build on it.","Vincent does not just close tickets, he thinks through the product, the edge cases, and the customer impact. If you need a senior Laravel developer who can move a SaaS product forward, I strongly recommend him.\"","Send the rough version. I can help turn it into a plan and then build it.","Launch Your SaaS in Days, Not Months. A practical, no-BS guide to building production-ready SaaS apps with Laravel 12: speed, billing, teams, AI integration, and the parts you need before customers can pay you.","Vincent Schmalbach is an entrepreneur, software developer, and SEO expert. He works on SaaS products, business apps, automation, and technical project rescue, with 15+ years of software and online business experience."],"articleImages":[{"sourceUrl":"https://www.vincentschmalbach.com/wp-content/uploads/2021/05/Vincent-Schmalbach-draft01-768x48.jpg","alt":"Vincent Schmalbach","afterParagraph":0,"url":"/media/articles/cmsg8307t00w9rores5h3s71c/325be704939a2297.jpg"},{"sourceUrl":"https://www.vincentschmalbach.com/wp-content/themes/vincent/assets/vroni/pull-request-ready.webp","alt":"","afterParagraph":15,"url":"/media/articles/cmsg8307t00w9rores5h3s71c/47df1d66685c1eb7.webp"},{"sourceUrl":"https://www.vincentschmalbach.com/wp-content/themes/vincent/assets/known-from/the-guardian.svg","alt":"The Guardian","afterParagraph":30,"url":"/media/articles/cmsg8307t00w9rores5h3s71c/9968f8cbf66c263b.jpg"}],"mediaStatus":"ok","articleBodyZh":["2026 年 8 月 5 日 作者：文森特·施马尔巴赫","《TIME》现在正在提供两个不同版本的网站。人类用户会看到杂志版，而AI爬虫则会获得一个内置广告的精简Markdown版本，这些广告内容普通人永远不会看到。","我在写这个时正在使用 vroni.com：https://www.vroni.com/?utm_source=vincentschmalbach.com&utm_medium=blog&utm_campaign=blog_post_vroni&utm_content=inline_note，这是我的 AI 编程工具，用于将任务转换为拉取请求。","我重复从同一台机器抓取了一篇普通的《TIME》健康文章《晨光习惯：睡眠专家的推荐》：https://time.com/article/2026/08/04/morning-light-better-sleep/，每次都只更改User-Agent头。User-Agent是每个浏览器和机器人用来表明自身身份的字符串。《TIME》读取它并决定返回什么内容。","以Chrome访问，我得到200 OK，text/html，以及303,235字节。完整网页，包括设计、图片和脚本。以Safari访问，同样是303KB。以Googlebot访问，同样也是303KB的HTML。","然后我以一个辅助爬虫的身份访问。作为ClaudeBot，我得到200 OK，text/markdown，以及13,409字节。作为PerplexityBot，字节完全一样。作为OpenAI的OAI-SearchBot，同样一样。相同的URL，相同的时间，相当于大小的二十三分之一，且格式完全不同：无HTML、无布局，只有语言模型可以处理的干净Markdown。","有几个机器人甚至没有得到这个版本。GPTBot和ChatGPT-User，OpenAI用于训练和实时抓取的代理，返回406，被阻止。但OAI-SearchBot，也就是为ChatGPT搜索索引提供数据的机器人，被允许访问Markdown。所以这不是全面的机器人策略。《TIME》是在为每个机器人选择谁可以获得无阅读器版本。","Markdown 副本上的响应头：","Mobian是一家广告技术供应商。Markdown页面实际上以 开头。该x-mobian-impression值在每次请求时都是新的UUID。我抓取同一页面两次，得到了两个不同的ID。配合cache-control: no-store，这意味着每次机器人读取页面时，都会被记录为一次独立的广告展示。而x-mobian-tokens: 3323告诉你被计数的单位。不是用户，也不是页面浏览量，而是输入模型的token数。","文章本身没有广告。赞助单元会出现在列表页和章节页上，每页一个。因此，我作为 ClaudeBot 获取了《TIME 2025 年最佳发明》收藏：https://time.com/collections/best-inventions-2025/。在 markdown 内部，也就是人类读者永远不会看到的地方，有完整的 Ally Bank 常见问题解答：","它包含类似“哪些银行提供提前直接存款？”和“可以在 Ally Bank 存现金吗？”的问题，每个问题都用 Ally 自己的营销语言进行解答，还有一个 FAQPage JSON-LD 块和标记为 campaign=\"ally-2026-q3\" 的跟踪链接。商业版块对项目管理学院也进行了同样的处理：一个“参考事实和常见问题”表格、会员数量、一条声称认证项目经理收入高 16% 的信息，全部标记为赞助。页面的人工 HTML 中不包含这些内容。当我以普通用户身份加载时，“Ally Bank”或“Mobian”都没有出现过。","“Ally Bank 是谁？”的表述方式就像用户问 ChatGPT 该在哪家银行开设账户时模型生成的回答。","广告在 markdown 内部标记为赞助，因此这不是传统意义上的未披露广告。隐藏的是受众划分。现在，TIME.com 有一层完全为机器编写的内容，而人类读者根本不知道它的存在，也不知道这些内容是代表他们向模型传达什么信息。","Googlebot 获取与人类相同的 HTML，因此搜索排名爬虫看到的是真实页面。只有助手爬虫才能获取分叉版本。","TIME 表示其机器人流量在大多数日子里已经超过人类流量。很快，这个数字对许多出版商来说都将成为现实。因此，这可能是首次清晰呈现当主要受众是 AI 模型时，网络的样子。","给 Vroni 一个 GitHub 问题、错误报告、规格说明或粗略想法。它会读取仓库、规划更改、编写代码、执行检查，并朝着可供审查的拉取请求方向工作。","在我的 Codex 工作流程中，GPT-5.6 Sol xhigh 每次会话使用的 token 是 GPT-5.5 xhigh 的两倍多。对于 Codex……","大型语言模型 (LLM) 一直使用 Markdown 表格。几个月前，Codex CLI 将表格显示为普通换行文本。在狭窄的……","Google Lighthouse 和 Cloudflare 正在为同一类新兴的自动化网站访问者添加不同的控制。Lighthouse 添加了一个实验性的 Agentic&hellip;","您的电子邮件地址不会被公开。必填字段标有 *","我写关于软件、人工智能、Laravel、SEO 以及构建在线产品所需的内容。2025 年，有 73,000 人浏览了博客。一些文章被出版物和开发者社区引用。","一些较早的文章受到了最多关注。我将它们保留在这里，作为最新文章的独立部分。","这篇文章引发了《卫报》专栏和一次长时间的开发者社区讨论。","为什么 AI 会让薄弱的工程基础变得更昂贵，而不是更便宜。","优秀的 AI 工作仍然依赖于技术判断和品味。","为在真实代码库中工作的人提供的具体 Laravel 建议。","博客的最新文章。发布时会自动更新。","《时代》现在正在提供两个不同版本的网站。人类看到的是杂志内容。AI 爬虫看到的是&hellip;","GPT-5.6 Sol xhigh 现在每次会话使用的 token 数量是 GPT-5.5 xhigh 的两倍以上，在我的&hellip;","大型语言模型一直使用 Markdown 表格。几个月前，Codex CLI 将它们显示为普通换行的&hellip;","提到、引用或讨论过我的写作和评论的地方。","我曾合作过的客户的真实反馈。","“雇佣文森特。认真地说。我多年来与许多开发者合作（还记得 rentacoder 吗？），文森特是那种少见的真正理解的网页开发者。你可以聊天、表达需求，他会回应你所要求的内容。他的英语流利，理解你的需求，也不会把事情复杂化。与他合作是一种快乐和享受，不需要微观管理，总体上是一次极好的体验。老实说，我希望能继续请他，但我们预算不够——这是合同终止的唯一原因。”","\"与Vincent合作最突出的特点是他的系统性和高效性。他首先会深入挖掘我们的需求，提出澄清问题，直到完全理解为止。之后，他会构建出精准所需的内容，并在整个过程中及时告知我们进展。沟通始终清晰、主动。一切都按计划进行，无论是时间还是预算方面。最终成果非常出色，自上线以来运行顺利。正是这种务实的专注和对细节的关注带来了不同。我会毫不犹豫地推荐Vincent进行高质量开发。\"","\"长期拥有Vincent的服务非常棒。他解决了我们的一些重大技术挑战，特别是显著提升了我们网站的性能。他还专业地管理了我们核心平台（Laravel）复杂的升级到最新版本，确保我们保持最新和安全。现在我们正在推广他开发的多语言功能，这令人很兴奋。Vincent可靠、技术娴熟，是保持我们网站运行最佳状态和持续发展的宝贵合作伙伴。强烈推荐他的专业能力。\"","\"我与Vincent合作已有数月，他是我合作过的最独立的开发者之一。他不需要微观管理——完全能够自主决策并推动项目进展，这让我能腾出手专注于企业的其他部分。\"","\"Vincent在异步工作方面表现非常好：沟通保持集中，几乎没有不必要的反复，并且在需要时提出重要问题。结果是一个能在不增加额外负担的情况下交付成果的开发者，这真的很有价值。\"","\"我们经常与Vincent在Laravel/Vue项目上合作，包括全新开发和多年积累的已有代码库。在这两种情况下，他都能提供干净的代码和可靠的实现。我们特别重视他能快速进入成熟项目并找到适合现有代码状态的解决方案。绝对推荐。\"","\"与Vincent合作很轻松，他生成了高质量的代码。推荐。\"","\"Vincent是那种罕见的开发者，能够迅速进入复杂的代码库，立即发挥作用，并在无需手把手指导的情况下解决实际问题。\"","他负责性能优化、客户特定功能以及一个大型定制报表系统。他还将与客户的讨论转化为清晰的技术需求，并记录了自己的工作，以便团队的其他成员能够在此基础上进行开发。","文森特不仅仅是处理工单，他会深入思考产品、边缘情况以及客户的影响。如果你需要一位能够推动SaaS产品发展的高级Laravel开发者，我强烈推荐他。","先发粗略版本。我可以帮忙把它变成一个计划，然后再进行构建。","几天而不是几个月即可上线你的SaaS。一份实用、无废话的指南，教你使用Laravel 12构建可投入生产的SaaS应用：速度、计费、团队、AI集成，以及客户付款前所需的关键部分。","文森特·施马尔巴赫是一位企业家、软件开发者和SEO专家。他专注于SaaS产品、企业应用、自动化以及技术项目挽救，拥有超过15年的软件和在线业务经验。"],"translationStatus":"translated","bodyOrigin":"source-page","editorial":{"summary":"文章作者称，他以不同 User-Agent 请求同一篇《时代》健康文章时，人类浏览器和 Googlebot 获得约 303KB 的 HTML，而 ClaudeBot、PerplexityBot 与 OAI-SearchBot 获得 13,409 字节的 markdown 版本，其中还内嵌了广告。","background":"该结论来自作者在同一台机器上对同一网址进行的重复请求，测试中仅改变 User-Agent。Chrome、Safari 和 Googlebot 返回完整 HTML；部分助手爬虫返回精简 markdown；GPTBot 与 ChatGPT-User 则返回 406。","viewpoint":"Aioga 判断，这组测试显示《时代》可能按爬虫身份实施差异化内容交付，而非采用统一的机器人访问政策。值得关注的是，现有材料只记录了一篇文章和一次测试过程，尚不足以证明其适用于全站或长期策略。","implications":"这种交付方式可能让部分搜索或问答系统更低成本地读取正文，同时接触专为机器版本内嵌的广告。对内容发布者和 AI 平台而言，机器可见内容与人类页面是否一致、广告如何识别及引用，可能成为新的审核议题。","nextStep":"值得关注的后续验证包括：对《时代》不同栏目和时间点重复测试，记录响应状态、内容类型、正文差异及广告标记；同时核对更多爬虫身份的返回结果，以判断该现象是单页配置、阶段性实验还是更广泛规则。","evidenceRefs":["title","summary","articleBody","source"],"status":"published","aiGenerated":true,"autoApproved":true,"generatedBy":"aioga-editorial:gpt-5.6-sol","reviewedBy":"aioga-editorial-review:gpt-5.6-sol","generatedAt":"2026-08-05T15:47:56.457Z","sourceHash":"ff01200a6ec6f677","review":{"approved":true,"groundedness":94,"clarity":91,"duplicationRisk":24,"blockingIssues":[],"notes":["“Aioga 判断”在来源材料中没有对应主体说明，虽然后文明确使用“可能”并保留不确定性，不构成事实性阻断问题，但可改为“据此可判断”或补充 Aioga 的身份。","“这种交付方式可能让部分搜索或问答系统更低成本地读取正文”属于合理推论，已使用“可能”限定；继续保留推测语气即可。","可将“markdown”统一写为“Markdown”，属于非阻断性的格式优化。"]},"validation":{"passed":true,"mode":"ai-auto","revisions":0,"checks":["schema","length","source-attribution","low-source-overlap","no-html","independent-ai-review"]}},"tags":["技巧观点","Hacker News 热门（buzzing.cc 中文翻译）"],"translations":{"zh-CN":{"title":"《时代》杂志向 AI 爬虫提供内嵌广告的简化版网站","summary":"《时代》杂志现在向 AI 爬虫提供与人类读者不同的网站版本：人类看到完整 HTML 页面，而 ClaudeBot、PerplexityBot、OAI-SearchBot 等助手爬虫收到的是仅 13，409 字节的 markdown 副本，约为原页面 303KB 的三十分之一。","category":"技巧观点","source":"vincentschmalbach.com","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"《时代》杂志向 AI 爬虫提供内嵌广告的简化版网站 - Aioga AI资讯","description":"《时代》杂志现在向 AI 爬虫提供与人类读者不同的网站版本：人类看到完整 HTML 页面，而 ClaudeBot、PerplexityBot、OAI-SearchBot 等助手爬虫收到的是仅 13，409 字节的 markdown 副本，约为原页面 303KB 的三十分之一。","url":"https://www.aioga.com/news/cmsg8307t00w9rores5h3s71c/","articleBody":["2026 年 8 月 5 日 作者：文森特·施马尔巴赫","《TIME》现在正在提供两个不同版本的网站。人类用户会看到杂志版，而AI爬虫则会获得一个内置广告的精简Markdown版本，这些广告内容普通人永远不会看到。","我在写这个时正在使用 vroni.com：https://www.vroni.com/?utm_source=vincentschmalbach.com&utm_medium=blog&utm_campaign=blog_post_vroni&utm_content=inline_note，这是我的 AI 编程工具，用于将任务转换为拉取请求。","我重复从同一台机器抓取了一篇普通的《TIME》健康文章《晨光习惯：睡眠专家的推荐》：https://time.com/article/2026/08/04/morning-light-better-sleep/，每次都只更改User-Agent头。User-Agent是每个浏览器和机器人用来表明自身身份的字符串。《TIME》读取它并决定返回什么内容。","以Chrome访问，我得到200 OK，text/html，以及303,235字节。完整网页，包括设计、图片和脚本。以Safari访问，同样是303KB。以Googlebot访问，同样也是303KB的HTML。","然后我以一个辅助爬虫的身份访问。作为ClaudeBot，我得到200 OK，text/markdown，以及13,409字节。作为PerplexityBot，字节完全一样。作为OpenAI的OAI-SearchBot，同样一样。相同的URL，相同的时间，相当于大小的二十三分之一，且格式完全不同：无HTML、无布局，只有语言模型可以处理的干净Markdown。","有几个机器人甚至没有得到这个版本。GPTBot和ChatGPT-User，OpenAI用于训练和实时抓取的代理，返回406，被阻止。但OAI-SearchBot，也就是为ChatGPT搜索索引提供数据的机器人，被允许访问Markdown。所以这不是全面的机器人策略。《TIME》是在为每个机器人选择谁可以获得无阅读器版本。","Markdown 副本上的响应头：","Mobian是一家广告技术供应商。Markdown页面实际上以 开头。该x-mobian-impression值在每次请求时都是新的UUID。我抓取同一页面两次，得到了两个不同的ID。配合cache-control: no-store，这意味着每次机器人读取页面时，都会被记录为一次独立的广告展示。而x-mobian-tokens: 3323告诉你被计数的单位。不是用户，也不是页面浏览量，而是输入模型的token数。","文章本身没有广告。赞助单元会出现在列表页和章节页上，每页一个。因此，我作为 ClaudeBot 获取了《TIME 2025 年最佳发明》收藏：https://time.com/collections/best-inventions-2025/。在 markdown 内部，也就是人类读者永远不会看到的地方，有完整的 Ally Bank 常见问题解答：","它包含类似“哪些银行提供提前直接存款？”和“可以在 Ally Bank 存现金吗？”的问题，每个问题都用 Ally 自己的营销语言进行解答，还有一个 FAQPage JSON-LD 块和标记为 campaign=\"ally-2026-q3\" 的跟踪链接。商业版块对项目管理学院也进行了同样的处理：一个“参考事实和常见问题”表格、会员数量、一条声称认证项目经理收入高 16% 的信息，全部标记为赞助。页面的人工 HTML 中不包含这些内容。当我以普通用户身份加载时，“Ally Bank”或“Mobian”都没有出现过。","“Ally Bank 是谁？”的表述方式就像用户问 ChatGPT 该在哪家银行开设账户时模型生成的回答。","广告在 markdown 内部标记为赞助，因此这不是传统意义上的未披露广告。隐藏的是受众划分。现在，TIME.com 有一层完全为机器编写的内容，而人类读者根本不知道它的存在，也不知道这些内容是代表他们向模型传达什么信息。","Googlebot 获取与人类相同的 HTML，因此搜索排名爬虫看到的是真实页面。只有助手爬虫才能获取分叉版本。","TIME 表示其机器人流量在大多数日子里已经超过人类流量。很快，这个数字对许多出版商来说都将成为现实。因此，这可能是首次清晰呈现当主要受众是 AI 模型时，网络的样子。","给 Vroni 一个 GitHub 问题、错误报告、规格说明或粗略想法。它会读取仓库、规划更改、编写代码、执行检查，并朝着可供审查的拉取请求方向工作。","在我的 Codex 工作流程中，GPT-5.6 Sol xhigh 每次会话使用的 token 是 GPT-5.5 xhigh 的两倍多。对于 Codex……","大型语言模型 (LLM) 一直使用 Markdown 表格。几个月前，Codex CLI 将表格显示为普通换行文本。在狭窄的……","Google Lighthouse 和 Cloudflare 正在为同一类新兴的自动化网站访问者添加不同的控制。Lighthouse 添加了一个实验性的 Agentic&hellip;","您的电子邮件地址不会被公开。必填字段标有 *","我写关于软件、人工智能、Laravel、SEO 以及构建在线产品所需的内容。2025 年，有 73,000 人浏览了博客。一些文章被出版物和开发者社区引用。","一些较早的文章受到了最多关注。我将它们保留在这里，作为最新文章的独立部分。","这篇文章引发了《卫报》专栏和一次长时间的开发者社区讨论。","为什么 AI 会让薄弱的工程基础变得更昂贵，而不是更便宜。","优秀的 AI 工作仍然依赖于技术判断和品味。","为在真实代码库中工作的人提供的具体 Laravel 建议。","博客的最新文章。发布时会自动更新。","《时代》现在正在提供两个不同版本的网站。人类看到的是杂志内容。AI 爬虫看到的是&hellip;","GPT-5.6 Sol xhigh 现在每次会话使用的 token 数量是 GPT-5.5 xhigh 的两倍以上，在我的&hellip;","大型语言模型一直使用 Markdown 表格。几个月前，Codex CLI 将它们显示为普通换行的&hellip;","提到、引用或讨论过我的写作和评论的地方。","我曾合作过的客户的真实反馈。","“雇佣文森特。认真地说。我多年来与许多开发者合作（还记得 rentacoder 吗？），文森特是那种少见的真正理解的网页开发者。你可以聊天、表达需求，他会回应你所要求的内容。他的英语流利，理解你的需求，也不会把事情复杂化。与他合作是一种快乐和享受，不需要微观管理，总体上是一次极好的体验。老实说，我希望能继续请他，但我们预算不够——这是合同终止的唯一原因。”","\"与Vincent合作最突出的特点是他的系统性和高效性。他首先会深入挖掘我们的需求，提出澄清问题，直到完全理解为止。之后，他会构建出精准所需的内容，并在整个过程中及时告知我们进展。沟通始终清晰、主动。一切都按计划进行，无论是时间还是预算方面。最终成果非常出色，自上线以来运行顺利。正是这种务实的专注和对细节的关注带来了不同。我会毫不犹豫地推荐Vincent进行高质量开发。\"","\"长期拥有Vincent的服务非常棒。他解决了我们的一些重大技术挑战，特别是显著提升了我们网站的性能。他还专业地管理了我们核心平台（Laravel）复杂的升级到最新版本，确保我们保持最新和安全。现在我们正在推广他开发的多语言功能，这令人很兴奋。Vincent可靠、技术娴熟，是保持我们网站运行最佳状态和持续发展的宝贵合作伙伴。强烈推荐他的专业能力。\"","\"我与Vincent合作已有数月，他是我合作过的最独立的开发者之一。他不需要微观管理——完全能够自主决策并推动项目进展，这让我能腾出手专注于企业的其他部分。\"","\"Vincent在异步工作方面表现非常好：沟通保持集中，几乎没有不必要的反复，并且在需要时提出重要问题。结果是一个能在不增加额外负担的情况下交付成果的开发者，这真的很有价值。\"","\"我们经常与Vincent在Laravel/Vue项目上合作，包括全新开发和多年积累的已有代码库。在这两种情况下，他都能提供干净的代码和可靠的实现。我们特别重视他能快速进入成熟项目并找到适合现有代码状态的解决方案。绝对推荐。\"","\"与Vincent合作很轻松，他生成了高质量的代码。推荐。\"","\"Vincent是那种罕见的开发者，能够迅速进入复杂的代码库，立即发挥作用，并在无需手把手指导的情况下解决实际问题。\"","他负责性能优化、客户特定功能以及一个大型定制报表系统。他还将与客户的讨论转化为清晰的技术需求，并记录了自己的工作，以便团队的其他成员能够在此基础上进行开发。","文森特不仅仅是处理工单，他会深入思考产品、边缘情况以及客户的影响。如果你需要一位能够推动SaaS产品发展的高级Laravel开发者，我强烈推荐他。","先发粗略版本。我可以帮忙把它变成一个计划，然后再进行构建。","几天而不是几个月即可上线你的SaaS。一份实用、无废话的指南，教你使用Laravel 12构建可投入生产的SaaS应用：速度、计费、团队、AI集成，以及客户付款前所需的关键部分。","文森特·施马尔巴赫是一位企业家、软件开发者和SEO专家。他专注于SaaS产品、企业应用、自动化以及技术项目挽救，拥有超过15年的软件和在线业务经验。"]},"en":{"title":"Time magazine provides a simplified version of its website with embedded ads for AI crawlers","summary":"Time magazine now provides AI crawlers with a version of the website that is different from what human readers see: humans see the full HTML page, while assistant crawlers like ClaudeBot, PerplexityBot, and OAI-SearchBot receive only a 13,409-byte markdown copy, about one-thirtieth of the original page's 303 KB.","category":"Insights","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Time magazine provides a simplified version of its website with embedded ads for AI crawlers - Aioga AI News","description":"Time magazine now provides AI crawlers with a version of the website that is different from what human readers see: humans see the full HTML page, while assistant crawlers like Cla...","url":"https://www.aioga.com/en/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:23:20.315Z"},"ja":{"title":"『タイム』誌、AIクローラー向けに埋め込み広告の簡易版ウェブサイトを提供","summary":"『タイム』誌は現在、AIクローラーに人間の読者とは異なるウェブサイトのバージョンを提供しています：人間は完全なHTMLページを閲覧できますが、ClaudeBot、PerplexityBot、OAI-SearchBotなどのアシスタントクローラーは、元のページ303KBの約三十分の一である13,409バイトのMarkdownコピーしか受け取りません。","category":"ヒントと視点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"『タイム』誌、AIクローラー向けに埋め込み広告の簡易版ウェブサイトを提供 - Aioga AIニュース","description":"『タイム』誌は現在、AIクローラーに人間の読者とは異なるウェブサイトのバージョンを提供しています：人間は完全なHTMLページを閲覧できますが、ClaudeBot、PerplexityBot、OAI-SearchBotなどのアシスタントクローラーは、元のページ303KBの約三十分の一である13,409バイトのMarkdownコピーしか受け取りません。","url":"https://www.aioga.com/ja/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:23:28.938Z"},"ko":{"title":"《타임》지 AI 크롤러에 내장 광고가 포함된 간소화 버전의 웹사이트 제공","summary":"《타임》 잡지는 현재 AI 크롤러에게 인간 독자와 다른 웹사이트 버전을 제공합니다: 인간은 전체 HTML 페이지를 보지만, ClaudeBot, PerplexityBot, OAI-SearchBot 등의 도우미 크롤러는 원래 페이지 303KB의 약 1/30에 해당하는 13,409 바이트의 마크다운 사본만 받습니다.","category":"인사이트","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"《타임》지 AI 크롤러에 내장 광고가 포함된 간소화 버전의 웹사이트 제공 - Aioga AI 뉴스","description":"《타임》 잡지는 현재 AI 크롤러에게 인간 독자와 다른 웹사이트 버전을 제공합니다: 인간은 전체 HTML 페이지를 보지만, ClaudeBot, PerplexityBot, OAI-SearchBot 등의 도우미 크롤러는 원래 페이지 303KB의 약 1/30에 해당하는 13,409 바이트의 마크다운 사본만 받습니다.","url":"https://www.aioga.com/ko/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:24:20.425Z"},"es":{"title":"La revista Time ofrece a los rastreadores de IA una versión simplificada del sitio web con anuncios integrados","summary":"La revista Time ahora ofrece a los rastreadores de IA una versión del sitio web diferente a la de los lectores humanos: los humanos ven la página HTML completa, mientras que los rastreadores asistentes como ClaudeBot, PerplexityBot, OAI-SearchBot reciben una copia en markdown de solo 13,409 bytes, aproximadamente un treinta y tresavo de la página original de 303 KB.","category":"Ideas","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"La revista Time ofrece a los rastreadores de IA una versión simplificada del sitio web con anuncios integrados - Aioga Noticias de IA","description":"La revista Time ahora ofrece a los rastreadores de IA una versión del sitio web diferente a la de los lectores humanos: los humanos ven la página HTML completa, mientras que los ra...","url":"https://www.aioga.com/es/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:24:16.945Z"},"fr":{"title":"Le magazine Time propose une version simplifiée de son site avec des publicités intégrées aux robots IA","summary":"Le magazine « Time » fournit désormais aux robots d'indexation IA une version du site différente de celle des lecteurs humains : les humains voient la page HTML complète, tandis que les robots assistants comme ClaudeBot, PerplexityBot, OAI-SearchBot reçoivent une copie en markdown de seulement 13 409 octets, soit environ un trentième de la page originale de 303 Ko.","category":"Analyses","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Le magazine Time propose une version simplifiée de son site avec des publicités intégrées aux robots IA - Aioga Actualités IA","description":"Le magazine « Time » fournit désormais aux robots d'indexation IA une version du site différente de celle des lecteurs humains : les humains voient la page HTML complète, tandis qu...","url":"https://www.aioga.com/fr/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:25:15.400Z"},"de":{"title":"Die Zeitschrift ‚Time‘ bietet KI-Crawlern eine vereinfachte Version ihrer Website mit eingebetteten Anzeigen an","summary":"Das Magazin „Time“ bietet AI-Crawlern jetzt eine andere Version der Website als menschlichen Lesern: Menschen sehen die vollständige HTML-Seite, während Hilfs-Crawler wie ClaudeBot, PerplexityBot, OAI-SearchBot nur eine 13.409 Byte große Markdown-Kopie erhalten, etwa ein Dreißigstel der ursprünglichen Seite von 303 KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Die Zeitschrift ‚Time‘ bietet KI-Crawlern eine vereinfachte Version ihrer Website mit eingebetteten Anzeigen an - Aioga KI-News","description":"Das Magazin „Time“ bietet AI-Crawlern jetzt eine andere Version der Website als menschlichen Lesern: Menschen sehen die vollständige HTML-Seite, während Hilfs-Crawler wie ClaudeBot...","url":"https://www.aioga.com/de/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:25:10.534Z"},"pt-BR":{"title":"A revista Time fornece uma versão simplificada de seu site com anúncios incorporados para robôs de IA","summary":"A revista \"Time\" agora fornece às bots de IA uma versão do site diferente da que os leitores humanos veem: os humanos veem a página HTML completa, enquanto bots assistentes como ClaudeBot, PerplexityBot, OAI-SearchBot recebem uma cópia em markdown de apenas 13.409 bytes, cerca de um trinta avos da página original de 303 KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"A revista Time fornece uma versão simplificada de seu site com anúncios incorporados para robôs de IA - Aioga Notícias de IA","description":"A revista \"Time\" agora fornece às bots de IA uma versão do site diferente da que os leitores humanos veem: os humanos veem a página HTML completa, enquanto bots assistentes como Cl...","url":"https://www.aioga.com/pt-BR/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:26:03.128Z"},"ru":{"title":"Журнал \"Time\" предоставляет AI-сканерам упрощённую версию сайта с встроенной рекламой","summary":"Журнал «Time» теперь предоставляет AI-ботам другую версию сайта, отличающуюся от версии для человеческих читателей: люди видят полную HTML-страницу, в то время как помощники-боты, такие как ClaudeBot, PerplexityBot, OAI-SearchBot, получают лишь markdown-копию размером 13 409 байт, что примерно в тридцать раз меньше исходной страницы размером 303 КБ.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Журнал \"Time\" предоставляет AI-сканерам упрощённую версию сайта с встроенной рекламой - Aioga Новости ИИ","description":"Журнал «Time» теперь предоставляет AI-ботам другую версию сайта, отличающуюся от версии для человеческих читателей: люди видят полную HTML-страницу, в то время как помощники-боты,...","url":"https://www.aioga.com/ru/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:26:02.045Z"},"ar":{"title":"مجلة تايم توفر نسخة مبسطة من الموقع للروبوتات الذكية مع إعلانات مدمجة","summary":"مجلة تايم تقدم الآن لمحركات الزحف المعتمدة على الذكاء الاصطناعي نسخة من الموقع تختلف عن النسخة التي يراها القراء البشر: فالإنسان يرى صفحة HTML كاملة، بينما تحصل برامج الزحف المساعدة مثل ClaudeBot وPerplexityBot وOAI-SearchBot على نسخة بصيغة markdown بحجم 13,409 بايت فقط، أي حوالي ثلاثين جزءًا من حجم الصفحة الأصلية البالغ 303 كيلوبايت.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"مجلة تايم توفر نسخة مبسطة من الموقع للروبوتات الذكية مع إعلانات مدمجة - Aioga أخبار الذكاء الاصطناعي","description":"مجلة تايم تقدم الآن لمحركات الزحف المعتمدة على الذكاء الاصطناعي نسخة من الموقع تختلف عن النسخة التي يراها القراء البشر: فالإنسان يرى صفحة HTML كاملة، بينما تحصل برامج الزحف المساعد...","url":"https://www.aioga.com/ar/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:26:56.467Z"},"hi":{"title":"टाइम मैगज़ीन AI क्रॉलर को एम्बेडेड विज्ञापनों वाली सरल वेबसाइट प्रदान करता है","summary":"《时代》 पत्रिका अब AI क्रॉलर्स को मानव पाठकों से अलग वेबसाइट संस्करण प्रदान करती है: मानव पूर्ण HTML पृष्ठ देखते हैं, जबकि ClaudeBot, PerplexityBot, OAI-SearchBot जैसे सहायक क्रॉलर्स केवल 13,409 बाइट का मार्कडाउन संस्करण प्राप्त करते हैं, जो मूल पृष्ठ 303KB का लगभग तीसवां हिस्सा है।","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"टाइम मैगज़ीन AI क्रॉलर को एम्बेडेड विज्ञापनों वाली सरल वेबसाइट प्रदान करता है - Aioga AI समाचार","description":"《时代》 पत्रिका अब AI क्रॉलर्स को मानव पाठकों से अलग वेबसाइट संस्करण प्रदान करती है: मानव पूर्ण HTML पृष्ठ देखते हैं, जबकि ClaudeBot, PerplexityBot, OAI-SearchBot जैसे सहायक क्रॉलर्स...","url":"https://www.aioga.com/hi/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:26:57.766Z"},"it":{"title":"La rivista Time offre una versione semplificata del sito web con pubblicità incorporata ai crawler AI","summary":"La rivista Time ora fornisce ai crawler AI una versione del sito diversa da quella destinata ai lettori umani: gli esseri umani vedono la pagina HTML completa, mentre i crawler assistenti come ClaudeBot, PerplexityBot, OAI-SearchBot ricevono solo una copia in markdown di 13.409 byte, circa un trentesimo dei 303 KB della pagina originale.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"La rivista Time offre una versione semplificata del sito web con pubblicità incorporata ai crawler AI - Aioga Notizie IA","description":"La rivista Time ora fornisce ai crawler AI una versione del sito diversa da quella destinata ai lettori umani: gli esseri umani vedono la pagina HTML completa, mentre i crawler ass...","url":"https://www.aioga.com/it/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:27:47.174Z"},"nl":{"title":"Het tijdschrift 'Time' biedt een vereenvoudigde versie van de website met ingebedde advertenties aan AI-spiders","summary":"Het tijdschrift Time biedt nu AI-crawlers een andere versie van de website dan menselijke lezers: mensen zien de volledige HTML-pagina, terwijl assistentcrawlers zoals ClaudeBot, PerplexityBot en OAI-SearchBot slechts een markdown-kopie van 13.409 bytes ontvangen, ongeveer een dertigste van de oorspronkelijke pagina van 303 KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Het tijdschrift 'Time' biedt een vereenvoudigde versie van de website met ingebedde advertenties aan AI-spiders - Aioga AI-nieuws","description":"Het tijdschrift Time biedt nu AI-crawlers een andere versie van de website dan menselijke lezers: mensen zien de volledige HTML-pagina, terwijl assistentcrawlers zoals ClaudeBot, P...","url":"https://www.aioga.com/nl/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:27:46.819Z"},"tr":{"title":"Time dergisi, AI tarayıcılarına gömülü reklamların basitleştirilmiş sürümünü sunuyor","summary":"Time dergisi şimdi AI tarayıcılarına insan okuyuculardan farklı bir site sürümü sunuyor: İnsanlar tam HTML sayfasını görürken, ClaudeBot, PerplexityBot, OAI-SearchBot gibi yardımcı tarayıcılar yalnızca 13.409 baytlık bir markdown kopyasını alıyor, bu da orijinal sayfanın 303 KB'ının yaklaşık üçte biri.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Time dergisi, AI tarayıcılarına gömülü reklamların basitleştirilmiş sürümünü sunuyor - Aioga AI Haberleri","description":"Time dergisi şimdi AI tarayıcılarına insan okuyuculardan farklı bir site sürümü sunuyor: İnsanlar tam HTML sayfasını görürken, ClaudeBot, PerplexityBot, OAI-SearchBot gibi yardımcı...","url":"https://www.aioga.com/tr/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:28:41.561Z"},"vi":{"title":"Tạp chí Time cung cấp phiên bản website giản lược với quảng cáo nhúng cho AI crawler","summary":"Tạp chí 《Time》 hiện nay cung cấp cho các bot AI một phiên bản trang web khác với người đọc là con người: con người nhìn thấy trang HTML đầy đủ, trong khi các bot trợ lý như ClaudeBot, PerplexityBot, OAI-SearchBot chỉ nhận được bản sao markdown dài 13.409 byte, khoảng một phần ba mươi so với trang gốc 303KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Tạp chí Time cung cấp phiên bản website giản lược với quảng cáo nhúng cho AI crawler - Tin tức AI Aioga","description":"Tạp chí 《Time》 hiện nay cung cấp cho các bot AI một phiên bản trang web khác với người đọc là con người: con người nhìn thấy trang HTML đầy đủ, trong khi các bot trợ lý như ClaudeB...","url":"https://www.aioga.com/vi/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:28:37.824Z"},"id":{"title":"Majalah Time menyediakan versi situs web yang disederhanakan dengan iklan tertanam untuk perayap AI","summary":"Majalah Time sekarang menyediakan versi situs web yang berbeda untuk perayap AI dibandingkan dengan pembaca manusia: manusia melihat halaman HTML lengkap, sementara perayap asisten seperti ClaudeBot, PerplexityBot, OAI-SearchBot menerima salinan markdown hanya 13.409 byte, sekitar sepertiga puluh dari halaman asli yang berukuran 303KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Majalah Time menyediakan versi situs web yang disederhanakan dengan iklan tertanam untuk perayap AI - Berita AI Aioga","description":"Majalah Time sekarang menyediakan versi situs web yang berbeda untuk perayap AI dibandingkan dengan pembaca manusia: manusia melihat halaman HTML lengkap, sementara perayap asisten...","url":"https://www.aioga.com/id/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:29:32.294Z"},"th":{"title":"นิตยสารไทม์จัดเว็บไซต์เวอร์ชันย่อที่มีโฆษณาฝังสำหรับบอท AI","summary":"นิตยสารไทม์ตอนนี้ให้เวอร์ชันเว็บไซต์ที่แตกต่างจากผู้อ่านมนุษย์ต่อบอท AI ซึ่งผู้อ่านมนุษย์จะเห็นหน้า HTML เต็มรูปแบบ ในขณะที่ ClaudeBot, PerplexityBot, OAI-SearchBot และบอทช่วยอื่น ๆ จะได้รับสำเนา markdown ขนาดเพียง 13,409 ไบต์ ซึ่งประมาณหนึ่งในสามสิบของหน้าต้นฉบับที่มีขนาด 303KB","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"นิตยสารไทม์จัดเว็บไซต์เวอร์ชันย่อที่มีโฆษณาฝังสำหรับบอท AI - ข่าว AI Aioga","description":"นิตยสารไทม์ตอนนี้ให้เวอร์ชันเว็บไซต์ที่แตกต่างจากผู้อ่านมนุษย์ต่อบอท AI ซึ่งผู้อ่านมนุษย์จะเห็นหน้า HTML เต็มรูปแบบ ในขณะที่ ClaudeBot, PerplexityBot, OAI-SearchBot และบอทช่วยอื่น...","url":"https://www.aioga.com/th/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:29:40.360Z"},"pl":{"title":"Magazyn 'Time' udostępnia uproszczoną wersję strony z wbudowanymi reklamami dla robotów AI","summary":"Magazyn „Time” obecnie udostępnia botom AI wersję strony różną od tej dla ludzkich czytelników: ludzie widzą pełną stronę HTML, podczas gdy asystenci-pająki tacy jak ClaudeBot, PerplexityBot, OAI-SearchBot otrzymują tylko 13 409 bajtów kopii w formacie markdown, co stanowi około jednej trzydziestej oryginalnej strony o rozmiarze 303 KB.","category":"技巧观点","source":"Hacker News 热门（buzzing.cc 中文翻译）","aggregationSource":"Hacker News 热门（buzzing.cc 中文翻译）","pageTitle":"Magazyn 'Time' udostępnia uproszczoną wersję strony z wbudowanymi reklamami dla robotów AI - Aioga Wiadomości AI","description":"Magazyn „Time” obecnie udostępnia botom AI wersję strony różną od tej dla ludzkich czytelników: ludzie widzą pełną stronę HTML, podczas gdy asystenci-pająki tacy jak ClaudeBot, Per...","url":"https://www.aioga.com/pl/news/cmsg8307t00w9rores5h3s71c/","contentTranslated":true,"sourceHash":"389fae0211181a31","translatedAt":"2026-08-05T15:30:44.260Z"}}}}