{"@context":"https://schema.org","@type":"NewsArticle","generatedAt":"2026-07-23T06:40:50.084Z","headline":"HYPIC：小红书联合北大、上交提出首个混合注意力大模型位置无关缓存系统","description":"HYPIC 在混合注意力大模型上实现了位置无关缓存，将首 token 延迟平均降低 3.25 倍。在 4 个生产级模型上，同 SLO 下可持续 QPS 提升 1.66 倍，任务质量与完全重算仅相差 1.71 分。","url":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/","mainEntityOfPage":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/","datePublished":"2026-07-16T10:00:00.000Z","dateModified":"2026-07-16T10:00:00.000Z","inLanguage":"zh-CN","publisher":{"@type":"NewsMediaOrganization","name":"Aioga","url":"https://www.aioga.com"},"citation":["https://mp.weixin.qq.com/s/RWveWvw9yBH6YQINBQ-XjA","https://aihot.virxact.com/items/cmrnclu0101cgbic6rpcgkw8s"],"canonicalUrl":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/","directAnswer":{"@type":"Answer","text":"HYPIC 面向混合注意力大模型实现位置无关缓存。材料称，其首 token 延迟平均降低 3.25 倍；在 4 个生产级模型上，同一 SLO 下可持续 QPS 提升 1.66 倍。","url":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/","dateCreated":"2026-07-16T10:00:00.000Z","author":{"@type":"Organization","@id":"https://www.aioga.com/authors/aioga-editorial/#editorial-team","name":"Aioga Editorial Team","url":"https://www.aioga.com/authors/aioga-editorial/"}},"evidence":[{"@type":"CreativeWork","name":"公众号：小红书技术（dots.llm） source article","url":"https://mp.weixin.qq.com/s/RWveWvw9yBH6YQINBQ-XjA","datePublished":"2026-07-16T10:00:00.000Z","provider":{"@type":"Organization","name":"公众号：小红书技术（dots.llm）","url":"https://mp.weixin.qq.com/s/RWveWvw9yBH6YQINBQ-XjA"}},{"@type":"CreativeWork","name":"AIHot archive record","url":"https://aihot.virxact.com/items/cmrnclu0101cgbic6rpcgkw8s","datePublished":"2026-07-16T10:00:00.000Z","provider":{"@type":"Organization","name":"AIHot","url":"https://aihot.virxact.com/items/cmrnclu0101cgbic6rpcgkw8s"}}],"aggregationSource":"公众号：小红书技术（dots.llm）","originalPublisher":{"name":"公众号：小红书技术（dots.llm）","url":"https://mp.weixin.qq.com/s/RWveWvw9yBH6YQINBQ-XjA"},"article":{"id":"cmrnclu0101cgbic6rpcgkw8s","slug":"cmrnclu0101cgbic6rpcgkw8s","url":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/","title":"HYPIC：小红书联合北大、上交提出首个混合注意力大模型位置无关缓存系统","title_en":"首 token 延迟降 3.25 倍！小红书联合北大、上交提出 HYPIC，让混合注意力大模型用上「位置无关缓存」","summary":"HYPIC 在混合注意力大模型上实现了位置无关缓存，将首 token 延迟平均降低 3.25 倍。在 4 个生产级模型上，同 SLO 下可持续 QPS 提升 1.66 倍，任务质量与完全重算仅相差 1.71 分。","source":"公众号：小红书技术（dots.llm）","sourceUrl":"https://mp.weixin.qq.com/s/RWveWvw9yBH6YQINBQ-XjA","aiHotUrl":"https://aihot.virxact.com/items/cmrnclu0101cgbic6rpcgkw8s","publishedAt":"2026-07-16T10:00:00.000Z","category":"论文研究","score":77,"selected":true,"articleBody":["HYPIC 在混合注意力大模型上实现了位置无关缓存，将首 token 延迟平均降低 3.25 倍。","在 4 个生产级模型上，同 SLO 下可持续 QPS 提升 1.66 倍，任务质量与完全重算仅相差 1.71 分。"],"articleImages":[],"mediaStatus":"none","articleBodyZh":[],"translationStatus":"","bodyOrigin":"summary-fallback","editorial":{"summary":"HYPIC 面向混合注意力大模型实现位置无关缓存。材料称，其首 token 延迟平均降低 3.25 倍；在 4 个生产级模型上，同一 SLO 下可持续 QPS 提升 1.66 倍。","background":"该研究由小红书联合北京大学、上海交通大学提出，标题将其称为首个混合注意力大模型位置无关缓存系统。现有材料仅披露核心性能与质量对比结果，未说明具体实验配置。","viewpoint":"Aioga 判断，HYPIC 的关注点在于同时改善首 token 延迟和同一 SLO 下的处理能力，并控制与完全重算之间的任务质量差距；但结论仍需结合完整论文和实验条件审视。","implications":"若披露结果可在相近部署条件下复现，该方案可能为混合注意力模型的缓存与推理优化提供参考。值得关注的是，现有摘录未交代模型名称、硬件环境及评分口径。","nextStep":"建议后续核查完整论文中的缓存机制、基线方案、SLO 定义、任务质量评分方法及各模型分项结果，并关注 3.25 倍与 1.66 倍数据是否覆盖不同负载和上下文条件。","evidenceRefs":["title","summary","articleBody","source"],"status":"published","aiGenerated":true,"autoApproved":true,"generatedBy":"aioga-editorial:gpt-5.6-sol","reviewedBy":"aioga-editorial-review:gpt-5.6-sol","generatedAt":"2026-07-22T18:52:55.155Z","sourceHash":"7c231bcae1b3ac9e","review":{"approved":true,"groundedness":96,"clarity":91,"duplicationRisk":24,"blockingIssues":[],"notes":["“首 token 延迟平均降低 3.25 倍”沿用了来源材料的表述，但“降低 X 倍”在数值含义上可能存在歧义；获得完整论文后可核实其实际含义是降至原来的 1/3.25，还是减少了其他比例。","候选内容已将“首个”明确限定为标题中的说法，并对实验配置缺失和复现条件作出保留，未将其扩展为独立确认的事实。"]},"validation":{"passed":true,"mode":"ai-auto","revisions":0,"checks":["schema","length","source-attribution","low-source-overlap","no-html","independent-ai-review"]}},"tags":["论文研究","公众号：小红书技术（dots.llm）"],"translations":{"zh-CN":{"title":"HYPIC：小红书联合北大、上交提出首个混合注意力大模型位置无关缓存系统","summary":"HYPIC 在混合注意力大模型上实现了位置无关缓存，将首 token 延迟平均降低 3.25 倍。在 4 个生产级模型上，同 SLO 下可持续 QPS 提升 1.66 倍，任务质量与完全重算仅相差 1.71 分。","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC：小红书联合北大、上交提出首个混合注意力大模型位置无关缓存系统 - Aioga AI资讯","description":"HYPIC 在混合注意力大模型上实现了位置无关缓存，将首 token 延迟平均降低 3.25 倍。在 4 个生产级模型上，同 SLO 下可持续 QPS 提升 1.66 倍，任务质量与完全重算仅相差 1.71 分。","url":"https://www.aioga.com/news/cmrnclu0101cgbic6rpcgkw8s/"},"en":{"title":"HYPIC: Xiaohongshu, in collaboration with Peking University and Shanghai Jiao Tong, proposed the first hybrid attention large model location-independent caching system","summary":"HYPIC has implemented location-independent caching on its hybrid attention large model, reducing the average first token latency by 3.25 times. On four production-level models, sustainable QPS improved by 1.66 times under the same SLO, and task quality differed by only 1.71 points from a full refactor.","category":"Research","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, in collaboration with Peking University and Shanghai Jiao Tong, proposed the first hybrid attention large model location-independent caching system - Aioga AI News","description":"HYPIC has implemented location-independent caching on its hybrid attention large model, reducing the average first token latency by 3.25 times. On four production-level models, sus","url":"https://www.aioga.com/en/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:50:58.971Z"},"ja":{"title":"HYPIC:小紅書は北京大学および上海交通通と共同で、初のハイブリッド注目型大規模モデル位置非依存キャッシュシステムを提案しました","summary":"HYPICはハイブリッドアテンシャル大規模モデルで位置非依存キャッシュを実装し、平均最初のトークン遅延を3.25倍削減しました。 4つの本番モデルでは、同じSLO下で持続可能なQPSが1.66倍向上し、タスクの質は完全なリファクタと比べてわずか1.71ポイント差がありました。","category":"論文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC:小紅書は北京大学および上海交通通と共同で、初のハイブリッド注目型大規模モデル位置非依存キャッシュシステムを提案しました - Aioga AIニュース","description":"HYPICはハイブリッドアテンシャル大規模モデルで位置非依存キャッシュを実装し、平均最初のトークン遅延を3.25倍削減しました。 4つの本番モデルでは、同じSLO下で持続可能なQPSが1.66倍向上し、タスクの質は完全なリファクタと比べてわずか1.71ポイント差がありました。","url":"https://www.aioga.com/ja/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:50:59.778Z"},"ko":{"title":"HYPIC: 샤오홍슈는 베이징대학교 및 상하이 자오통과 협력하여 최초의 하이브리드 주의 대형 모델 위치 독립 캐싱 시스템을 제안했습니다","summary":"HYPIC은 하이브리드 어텐션 대형 모델에 위치 독립 캐싱을 구현하여 평균 첫 토큰 지연 시간을 3.25배 줄였습니다. 네 개의 생산 수준 모델에서 동일한 SLO 하에서 지속 가능한 QPS는 1.66배 향상되었고, 작업 품질은 전체 리팩터링과 단 1.71점 차이에 불과했습니다.","category":"연구","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: 샤오홍슈는 베이징대학교 및 상하이 자오통과 협력하여 최초의 하이브리드 주의 대형 모델 위치 독립 캐싱 시스템을 제안했습니다 - Aioga AI 뉴스","description":"HYPIC은 하이브리드 어텐션 대형 모델에 위치 독립 캐싱을 구현하여 평균 첫 토큰 지연 시간을 3.25배 줄였습니다. 네 개의 생산 수준 모델에서 동일한 SLO 하에서 지속 가능한 QPS는 1.66배 향상되었고, 작업 품질은 전체 리팩터링과 단 1.71점 차이에 불과했습니다.","url":"https://www.aioga.com/ko/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:50:59.297Z"},"es":{"title":"HYPIC: Xiaohongshu, en colaboración con la Universidad de Pekín y Shanghai Jiao Tong, propuso el primer sistema híbrido de caché independiente de la ubicación de grandes modelos de atención","summary":"HYPIC ha implementado caché independiente de la ubicación en su modelo híbrido de atención grande, reduciendo la latencia media del primer token en 3,25 veces. En cuatro modelos de producción, el QPS sostenible mejoró 1,66 veces bajo el mismo SLO, y la calidad de las tareas difería solo 1,71 puntos respecto a una refactorización completa.","category":"Investigación","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, en colaboración con la Universidad de Pekín y Shanghai Jiao Tong, propuso el primer sistema híbrido de caché independiente de la ubicación de grandes modelos de atención - Aioga Noticias de IA","description":"HYPIC ha implementado caché independiente de la ubicación en su modelo híbrido de atención grande, reduciendo la latencia media del primer token en 3,25 veces. En cuatro modelos de","url":"https://www.aioga.com/es/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:50:59.484Z"},"fr":{"title":"HYPIC : Xiaohongshu, en collaboration avec l’Université de Pékin et Shanghai Jiao Tong, a proposé le premier système de mise en cache indépendant de la localisation à attention à grande taille","summary":"HYPIC a mis en œuvre une mise en cache indépendante de la localisation sur son modèle hybride attention large, réduisant la latence moyenne du premier jeton de 3,25 fois. Sur quatre modèles de niveau production, le QPS durable s’est amélioré de 1,66 fois sous le même SLO, et la qualité des tâches ne différait que de 1,71 point par rapport à une refonte complète.","category":"Recherche","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC : Xiaohongshu, en collaboration avec l’Université de Pékin et Shanghai Jiao Tong, a proposé le premier système de mise en cache indépendant de la localisation à attention à grande taille - Aioga Actualités IA","description":"HYPIC a mis en œuvre une mise en cache indépendante de la localisation sur son modèle hybride attention large, réduisant la latence moyenne du premier jeton de 3,25 fois. Sur quatr","url":"https://www.aioga.com/fr/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:50:59.449Z"},"de":{"title":"HYPIC: Xiaohongshu schlug in Zusammenarbeit mit der Peking-Universität und Shanghai Jiao Tong das erste hybride Fokus-Großmodell-Standortunabhängig-Caching-System vor","summary":"HYPIC hat standortunabhängiges Caching in seinem hybriden Attention-Large-Modell implementiert und die durchschnittliche Latenz für den ersten Token um das 3,25-fache reduziert. Bei vier Produktionsmodellen verbesserte sich die nachhaltige QPS unter demselben SLO um das 1,66-fache, und die Aufgabenqualität unterschied sich nur um 1,71 Punkte von einer vollständigen Refaktorisierung.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu schlug in Zusammenarbeit mit der Peking-Universität und Shanghai Jiao Tong das erste hybride Fokus-Großmodell-Standortunabhängig-Caching-System vor - Aioga KI-News","description":"HYPIC hat standortunabhängiges Caching in seinem hybriden Attention-Large-Modell implementiert und die durchschnittliche Latenz für den ersten Token um das 3,25-fache reduziert. Be","url":"https://www.aioga.com/de/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:02.772Z"},"pt-BR":{"title":"HYPIC: Xiaohongshu, em colaboração com a Universidade de Pequim e a Shanghai Jiao Tong, propôs o primeiro sistema híbrido de cache independente de localização de grande formato de atenção","summary":"A HYPIC implementou cache independente de localização em seu modelo híbrido de atenção grande, reduzindo a latência média do primeiro token em 3,25 vezes. Em quatro modelos de produção, o QPS sustentável melhorou 1,66 vezes sob o mesmo SLO, e a qualidade das tarefas diferiu em apenas 1,71 ponto em relação a uma refatoração completa.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, em colaboração com a Universidade de Pequim e a Shanghai Jiao Tong, propôs o primeiro sistema híbrido de cache independente de localização de grande formato de atenção - Aioga Notícias de IA","description":"A HYPIC implementou cache independente de localização em seu modelo híbrido de atenção grande, reduzindo a latência média do primeiro token em 3,25 vezes. Em quatro modelos de prod","url":"https://www.aioga.com/pt-BR/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:04.065Z"},"ru":{"title":"HYPIC: Xiaohongshu в сотрудничестве с Пекинским университетом и Шанхайским Цзяо Туном предложила первую гибридную систему кэширования с большой моделью, независимую от местоположения","summary":"HYPIC реализовал кэширование, независимое от местоположения, в своей гибридной модели внимания large, снизив среднюю задержку первого токена в 3,25 раза. На четырёх серийных моделях устойчивый QPS улучшился в 1,66 раза при том же SLO, а качество задач отличалось всего на 1,71 пункта от полного рефактора.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu в сотрудничестве с Пекинским университетом и Шанхайским Цзяо Туном предложила первую гибридную систему кэширования с большой моделью, независимую от местоположения - Aioga Новости ИИ","description":"HYPIC реализовал кэширование, независимое от местоположения, в своей гибридной модели внимания large, снизив среднюю задержку первого токена в 3,25 раза. На четырёх серийных моделя","url":"https://www.aioga.com/ru/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:04.078Z"},"ar":{"title":"HYPIC: اقترحت شياوهونغشو، بالتعاون مع جامعة بكين وشنغهاي جياو تونغ، أول نظام تخزين مؤقت هجين يعتمد على النموذج الكبير المستقل عن الموقع","summary":"طبقت HYPIC التخزين المؤقت المستقل عن الموقع على نموذج الانتباه الهجين الكبير، مما قلل متوسط زمن استجابة الرمز الأول بمقدار 3.25 مرة. في أربعة نماذج إنتاجية، تحسنت جودة التصنيع المستدامة بنسبة 1.66 ضعف تحت نفس مستوى الإنتاج، واختلفت جودة المهام بفارق 1.71 نقطة فقط عن إعادة هيكلة كاملة.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: اقترحت شياوهونغشو، بالتعاون مع جامعة بكين وشنغهاي جياو تونغ، أول نظام تخزين مؤقت هجين يعتمد على النموذج الكبير المستقل عن الموقع - Aioga أخبار الذكاء الاصطناعي","description":"طبقت HYPIC التخزين المؤقت المستقل عن الموقع على نموذج الانتباه الهجين الكبير، مما قلل متوسط زمن استجابة الرمز الأول بمقدار 3.25 مرة. في أربعة نماذج إنتاجية، تحسنت جودة التصنيع المس","url":"https://www.aioga.com/ar/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:03.789Z"},"hi":{"title":"HYPIC: ज़ियाओहोंगशु ने पेकिंग विश्वविद्यालय और शंघाई जिओ टोंग के सहयोग से पहला हाइब्रिड ध्यान बड़े मॉडल स्थान-स्वतंत्र कैशिंग सिस्टम का प्रस्ताव रखा","summary":"HYPIC ने अपने हाइब्रिड अटेंशन लार्ज मॉडल पर स्थान-स्वतंत्र कैशिंग लागू की है, जिससे औसत पहले टोकन विलंबता को 3.25 गुना कम कर दिया गया है। चार उत्पादन-स्तरीय मॉडलों पर, एक ही एसएलओ के तहत टिकाऊ क्यूपीएस में 1.66 गुना सुधार हुआ, और कार्य की गुणवत्ता एक पूर्ण रिफैक्टर से केवल 1.71 अंक भिन्न थी।","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: ज़ियाओहोंगशु ने पेकिंग विश्वविद्यालय और शंघाई जिओ टोंग के सहयोग से पहला हाइब्रिड ध्यान बड़े मॉडल स्थान-स्वतंत्र कैशिंग सिस्टम का प्रस्ताव रखा - Aioga AI समाचार","description":"HYPIC ने अपने हाइब्रिड अटेंशन लार्ज मॉडल पर स्थान-स्वतंत्र कैशिंग लागू की है, जिससे औसत पहले टोकन विलंबता को 3.25 गुना कम कर दिया गया है। चार उत्पादन-स्तरीय मॉडलों पर, एक ही एसएलओ ","url":"https://www.aioga.com/hi/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:03.996Z"},"it":{"title":"HYPIC: Xiaohongshu, in collaborazione con l'Università di Pechino e Shanghai Jiao Tong, ha proposto il primo sistema di cache ibrido a grande attenzione e indipendente dalla posizione","summary":"HYPIC ha implementato una cache indipendente dalla posizione sul suo modello ibrido attention large, riducendo la latenza media del primo token di 3,25 volte. Su quattro modelli a livello di produzione, il QPS sostenibile è migliorato di 1,66 volte con lo stesso SLO, e la qualità dei compiti differiva di soli 1,71 punti rispetto a un rifactoring completo.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, in collaborazione con l'Università di Pechino e Shanghai Jiao Tong, ha proposto il primo sistema di cache ibrido a grande attenzione e indipendente dalla posizione - Aioga Notizie IA","description":"HYPIC ha implementato una cache indipendente dalla posizione sul suo modello ibrido attention large, riducendo la latenza media del primo token di 3,25 volte. Su quattro modelli a ","url":"https://www.aioga.com/it/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:04.591Z"},"nl":{"title":"HYPIC: Xiaohongshu stelde in samenwerking met de Peking Universiteit en Shanghai Jiao Tong het eerste hybride aandacht-grootmodel-locatieonafhankelijke cachingsysteem voor","summary":"HYPIC heeft locatie-onafhankelijke caching geïmplementeerd op zijn hybride attention large model, waardoor de gemiddelde latentie van de eerste token met 3,25 keer wordt verminderd. Op vier productiemodellen verbeterde duurzame QPS met 1,66 keer onder dezelfde SLO, en verschilde de taakkwaliteit slechts met 1,71 punten van een volledige refactoring.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu stelde in samenwerking met de Peking Universiteit en Shanghai Jiao Tong het eerste hybride aandacht-grootmodel-locatieonafhankelijke cachingsysteem voor - Aioga AI-nieuws","description":"HYPIC heeft locatie-onafhankelijke caching geïmplementeerd op zijn hybride attention large model, waardoor de gemiddelde latentie van de eerste token met 3,25 keer wordt verminderd","url":"https://www.aioga.com/nl/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:02.810Z"},"tr":{"title":"HYPIC: Xiaohongshu, Pekin Üniversitesi ve Şanghay Jiao Tong ile iş birliği içinde, ilk hibrit dikkat büyük model konumdan bağımsız önbellek sistemini önerdi","summary":"HYPIC, hibrit dikkat büyük modelinde konumdan bağımsız önbellekleme uyguladı ve ortalama ilk token gecikmesini 3,25 kat azalttı. Dört üretim düzeyindeki modelde, aynı SLO altında sürdürülebilir QPS 1,66 kat iyileşti ve tam refaktöre göre görev kalitesi sadece 1,71 puan farklılık gösterdi.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, Pekin Üniversitesi ve Şanghay Jiao Tong ile iş birliği içinde, ilk hibrit dikkat büyük model konumdan bağımsız önbellek sistemini önerdi - Aioga AI Haberleri","description":"HYPIC, hibrit dikkat büyük modelinde konumdan bağımsız önbellekleme uyguladı ve ortalama ilk token gecikmesini 3,25 kat azalttı. Dört üretim düzeyindeki modelde, aynı SLO altında s","url":"https://www.aioga.com/tr/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:03.007Z"},"vi":{"title":"HYPIC: Xiaohongshu, phối hợp với Đại học Bắc Kinh và Giao thông Thượng Hải, đã đề xuất hệ thống bộ nhớ đệm độc lập với vị trí mô hình lớn chú ý kết hợp đầu tiên","summary":"HYPIC đã triển khai bộ nhớ đệm không phụ thuộc vào vị trí trên mô hình lớn chú ý kết hợp của mình, giảm độ trễ trung bình của token đầu tiên xuống 3,25 lần. Trên bốn mô hình cấp sản xuất, QPS bền vững được cải thiện 1,66 lần trong cùng một SLO và chất lượng tác vụ chỉ chênh lệch 1,71 điểm so với một bộ lọc đầy đủ.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, phối hợp với Đại học Bắc Kinh và Giao thông Thượng Hải, đã đề xuất hệ thống bộ nhớ đệm độc lập với vị trí mô hình lớn chú ý kết hợp đầu tiên - Tin tức AI Aioga","description":"HYPIC đã triển khai bộ nhớ đệm không phụ thuộc vào vị trí trên mô hình lớn chú ý kết hợp của mình, giảm độ trễ trung bình của token đầu tiên xuống 3,25 lần. Trên bốn mô hình cấp sả","url":"https://www.aioga.com/vi/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:02.668Z"},"id":{"title":"HYPIC: Xiaohongshu, bekerja sama dengan Universitas Peking dan Shanghai Jiao Tong, mengusulkan sistem caching independen lokasi model besar perhatian hibrida pertama","summary":"HYPIC telah menerapkan caching independen lokasi pada model besar perhatian hibridnya, mengurangi latensi token pertama rata-rata sebesar 3,25 kali. Pada empat model tingkat produksi, QPS berkelanjutan meningkat 1,66 kali lipat di bawah SLO yang sama, dan kualitas tugas berbeda hanya 1,71 poin dari pemfaktoran ulang penuh.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, bekerja sama dengan Universitas Peking dan Shanghai Jiao Tong, mengusulkan sistem caching independen lokasi model besar perhatian hibrida pertama - Berita AI Aioga","description":"HYPIC telah menerapkan caching independen lokasi pada model besar perhatian hibridnya, mengurangi latensi token pertama rata-rata sebesar 3,25 kali. Pada empat model tingkat produk","url":"https://www.aioga.com/id/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:03.832Z"},"th":{"title":"HYPIC: Xiaohongshu ร่วมกับมหาวิทยาลัยปักกิ่งและเซี่ยงไฮ้ Jiao Tong ได้เสนอระบบแคชที่ไม่ขึ้นกับตําแหน่งที่ตั้งแบบจําลองขนาดใหญ่แบบไฮบริดตัวแรก","summary":"HYPIC ได้ใช้การแคชที่ไม่ขึ้นกับตําแหน่งในโมเดลขนาดใหญ่ที่ให้ความสนใจแบบไฮบริด ซึ่งช่วยลดเวลาแฝงของโทเค็นแรกโดยเฉลี่ยลง 3.25 เท่า ในรุ่นระดับการผลิตสี่รุ่น QPS ที่ยั่งยืนดีขึ้น 1.66 เท่าภายใต้ SLO เดียวกัน และคุณภาพของงานแตกต่างกันเพียง 1.71 คะแนนจากการปรับโครงสร้างเต็มรูปแบบ","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu ร่วมกับมหาวิทยาลัยปักกิ่งและเซี่ยงไฮ้ Jiao Tong ได้เสนอระบบแคชที่ไม่ขึ้นกับตําแหน่งที่ตั้งแบบจําลองขนาดใหญ่แบบไฮบริดตัวแรก - ข่าว AI Aioga","description":"HYPIC ได้ใช้การแคชที่ไม่ขึ้นกับตําแหน่งในโมเดลขนาดใหญ่ที่ให้ความสนใจแบบไฮบริด ซึ่งช่วยลดเวลาแฝงของโทเค็นแรกโดยเฉลี่ยลง 3.25 เท่า ในรุ่นระดับการผลิตสี่รุ่น QPS ที่ยั่งยืนดีขึ้น 1.66","url":"https://www.aioga.com/th/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:04.186Z"},"pl":{"title":"HYPIC: Xiaohongshu, we współpracy z Uniwersytetem Pekińskim i Shanghai Jiao Tong, zaproponował pierwszy hybrydowy system pamięci podręcznej dużej uwagi niezależny od lokalizacji","summary":"HYPIC wdrożył pamięć niezależną od lokalizacji w swoim hybrydowym modelu dużej uwagi (Hybrid Attention), zmniejszając średnie opóźnienie pierwszego tokena o 3,25-krotność. W czterech modelach produkcyjnych zrównoważone QPS poprawiło się o 1,66 razy przy tym samym SLO, a jakość zadań różniła się tylko o 1,71 punktu od pełnej refaktoryzacji.","category":"论文研究","source":"公众号：小红书技术（dots.llm）","aggregationSource":"公众号：小红书技术（dots.llm）","pageTitle":"HYPIC: Xiaohongshu, we współpracy z Uniwersytetem Pekińskim i Shanghai Jiao Tong, zaproponował pierwszy hybrydowy system pamięci podręcznej dużej uwagi niezależny od lokalizacji - Aioga Wiadomości AI","description":"HYPIC wdrożył pamięć niezależną od lokalizacji w swoim hybrydowym modelu dużej uwagi (Hybrid Attention), zmniejszając średnie opóźnienie pierwszego tokena o 3,25-krotność. W cztere","url":"https://www.aioga.com/pl/news/cmrnclu0101cgbic6rpcgkw8s/","contentTranslated":true,"sourceHash":"760c3cd35dab07f2","translatedAt":"2026-07-19T11:51:04.918Z"}}}}