chaos/script
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix: 透明分批压缩 - /v1路由 + 超限自动compact无需客户端感知

Browse Source 
关键改动:
1. /v1/<path> 路由: 与 /v2 相同代理逻辑,兼容标准OpenAI客户端
2. auto_compact(): chat/completions超限时自动分批压缩,返回标准OpenAI格式
   - 客户端完全无感知,不需要调用特殊端点
   - 支持stream=true(SSE)和stream=false
   - X-Auto-Compact响应头标识自动压缩发生
3. 非chat/completions超限仍返回413清晰错误
4. 修复compact SSE与Waitress的direct_passthrough兼容问题
This commit is contained in:
chaos committed 2026-07-08 14:21:38 +08:00
1 parent 85ea33eb4e
commit 368ffbe66c
2 files changed
+196 -4
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

.gitignore
+1
View File
@@ -0,0 +1 @@
__pycache__/