vLLM v0.34.0rc1修复XPU推测解码NaN处理
AI 总结
vLLM发布报告显示,v0.34.0rc1标签对应提交52aeb58,于11月11日19时37分打标。可见发布说明列出一项针对XPU推测解码的缺陷修复,将greedy_argmax改为把NaN视为负无穷;不过标题被截断,页面也显示加载错误。
深度见解
该版本包含一项针对XPU推测解码中greedy_argmax的定向正确性修复,处理了NaN值的处理方式。
v0.34.0rc1
- v0.34.0rc1
-
52aeb58 - Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry, something went wrong. Uh oh! There was an error while loading. Please reload this page. No results found View all tags
- v0.34.0rc1
-
52aeb58 - Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry, something went wrong. Uh oh! There was an error while loading. Please reload this page. No results found View all tags
taneem-ibrahim tagged this 11 Nov 19:37