vLLM v0.34.0rc1 fixes NaN handling in XPU speculative decoding
AI summary
The vLLM releases report shows that the v0.34.0rc1 tag points to commit 52aeb58 and was tagged on November 11 at 19:37. Its visible release note lists an XPU speculative-decoding bugfix that changes greedy_argmax to treat NaN as negative infinity, although the title is truncated and the page shows loading errors.
In-depth insight
The release includes a targeted correctness fix for greedy_argmax in XPU speculative decoding, addressing how NaN values are handled.
v0.34.0rc1
- v0.34.0rc1
-
52aeb58 - Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry, something went wrong. Uh oh! There was an error while loading. Please reload this page. No results found View all tags
- v0.34.0rc1
-
52aeb58 - Choose a tag to compare Sorry, something went wrong. Filter Loading Sorry, something went wrong. Uh oh! There was an error while loading. Please reload this page. No results found View all tags
taneem-ibrahim tagged this 11 Nov 19:37