Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

vLLM v0.34.0rc1 fixes NaN handling in XPU speculative decoding

AI summary

The vLLM releases report shows that the v0.34.0rc1 tag points to commit 52aeb58 and was tagged on November 11 at 19:37. Its visible release note lists an XPU speculative-decoding bugfix that changes greedy_argmax to treat NaN as negative infinity, although the title is truncated and the page shows loading errors.

In-depth insight

The release includes a targeted correctness fix for greedy_argmax in XPU speculative decoding, addressing how NaN values are handled.

v0.34.0rc1

v0.34.0rc1

@taneem-ibrahim

taneem-ibrahim tagged this 11 Nov 19:37

#vLLM

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.