Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

1Cat-vLLM

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 2

  1. 1Cat-vLLM outpaces Strata on most Tesla V100 tests

    A community benchmark on four 16 GB Tesla V100 GPUs found that 1Cat-vLLM delivered higher single-stream decode rates than Strata across all tested prompt lengths, including 124.9 versus 74.8 tokens per second at 2,654 tokens. It also led most prefill and concurrent-request tests, but Strata performed better on prefill near 100K tokens and generally achieved higher multi-token-prediction acceptance. The author says 1Cat-vLLM is a Tesla V100-focused vLLM fork with original expert-caching work.

    r/LocalLLaMA · 🔥 0
  2. Developer reports DeepSeek-V4.1-Flash running on eight V100 GPUs

    A developer reported running a quantized DeepSeek-V4.1-Flash-1017 build on eight Tesla V100-SXM2 GPUs, with all 248.8 GB of weights held in VRAM and a 524,288-token context limit per request. The developer's measurements showed code generation at 215 tokens per second after a 1K prompt, falling to 160 tokens per second at 256K. Prefill reached about 2,200 tokens per second at 128K and 256K. The server handles one request at a time, and the report publishes launch configurations, A/B test results, raw benchmark data, and tooling.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my 1Cat-vLLM experienceAsk about 1Cat-vLLM

Nobody has shared their experience with 1Cat-vLLM yet.