Tesla V100-SXM2
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Developer reports DeepSeek-V4.1-Flash running on eight V100 GPUs
A developer reported running a quantized DeepSeek-V4.1-Flash-1017 build on eight Tesla V100-SXM2 GPUs, with all 248.8 GB of weights held in VRAM and a 524,288-token context limit per request. The developer's measurements showed code generation at 215 tokens per second after a 1K prompt, falling to 160 tokens per second at 256K. Prefill reached about 2,200 tokens per second at 128K and 256K. The server handles one request at a time, and the report publishes launch configurations, A/B test results, raw benchmark data, and tooling.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my Tesla V100-SXM2 experienceAsk about Tesla V100-SXM2
Nobody has shared their experience with Tesla V100-SXM2 yet.