Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

cudaMemcpy tuner

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. Developer reports cudaMemcpy tuning boosts MoE prefill on RTX 3090

    Developer Maknee released a tool that tunes CUDA memory copies for CPU offloading in MoE inference. In a self-reported llama-bench test using an RTX 3090, Ryzen 7 7800X3D and Qwen3.6-35B-A3B-Q8_0, prefill throughput increased from 345 to 466 tokens per second. The developer published the code and benchmark setup.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my cudaMemcpy tuner experienceAsk about cudaMemcpy tuner

Nobody has shared their experience with cudaMemcpy tuner yet.