创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

GPU Unlock解锁RTX张量核心限制

AI 总结

Zagitta主导的GPU Unlock等社区项目通过修改GPU启动配置,解除部分NVIDIA GeForce RTX 20、30、40系列显卡在FP32累加的FP16/BF16 Tensor Core运算中的指令发射率限制。Tom’s Hardware和36氪 AI汇总的测试显示,部分矩阵运算峰值吞吐接近翻倍,Ampere显卡的LLM预填充提升14%至36%,但解码和INT8性能基本不变。Linux方案已有公开实现,Windows支持及具体卡型覆盖仍处于实验或未完成状态。

深度见解

这些项目可能让部分本地AI和图像生成用户从现有RTX硬件中获得更多算力,但实测收益取决于显卡与负载,不能据此认定LLM解码或游戏性能会同步提升。

Basically saw on twitter claims that 3090 has half of the cuda kernels disabled:

My 3090s just got 1.9x FASTER at BF16 tensor math!!! Same cards, same driver, same 300W, one Linux kernel module.

bf16 tensor pipe: 82 -> 155 TFLOPS cuBLAS BF16 GEMM 8192: 64 -> 99 TFLOPS TF32: 41 -> 79 TFLOPS

NVIDIA ships every 3090 with fp32-accumulate tensor math at half speed. The driver even reports it: FMLA32 = 1/2. gpu-unlock by Zagitta sets it to full before the NVIDIA driver loads. After a cold boot all 4 of my cards say FMLA32 = full.

Real inference got less than I predicted. Strata, Qwen3.8 Flash-Next on 2 cards, prefill: 4K: +12% 10K: +12% 90K: 3205 -> 3536 tok/s, +10%

Before installing I said +14 to 19% at 90K, so I was wrong. The GEMM phases got 23% shorter, but they are only about 40% of Strata prefill, and the int8 experts, copies and CUDA core kernels didnt get any faster.

Outputs did not change. With the same expert cache size, my log-prob dump over 1996 teacher-forced positions is the same file byte for byte as the stock run before the module.

Wondering if it will work for 40 series cards

submitted by /u/UltramanQuar [link] [comments]

#GPU Unlock#NVIDIA GeForce RTX 20 Series#NVIDIA GeForce RTX 30 Series#NVIDIA GeForce RTX 40 Series#NVIDIA GeForce RTX 3090#NVIDIA GeForce RTX 3090 Ti#NVIDIA GeForce RTX 3080 Ti#NVIDIA GeForce RTX 4090#NVIDIA GeForce RTX 2080 Ti#Zagitta

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。