cuBLAS新增Ozaki-II与2M算法加速FP64矩阵运算
NVIDIA技术博客称,CUDA Toolkit 13.4.2在cuBLAS中引入Ozaki-II和2M算法,利用整数Tensor Core加速实数与复数双精度矩阵乘法。Ozaki-II比Ozaki-I需要更少的整数乘法,2M则将一次复数乘法从四次实数乘法降至两次。NVIDIA表示cuBLAS可自动启用这些加速,无需修改应用代码,并公布了面向科学计算应用的基准结果。
这些算法可在保持双精度准确性的同时把FP64计算映射到更快的整数Tensor Core上,且无需修改应用代码,可能缩短HPC和AI工作负载的矩阵运算时间。
Many scientific simulations, from molecular chemistry to materials science, spend the majority of their execution time computing high-precision dense general matrix multiplications (GEMM). These operations are called DGEMM for real 64-bit floating-point numbers and ZGEMM for complex 64-bit floating-point numbers. cuBLAS is widely used by HPC and AI applications to accelerate GEMM and other Basic Linear Algebra Subprograms (BLAS) on NVIDIA GPUs. Rapid advances in lower-precision hardware have motivated exploration of a new class of algorithms that deliver full double-precision results on the faster integer Tensor Cores.
With CUDA Toolkit 13.4.2, cuBLAS no longer has to choose between accuracy and speed. cuBLAS breaks each double-precision number into integer pieces, multiplies them on the GPU’s Tensor Cores, and reassembles the exact result. The answers keep full double-precision accuracy, but the work runs on faster hardware.
Two new algorithms make this more efficient: Ozaki-II needs fewer integer multiplications than the earlier Ozaki-I approach, and the 2M method cuts a complex matrix multiplication from four real multiplications to two. This builds on the Automatic Dynamic Precision (ADP) framework introduced in Unlocking Tensor Core Performance with Floating Point Emulation in cuBLAS, which delivers higher double-precision (FP64) matrix-multiplication performance by mapping FP64 arithmetic onto integer Tensor Cores while preserving native FP64 accuracy.
#NVIDIA#cuBLAS#CUDA Toolkit 13.4.2#Ozaki-II#2M#Automatic Dynamic Precision#NVIDIA VR NVL72#NVIDIA GB200#NVIDIA RTX PRO 6000#BerkeleyGW