At SC26 in Chicago, storage-controller vendor Phison demonstrated an SSD design for AI servers that integrates a neural processing unit (NPU) and 64GB of memory. The design is intended to run AI frameworks and models such as PyTorch, llama.cpp, vLLM and OpenVINO inside the drive, allowing some processing to occur before data leaves the storage device. Phison says that, for suitable workloads, the …
Apple announced a 14-inch MacBook Pro powered by the M6 chip, with a 12-core CPU, 12-core GPU, additional GPU Neural Accelerators and a dual 16-core Neural Engine. Apple says the GPU delivers up to 30% faster graphics and up to 25% faster AI workloads than M5, while the laptop supports Wi-Fi 7, Bluetooth 6 and running LLMs locally. Preorders begin October 28, with availability from November 6, sta…
Researchers from iLearn-Lab at Harbin Institute of Technology (Shenzhen) and LV-Lab at the National University of Singapore propose QuantWM, a training-free framework for 2-bit KV Cache quantization in video world models. The team says its query-sensitive clustering and low-rank attention compensation improve visual stability while achieving up to 6.20x KV Cache compression across five evaluated m…
Google DeepMind launched EmbeddingGemma 2, a 740-million-parameter open-weight multimodal embedding model that maps text, code, images, audio, and video into a shared embedding space. Released under the Apache 2.0 license, it is designed for on-device search and retrieval, with modular encoders, an 8K-token context window, and support for reducing vector dimensions to lower storage use.
Why it ma…