Vulkan

Headlines · 8

1. 2h
   Ollama v0.40.17 adds concurrent MLX generation and Vulkan mmap support

   Ollama v0.40.17 adds concurrent generation to its MLX backend and uses mmap for Vulkan integrated GPUs, according to the release notes. The update also improves ChatGPT CLI restore and graceful restart, uses thinking metadata for OpenCode settings, and bumps llama.cpp to b12257 along with MLX and MLX-C.

   Ollama Releases · 🔥 9
2. 1d
   RustingStrata Runs DeepSeek-V4.1-Flash on a Single RTX 3060

   A Reddit post reports that the pure-Rust GGUF inference engine RustingStrata can run the 249 GB DeepSeek-V4.1-Flash IQ2_XXS model on a single RTX 3060 12 GB with 30 GB RAM. It streams model experts from SSD through the page cache and uses a 9 GB LRU cache in VRAM, while attention and shared matrix-vector operations run on the GPU. In the submitter’s comparison, RustingStrata achieved 2–3.6 tok/s decoding versus 0.3–1.5 tok/s for llama.cpp b12116, but sampling and tool calls were not yet supported, the context cap was 4096, and results may vary with page-cache conditions.

   r/LocalLLaMA · 🔥 2
3. 5d
   Deploying Qwen3.5 4B on a Legacy RX 580 Server

   A report from 掘金 · 人工智能 documents running Qwen3.5 4B with Ollama 0.40.14 on Windows 10 using an Intel Xeon E5-2670 v2, 32 GB of memory, and an 8 GB AMD RX 580. The author exposes the model to WorkBuddy and Dify through an OpenAI-compatible API, with the Xeon serving as fallback compute at a reported prefill speed of about 54–74 tokens per second. Because the Vulkan flash-attention path produced zero-filled output on longer prompts, the deployment disables flash attention and accepts slower generation for more predictable results.

   掘金 · 人工智能 · 🔥 0
4. 6d
   RustingStrata Brings Pure-Rust Qwen Inference to CUDA and Vulkan

   Developer Serious_Scarcity7818 introduced RustingStrata, a pure-Rust inference engine for Qwen GGUF models without ggml, supporting CUDA and Vulkan as well as hybrid CPU-GPU execution for MoE experts that exceed VRAM capacity. On the developer’s RTX 3060 12 GB system, it averaged about 36 tokens per second decoding Qwen3.8-Flash-Next, while a third-party tester reported roughly 209 tokens per second for Qwen3.6-35B-A3B on an RX 7900 XT.

   r/LocalLLaMA · 🔥 0
5. Nov 2
   Eden-NX2 brings experimental Nintendo Switch 2 emulation to PC

   Developer Takoroka has released Eden-NX2, an experimental fork of the Eden emulator with support for Nintendo Switch 2 games. TechSpot cites enthusiast videos showing it running Mario Kart World and Donkey Kong Bananza, though compatibility and performance still require work and the build needs a powerful PC. TechSpot also reports that AI-assisted coding contributed to the emulator’s development.

   TechSpot · 🔥 0
6. Oct 29
   AMD FSR SDK 2.4 Adds Vulkan Support and Expands FSR 4.1.2

   AMD has released FSR SDK 2.4, bringing machine-learning-based FSR Upscaling 4.1.2 to Radeon RX 6000-series GPUs and selected Ryzen APUs. According to IT之家 and Wccftech, the SDK is the first FSR "Redstone" release to provide Vulkan upscaling and frame generation with DirectX 12 feature parity. The update also adds improved frame pacing for Radeon RX 9000 GPUs and additional ray-tracing denoising capabilities.

   Wccftech · 🔥 0
7. Oct 20
   AMD expands FSR 4.1 to RX 6000 GPUs, Ryzen APUs, handhelds and Xbox

   AMD announced that its machine-learning FSR 4.1 upscaling now reaches Radeon RX 6000-series (RDNA 2) GPUs, Ryzen AI Max and Ryzen AI 9 APUs, and Ryzen Z2-series handhelds including the ROG Xbox Ally, with the update included in version 26.10.1 of its graphics driver as reported by TechSpot. The company says it retuned the neural network to run on INT8 shader hardware instead of the FP8 matrix hardware on Radeon RX 9000 cards, and built a handheld model less than half the size of the full one to fit tighter power budgets. AMD also confirmed FSR 4.1 is coming to Xbox Series X and Series S with no date given, that Vulkan API support will arrive in FSR SDK 2.4, and that future APUs will be added; it separately said the next Xbox, codenamed Project Helix, will use an FSR Diamond technology whose details it has not disclosed.

   Tom’s Hardware · 🔥 0
8. Oct 14
   Jailbroken PS5 runs Qwen3.8-27B locally at 20.9 tokens/s via GPU

   Developer abhi245y built PS5LM Plus, a native GPU app on top of Mert Cobanov's PS5LM llama.cpp port, letting a jailbroken PS5 call the console GPU through a Mesa RADV driver and Vulkan; usable memory reportedly rose from about 6GB to 11.4GB, enough for a heavily quantized Qwen3.8-27B. Developer-reported tests put that model at about 20.9 tokens/s with GPU utilization at 100% and CPU at 2%, while smaller Gemma 4 E4B and Llama 3.2 3B models reached roughly 61 and 124 tokens/s. PS5LM Plus also offers a LAN web chat interface and OpenAI/Anthropic-compatible APIs, but it requires a jailbreak, carries warranty and account-ban risks, and the 16GB unified memory still limits model size and quality.

   Wccftech · 🔥 0

Experience and discussion from the community

Share my Vulkan experienceAsk about Vulkan

All

upscayl•9h Pinned

upscayl: A free and open source application for enlarging and enhancing low-resolution images with AI models.

What problem it solves Low-resolution and pixelated images can appear too small or lack usable detail when enlarged. Upscayl addresses this by applying AI models that enhance images while estimating missing details, though blurred or out-of-focus images remain outside its intended use. Key features AI image enhancement — The application uses AI models to enlarge images and estimate details that we…

github.comhttps://github.com/upscayl/upscayl

LocalAI•4d Pinned

LocalAI: An open-source AI engine for running models locally across modalities and hardware.

What problem it solves Running AI models locally can require integrating multiple inference engines, model formats, hardware accelerators, and API surfaces. LocalAI addresses this with a small core, on-demand backends, and compatible APIs that work across supported hardware without requiring a GPU. Key features Composable inference backends — Backends are packaged separately and pulled only when a…

github.comhttps://github.com/mudler/LocalAI