Jailbroken PS5 runs 27B local AI models at 20 tokens/sec
GitHub developer cobanov previously ported llama.cpp to the PS5 as the community project PS5LM, but it ran as a CPU payload limited to roughly 6.25 GiB of RAM and mainly handled small 0.8B and 2B models. Reddit user u/AdIllustrious7246 then forked it into a native app that reaches the console's GPU through PS5_Vulkan, a port of the RADV graphics driver, raising usable memory to about 11.4 GiB and running Qwen 3.8 27B with low-bit quantization (such as IQ2_XXS) at roughly 20 tokens per second. The developer also reported about 61 tokens/sec for Gemma 4 E4B and 124 tokens/sec for Llama 3.2 3B, and added a dashboard showing live generation speed, GPU/CPU usage, power draw and temperatures, plus an OpenAI API-compatible interface for LAN access. All figures are the developer's own publicly posted results, require a jailbroken console and specific firmware (docs list 7.00 to 13.60), and are not an official Sony feature.
It shows console GPUs and high-bandwidth unified memory can handle local LLM inference once software support exists, though this remains a jailbreak-dependent community experiment far from an AI PC or dedicated server.