Jailbroken PS5 runs Qwen3.8-27B locally at 20.9 tokens/s with GPU acceleration
Developer abhi245y has built PS5LM Plus, a native GPU application that lets jailbroken PS5 consoles run large language models locally, building on the PS5LM llama.cpp port by AI engineer Mert Cobanov. By porting Mesa's open-source AMD RADV driver and using the Vulkan compute interface to run llama.cpp as a native app, the project raised usable memory from about 6GB to 11.4GB, enough for a heavily quantized Qwen3.8-27B that generates at roughly 20.9 tokens per second, with GPU utilization at 100% and CPU at 2% during testing. The project also includes a web chat interface and an API on LAN port 8081 that is compatible with OpenAI and Anthropic interfaces, so tools such as Claude Code and Codex can call the console-hosted model; the 16GB unified memory and the risk of console or PSN bans from jailbreaking remain the main constraints.
It shows a game console's GPU and high memory bandwidth can serve as a low-cost local inference node in experimental setups, though memory limits and jailbreak risks keep it niche.