Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Nvidia RTX Spark laptops run on Linux, but AC power cuts GPT-OSS-120B inference to 13.9 tok/s

AI summary

Hands-on testing found native Linux installs and runs on Nvidia RTX Spark laptops such as the MSI Prestige N16 Flip AI Plus, with GPU acceleration via Nvidia's open kernel driver, a full desktop, 4K 120Hz output and working audio and input devices after configuration. The catch is power management: when plugged into wall power the GPU is locked to roughly 780 MHz on Linux versus about 2.2 GHz on Windows, and on GPT-OSS-120B Windows reached 65.4 tokens per second, WSL 65.1, an Nvidia DGX Spark 61, while native Linux managed only 13.9. The report attributes the gap to an encrypted firmware power table and a Windows-only component called Nvidia Platform Controllers and Framework, which has no Linux equivalent, and says a fix requires Nvidia to port that power-management logic into its Linux driver. On battery, Linux clocks and throughput approach Windows levels, and WSL is presented as the practical middle ground since it keeps full GPU boost while retaining tools such as vLLM.

In-depth insight

Developers who buy RTX Spark laptops for local inference are currently told to use WSL rather than native Linux: on the same machine, plugged-in native Linux delivers about one-fifth the GPT-OSS-120B throughput of Windows, so the choice of operating system directly changes local AI workload speed.

Yes, but it comes with a serious catch. Linux installs and runs on RTX Spark laptops like the MSI Prestige N16 Flip AI Plus, including GPU acceleration through Nvidia’s open kernel driver. The problem is clock speed: once the laptop is plugged into wall power, the GPU gets locked to roughly 780 MHz on Linux instead of the 2 GHz-plus it hits on Windows. That turns a chip capable of around 65 tokens per second on a 120 billion parameter model into one struggling to break 14 tokens per second, for reasons tied to power management firmware that Linux currently can’t read.

TL;DR

  • Dual-booting Linux works on the MSI Prestige RTX Spark laptop, with a full desktop, GPU acceleration via Nvidia’s open driver, 4K output at 120Hz, and working audio, keyboard, and touchpad once configured correctly.
  • A hidden Windows-only component called the Nvidia Platform Controllers and Framework manages power delivery between CPU and GPU, and it has no Linux equivalent, which is the root cause of the slowdown.
  • GPU clock speed collapses to about 780 MHz on Linux when plugged in, compared to roughly 2.2 GHz on Windows, because the firmware’s power table is encrypted and only the Windows driver can decrypt it.
  • Benchmarks on GPT-OSS-120B show the gap clearly: Windows hit 65.4 tokens per second, WSL hit 65.1, the Nvidia DGX Spark hit 61, and native Linux on the same laptop managed only 13.9.
  • Memory allocation is a separate headache, since the laptop reserves 96GB of unified memory for the GPU by default and only Windows exposes a setting to change that split, which is required before Linux can see more than a sliver of RAM.
  • WSL (Windows Subsystem for Linux) is the practical middle ground today, since it rides on the Windows driver stack and keeps full GPU boost whether the laptop is plugged in or on battery, while still running Linux-first AI tools like vLLM.
  • A real fix depends on Nvidia, specifically on porting the platform controller’s power management logic into its Linux driver, which would effectively turn the laptop into a portable version of the DGX Spark.

#Nvidia#MSI#GPT-OSS-120B#vLLM#SGLang#WSL#Nvidia DGX Spark#Omarchy#LM Studio

Original · 8 min readRead the original
Group chat

No comments yet. Start the conversation.