Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

GPT-OSS-120B

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 10

  1. Microsoft previews USB4 RDMA for distributed AI inference on Windows 11

    Microsoft announced a developer preview of USB4-based RDMA that lets two or more compatible Windows 11 PCs pool memory and GPU capacity to run a shared AI model through supported inference frameworks, without dedicated RDMA adapters or switches. Microsoft reported round-trip latency of about 28–50 microseconds for small transfers. In separate vendor tests, Microsoft used three AMD mini PCs to run a four-bit-quantized 235-billion-parameter Qwen3 model at about 18.5 tokens per second; AMD reported about 22 tokens per second for Qwen3-235B-A22B, while Intel reported 54.2 tokens per second for GPT-OSS-120B on four Core Ultra Series 3 PCs.

    IT之家 AI · 🔥 4
  2. ChatGPT for SNES v0.7 brings a tiny language model to the cartridge

    Benj Edwards and AI agents have released version 0.7 of ChatGPT for SNES, an unofficial experiment that runs a roughly 2.2-million-parameter language model on the Super FX 2 chip. Downloadable ROM and browser-emulator builds include an optional fact book containing opening sentences from 150,000 Simple English Wikipedia articles. The project is not made or endorsed by OpenAI, and both sources note that its limited knowledge makes answers inaccurate at times.

    Hacker News · AI(100+ 分) · 🔥 11
  3. tandem.cpp adds AMD ROCm support and large-model CPU/GPU offloading

    The developer of tandem.cpp announced that its llama.cpp patch set can now build with HIP for AMD ROCm, while keeping frequently used MoE experts on the GPU and offloading remaining work to the CPU. In developer-run tests, DeepSeek-V4.1-Flash IQ2_XS with 139 GiB of experts reached 14.2 decode tokens per second on a system with an RTX 5070 Ti and 64 GB RAM, compared with 7.4 for llama.cpp. The AMD RX 7900 XTX test also included Qwen3.8 IQ3_S with MTP, but the reported performance figures have not been independently verified and Vulkan support is not yet available.

    r/LocalLLaMA · 🔥 0
  4. SGLang-Neuron v0.1.0 brings SGLang serving to AWS Trainium

    RadixArk and Amazon Annapurna Labs released SGLang-Neuron v0.1.0 as an open-source, PyTorch-native backend for serving language and diffusion models on AWS Trainium, with the LMSYS Blog describing it as being in public preview and AWS Machine Learning Blog calling it publicly available. The plugin retains SGLang’s server interface and adds an asynchronous runtime, megakernels, prefill-decode disaggregation, and a host-memory HiCache tier. Vendor-reported configurations include Kimi-K3 across three Trainium3 nodes, GLM-5.2 with a 1M-token context, and SGLang Diffusion on Trainium2.

    LMSYS Blog · 🔥 0
  5. OpenRouter test finds no detected accuracy difference across fp8, fp4 and fp16

    OpenRouter analyzed 1,455 provider endpoints on October 20, 2026, finding that 865, or 59.5%, did not report a precision label. In a test of six Qwen3.8 27B endpoints on that day, it detected no accuracy difference among fp8, fp4 and fp16 across 240 scored tasks; all six scored between 98.3% and 99.2%. One fp4 endpoint ranked lowest on 40 additional multiplication tasks, but by a gap too small to rule out chance. Lower precision was generally cheaper, but not universally: 8-bit cost less than 16-bit for 14 of 24 compared models, while 4-bit cost less than 8-bit for 26 of 33. The quality comparison covered one model on one day, and OpenRouter could not determine which quantization methods the providers used.

    OpenRouter Blog · 🔥 0
  6. Artificial Analysis Endpoint Accuracy Index v1.1 expands coverage

    Artificial Analysis launched Endpoint Accuracy Index v1.1, expanding coverage to six open-weight models, including GLM-5.3 Flash and Muse Spark Open. The index compares provider endpoints with a self-hosted reference using tool calling, scientific reasoning and long-context recall; its updated AA-LCR v1.1 uses 25 repeats and narrows the average 95% confidence interval from ±4.7 to ±2.6 points.

    ArtificialAnlys (X) · 🔥 0
  7. Tiiny Pocket tests show trade-offs between local-AI speed and coding performance

    Reddit user /u/IronDiligent6698 tested three local language models on a Tiiny Pocket running TiinyOS 0.1.36. In median speed results, Qwen3.5-9B-Turbo was fastest at about 75 output tokens per second, while Qwen3.6-35B-A3B-Turbo reached about 64 tokens per second and gpt-oss-120b averaged about 16. In a coding test, the 9B model produced no gradable result, the 35B model passed 9 of 10 tests, and gpt-oss-120b passed all 10 in about 229 seconds; the latter two took roughly 235 and 229 seconds, respectively. The author kept each model’s best run and acknowledged possible gaps in the testing method. The user also reported that personal-model import and Hugging Face installation were unavailable, while the team had reportedly planned an import tool.

    r/LocalLLaMA · 🔥 0
  8. Nvidia RTX Spark laptops run on Linux, but AC power cuts GPT-OSS-120B inference to 13.9 tok/s

    Hands-on testing found native Linux installs and runs on Nvidia RTX Spark laptops such as the MSI Prestige N16 Flip AI Plus, with GPU acceleration via Nvidia's open kernel driver, a full desktop, 4K 120Hz output and working audio and input devices after configuration. The catch is power management: when plugged into wall power the GPU is locked to roughly 780 MHz on Linux versus about 2.2 GHz on Windows, and on GPT-OSS-120B Windows reached 65.4 tokens per second, WSL 65.1, an Nvidia DGX Spark 61, while native Linux managed only 13.9. The report attributes the gap to an encrypted firmware power table and a Windows-only component called Nvidia Platform Controllers and Framework, which has no Linux equivalent, and says a fix requires Nvidia to port that power-management logic into its Linux driver. On battery, Linux clocks and throughput approach Windows levels, and WSL is presented as the practical middle ground since it keeps full GPU boost while retaining tools such as vLLM.

    Hacker News 首页(100+ 分) · 🔥 0
  9. tandem.cpp accelerates CPU-assisted MoE decoding on consumer GPUs

    The independent tandem.cpp project has released patches for llama.cpp that keep frequently used MoE experts on the GPU while the CPU handles the rest, targeting single-user decoding when a model does not fit in VRAM. The project reports that Qwen3.8-Flash-Next reached 97.3 decoding tokens per second with greedy sampling on an i5-12400F system with 64 GB DDR4 memory and an RTX 4090, compared with 29.8 tokens per second for llama.cpp. It also reports gains for gpt-oss-120b and other MoE models, although the implementation is tuned specifically for Qwen3.8.

    r/LocalLLaMA · 🔥 0
  10. Apple study compares plan-first vs retrieve-first tool discovery for LLM agents

    Apple Machine Learning Research published an EMNLP paper by Mingfei Zhang and co-authors comparing two ways tool-using LLM agents find APIs before planning: Retrieve-then-Plan (RtP), which embeds the query and retrieves similar tools, and Plan-then-Retrieve (PtR), in which the model first generates abstract tool stubs that become retrieval queries. On ToolBench's 46,984 API endpoints across 50 categories, RtP beat PtR on single-tool queries while PtR beat RtP on multi-tool queries; the crossover held at retrieval budgets k=1–20, registry sizes from 1k to 47k APIs, and with Gemini 2.5 Flash and gpt-oss-120b. The authors also describe a stub-hallucination failure mode, note that PtR's extra discovery call roughly doubles inference cost, and suggest complexity-adaptive routing using RtP's top-1 retrieval score.

    Apple Machine Learning Research · 🔥 0

Experience and discussion from the community

Share my GPT-OSS-120B experienceAsk about GPT-OSS-120B

Nobody has shared their experience with GPT-OSS-120B yet.