Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Nvidia DGX Spark

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 25

  1. 12 Used V100 GPUs Run DeepSeek V4.1 Flash's Full Expert Set

    Nick Mermiges expanded his private AI server from eight to 12 used Nvidia V100 GPUs, with four cards on each of three boards. He reports that the system runs all 15,360 DeepSeek V4.1 Flash experts on the cards using 4-bit NVFP4. His measurements show 157–184 tokens per second for a single code stream, a 28.1-second first-token time for a 128K context, and power draw of up to about 2,100W. The reports attribute these figures to the owner and note that answer quality in use was not established.

    Tom’s Hardware · 🔥 11
  2. Inkling 2 Mini launches with day-zero vLLM support

    Thinking Machines announced Inkling 2 Mini, a multimodal mixture-of-experts model with 26B total parameters, 3.5B active parameters and support for contexts up to 1M tokens. Its middle 12 layers run three times per token with shared weights, separate KV caches and gated messages between passes. vLLM Blog says vLLM provides day-zero support across NVIDIA Blackwell, Hopper and DGX Spark, plus serving support for the TML-d24-varloop-research checkpoint.

    vLLM Blog · 🔥 3
  3. Three Used V100 GPUs Reach 100.8 Tokens/s With Qwen 3.6 35B

    A homelab builder measured 100.8 tokens per second for Qwen 3.6 35B at Q8 on three used Nvidia V100 GPUs with a 4K context, falling to 72.7 tokens per second at 128K. Across more than 130 llama.cpp tests, the dense Qwen 3.6 27B managed 24.3 tokens per second at 4K. In the reported 128K run, the three-V100 build consumed about half the GPU energy of the three-P100 setup. The listed $1,042 price covers only the GPUs and selected components, excluding RAM, storage, the case, cooling, and one of the two CPUs.

    Tom’s Hardware · 🔥 0
  4. 128GB Unified-Memory Mini PCs Bring Large-Model Inference to the Desktop

    掘金·人工智能 argues that 128GB unified-memory mini PCs are becoming a practical desktop platform for running 70B–100B-class models locally, with most of the shared CPU-GPU memory pool available for model weights and KV cache. It reports that Ollama defaults to a 4K context below 24GB and supports 256K at 48GB or more, while Qwen3.6 35B MoE reached 20 tokens per second on a 64GB laptop with integrated graphics, though community reports say the model can lose track of multi-step tasks. The article also compares Nvidia DGX Spark with an AMD mini PC and closes by promoting Codigger’s software-led approach to local inference, cloud workstations, and agent orchestration.

    掘金 · 人工智能 · 🔥 0
  5. Li Auto showcases Mach M100 AI chip at TSMC OIP forum

    Li Auto CTO Xie Yan presented the company’s in-production Mach M100 edge AI chip at the 2026 TSMC OIP ecosystem forum in Beijing on November 17. Li Auto says the 5nm automotive chip uses a dynamic dataflow architecture, delivers 1280 TOPS and has shipped in several models; when running Qwen3.5-35B-A3B, it achieved 2.7 times the prefill speed and 1.5 times the decode speed of NVIDIA DGX Spark. Claims including “world’s first,” utilization above 82% and benchmark superiority remain vendor-reported without independent testing.

    IT之家 AI · 🔥 4
  6. NVIDIA AI Day Seoul draws 2,000 attendees across robotics and agents

    More than 2,000 people attended the two-day AI Day Seoul at COEX, according to NVIDIA Blog, where industry representatives, startups and developer communities discussed physical AI and AI agents. The event included a Hangul Day hackathon whose five finalists built Korean-language agents with the OpenShell runtime, plus developer workshops, certification exams, startup pitches and an AI for Science forum. Sessions were expected to become available soon on NVIDIA On-Demand.

    NVIDIA Blog · 🔥 0
  7. Edge0-145B NAS Storage Test Shows 51x Slower Cold Reads

    A workstation test read the same 105,368,210,944-byte file cold in 18.3 seconds from local NVMe and 15.6 minutes from a gigabit NAS, about 51 times slower. Based on the official model card cited by the author, the report recommends keeping the 51.20 GB lexicon layer on local SSD and the 40.08 GB expert library in system memory or fast local NVMe. The author did not download, load, or run Edge0-145B, so the report contains no measured inference throughput, latency, or memory use.

    掘金 · 人工智能 · 🔥 0
  8. llama.cpp model loading is far slower over NAS than local NVMe

    In local tests by 丘山录, reading a 475.25 GiB model set took 39.6 seconds from onboard NVMe, 114 seconds from a local SSD, and 1 hour 13 minutes 40 seconds from a NAS over a 1 Gb link. Changing only the read block size on the same disk reduced full-read time from 125.1 seconds at 1 MB to 39.7 seconds at 128 MB, while NAS throughput was largely constrained by the network link. Separate tests found that combining shards improved read performance, with the benefit more pronounced over SMB than on local NVMe.

    掘金 · 人工智能 · 🔥 0
  9. What PC Hardware Is Needed for Local AI Models?

    Engadget AI reports that a PC with 16GB of RAM can run relatively small local models around seven to eight billion parameters, while Ollama and LM Studio let users start a chatbot within minutes. Model size determines memory requirements, and memory bandwidth strongly affects generation speed, so a 32GB system or a graphics card with 16GB of VRAM is more practical for larger models. Local use can work offline without a subscription fee or sending data off the PC, according to the report.

    Engadget AI · 🔥 0
  10. NVIDIA Reports Open-Source Progress Toward AI-Native 6G

    NVIDIA says its open-source Aerial and Sionna tools connect wireless simulation, AI training and over-the-air experiments for next-generation 6G research. The company reports that global developer adoption of the two software projects grew 10-fold over the past year, its open-source 5G/6G tools surpassed 1 million downloads, and more than 8,000 research and academic institutions use the platforms. Research teams reported faster robot responses, improved neural radio reception, lower RAN power consumption and simulation times reduced from about three hours to 10–20 minutes in an early evaluation.

    NVIDIA Blog · 🔥 0
  11. Reddit post highlights Foundry Local agentic coding claim

    A Reddit post linked to an item titled “Bring Agentic Coding On-Device with Foundry Local.” Its author claimed 35–135% improvements in decoding and token generation on a 5090 and DGX Spark, but the supplied report provides no baseline or test method with which to evaluate the claim. The post also asked whether the capability could be added to llama.cpp.

    r/LocalLLaMA · 🔥 0
  12. Nvidia RTX Spark laptops run on Linux, but AC power cuts GPT-OSS-120B inference to 13.9 tok/s

    Hands-on testing found native Linux installs and runs on Nvidia RTX Spark laptops such as the MSI Prestige N16 Flip AI Plus, with GPU acceleration via Nvidia's open kernel driver, a full desktop, 4K 120Hz output and working audio and input devices after configuration. The catch is power management: when plugged into wall power the GPU is locked to roughly 780 MHz on Linux versus about 2.2 GHz on Windows, and on GPT-OSS-120B Windows reached 65.4 tokens per second, WSL 65.1, an Nvidia DGX Spark 61, while native Linux managed only 13.9. The report attributes the gap to an encrypted firmware power table and a Windows-only component called Nvidia Platform Controllers and Framework, which has no Linux equivalent, and says a fix requires Nvidia to port that power-management logic into its Linux driver. On battery, Linux clocks and throughput approach Windows levels, and WSL is presented as the practical middle ground since it keeps full GPU boost while retaining tools such as vLLM.

    Hacker News 首页(100+ 分) · 🔥 0
  13. Qwen-Image-2.1 Deployed on NVIDIA DGX Spark with GPUStack

    A Juejin AI author reports deploying Qwen-Image-2.1 on an NVIDIA DGX Spark with the GB10 GPU, 121GB unified CPU/GPU memory, and ARM64 architecture. The GPUStack-managed service exposed an OpenAI-compatible API for text-to-image generation, image editing, native transparent backgrounds, and LoRA; reported results included 49 seconds for a 1024×1024, 40-step generation and 38GB resident memory. The report also documents ARM64 image building, dependency isolation, network troubleshooting, deployment, and gateway configuration.

    掘金 · 人工智能 · 🔥 0
  14. Amazon Reportedly Cancels NVIDIA GPU Orders and Closes Buyer Account

    Amazon canceled AI creator Nick Saraev’s DGX Spark orders and then closed his account following a verification review, according to screenshots and posts reported by Wccftech and Tom’s Hardware. The sources disagree on whether the canceled orders covered four or seven units, and the shared closure email did not specify a reason. Epic CEO Tim Sweeney also said Amazon accepted his regular orders but canceled them before delivery after he tried to purchase two NVIDIA GPUs.

    Tom’s Hardware · 🔥 0
  15. Unsloth adds DeepSeek support in Strata v0.2.9

    Niko Veit announced that Unsloth now supports DeepSeek models. The post listed improvements on Strix, parallel request handling, NVIDIA DGX Spark and Intel B-series hardware, alongside a link to the Strata v0.2.9 release.

    UnslothAI (X) · 🔥 0
  16. DeepSeek-V4.1-Flash benchmarked on dual DGX Spark hardware

    Nick Mermiges of PLI Labs benchmarked DeepSeek-V4.1-Flash-1017 at 2.75 bpw with EXL3 and vLLM across two NVIDIA DGX Spark systems. An EPYC system with two RTX 3090s handled Engram tables and speculative drafting. In the author's tests, reported as medians of three runs, prefill reached 2,618 tokens per second with a 256K prompt, while structured JSON output reached 322 tokens per second across four streams. The report published the code, launch scripts, benchmark tool and raw results, while noting lower prose throughput and slower decoding than some cited deployments. Planned 1M-token context, llama-benchy, BFCL and head-to-head KLD tests were not yet available, and the prefix-cache code was still pending publication.

    r/LocalLLaMA · 🔥 0
  17. llama.cpp PR fuses MoE matrix multiplications and GLU in MMQ

    A llama.cpp pull request proposes fusing MoE gate/up matrix multiplications and GLU in the CUDA MMQ path. The PR reports prompt-processing gains of 5.7%–17.2% across DGX Spark and RTX 5090 systems using several Qwen MoE model and quantization configurations. The supplied report does not establish that the change has been merged or released, and the benchmark figures have not been independently verified.

    r/LocalLLaMA · 🔥 0
  18. NVIDIA Boosts Ling-3.0-flash MoE Inference on DGX Spark

    An NVIDIA Technical Blog post details three optimizations for Ling-3.0-flash on NVIDIA DGX Spark: the Humming MXFP4 MoE backend, online FP8 quantization of the LM head, and NEXTN multi-token-prediction speculative decoding. Profiling showed batch-size-1 decoding was memory-bound, with weight reads dominating, and the Mixture-of-Experts computation plus the output-layer projection standing out as the costliest operations. On a synthetic workload the baseline ran at 27.71 ms TPOT and 36.09 tok/s, while NEXTN MTP reached 9.72 ms and 102.88 tok/s; across the full 1,319-question GSM8K evaluation the three optimizations together raised decode throughput 42.5% and cut mean end-to-end latency 24.5%, with no statistically detectable accuracy change (96.89% to 96.82%). The post also warns that combining online FP8 LM-head quantization with MTP requires the draft model to share the entire LM-head module, otherwise the framework silently falls back to a configuration slower than baseline.

    NVIDIA Technical Blog · 🔥 0
  19. ASUS GX10 Tests Show No Thermal Throttling at 82°C

    A r/LocalLLaMA author tested DeepSeek V4.1-Flash on four ASUS GX10 systems across six cooling arrangements while recording temperatures, clocks, power and throughput. The highest observed temperature was 82°C, with no thermal throttling behavior and a maximum clock reduction of about 3%, which the author attributed to power-leakage management. The author found no meaningful performance difference between the coolest and hottest runs, though this was a single community report without independent corroboration.

    r/LocalLLaMA · 🔥 0
  20. llama.cpp CUDA PR fuses FFN operations for reported speed gains

    llama.cpp pull request #29948 proposes fusing CUDA FFN gate/up matrix multiplications and GLU in MMQ with interleaved gate/up rows. Its llama-bench results report gains of 1.9%–10.7% over master for listed quantizations of Qwen3.8-27B, Qwen3.6-27B, and Llama-3.1-8B on NVIDIA DGX Spark and RTX 5090. Tests used full GPU offload, Flash Attention, a 16,384-token prompt, and five repetitions.

    r/LocalLLaMA · 🔥 0
  21. ASUS sponsors edge AI hackathon with Ascent GX10 and PE3000N

    TechNews reports that the 2026 Agentic AI on the Edge Hackathon, sponsored by ASUS, took place October 21–22 at the Bottle Cap Factory in Nangang, Taipei; the same report also describes three days of development, an inconsistency it does not resolve. The report says 15 teams proposed solutions for smart manufacturing, automated services and smart retail. ASUS supplied its Ascent GX10 desktop AI supercomputer, described as based on the NVIDIA DGX Spark architecture with a GB10 Grace Blackwell Superchip, and its PE3000N rugged edge system built on an NVIDIA Jetson Thor module. According to ASUS, the GX10 supports NVIDIA's NemoClaw open agent blueprint for sandboxed, access-controlled on-device inference, while the PE3000N supports hardware sensor fusion and NVIDIA Isaac and Metropolis software stacks.

    科技新报 · 🔥 0
  22. Sipeed unveils 128GB MaixStation local-AI workstation

    Sipeed announced the MaixStation, a local-AI workstation built around Axera’s 16-core AX8860P and offered with 128GB of LPDDR5X across a 256-bit bus. Sipeed claims 273 GB/s of memory bandwidth, a 256-TOPS native-FP4 NPU, and an expected price of about $3,999 for the 128GB model. It says published Qwen tests outperform the Nvidia DGX Spark by roughly 10%, while another claimed run reports 25% faster prefill and 30% faster decode; these vendor results have not been independently validated, and the NPU toolchain and Kickstarter shipping remain pending.

    Tom’s Hardware · 🔥 0
  23. Axera launches AX8860 AI chip, claiming faster Qwen inference than DGX Spark

    Axera officially launched its AX8860 series AI chip at the 2026 China International Industry Fair, positioning it as a compute base for running large models at the edge and on-device. The 6nm chip pairs a 16-core Arm Cortex-A55 CPU with a self-developed NPU rated at 256 TOPS mixed precision (native FP4, no sparsity), supports up to 128GB of LPDDR5X memory with 273 GB/s bandwidth on a 256-bit bus, and offers PCIe 5.0 connectivity. Product forms include a 40W module, a single-slot Gen5x4 PCIe card, a single-slot four-chip card, and planned Mini PC and pocket PC designs; clustering over a 256 Gbps interface is claimed at 512 TOPS for two chips and 1024 TOPS for four at about 80% scaling efficiency. Axera and Sipeed claim the AX8860 runs Qwen 27B with 25% faster prefill and 30% faster decode than NVIDIA's DGX Spark, at system pricing "close to half" of DGX Spark, though no independent testing of these performance or price figures was provided. The chip supports vLLM, SGLang and PyTorch, ONNX and Hugging Face model formats, and an OpenAI-compatible API.

    Wccftech · 🔥 0
  24. Unsloth trains a decision model on Qwen3.5-2B in about 2 minutes on one DGX Spark

    Unsloth shared an Ivan Fioravanti demo showing a "decision model" trained in roughly two minutes on a single NVIDIA DGX Spark using Unsloth, with Qwen3.5-2B as the base model. The post points to Unsloth's documentation page on training your own decision model with Unsloth. The source gives no details on the model's intended use, evaluation results, or training data.

    UnslothAI (X) · 🔥 0
  25. Long-WAM scales world-action model context for real-time robot control

    Long-WAM is a model-system framework for scaling the context of causal world-action models under real-time robot-control constraints; its authors report that longer histories only pay off when the video foundation is pretrained autoregressively. On RoboCasa GR-1, raising context from 0.0 to 19.2 seconds lifted success from 63.3% to 78.7%, while a bidirectionally pretrained initialization showed no net gain, and robot-domain autoregressive pretraining further raised peak success on GR-1 and LIBERO-Long. The paper also reports deployment on RTX 5090, DGX Spark and Jetson AGX Thor, with each action chunk including future-video latent prediction taking 107.4 ms on RTX 5090, plus real-time long-horizon manipulation on Unitree G1 and YAM reaching 95% success on dynamic cup stacking, where it says Pi0.5 and Fast-WAM succeeded in none of 20 trials.

    Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my Nvidia DGX Spark experienceAsk about Nvidia DGX Spark

Nobody has shared their experience with Nvidia DGX Spark yet.