Nvidia H100
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 16
- Tiangai 300 Claims H200 Parity, but Outside Test Shows 5% Lead
Iluvatar CoreX says its Tiangai 300 AI GPU matched or exceeded NVIDIA's H200 in company-run demonstrations using text-to-image and text-to-video workloads. However, the only outside result cited by Wccftech, a Shanghai INESA test, found 1.05 times the H200's throughput, a modest 5% advantage, while the reported training comparison was against the older H100 rather than the H200.
Wccftech · 🔥 5 - Anthropic expands Claude drug discovery with six partnerships
Anthropic announced research partnerships with six drug-development organizations, began its own drug-discovery work and acquired Mithril Medicine, whose founder used Claude to coordinate 11 external laboratories and two rare-disease programs. In disclosed partner work, Claude helped design molecules, analyze laboratory data and review manufacturing records, including an experiment at BigHat Biosciences that tested about 1,010 variants in roughly 10 weeks. Anthropic said most of the research remains early and preclinical, with little or no human testing yet.
Hacker News 首页(100+ 分) · 🔥 0 - AI Compute Rental Market Shows a Sharp Supply Mismatch
A TMTPost analysis reports that H100 median rental prices fell from more than $7 per hour in early 2024 to about $3.4 by mid-2026, while some lower-end compute-node rents dropped from 30,000 yuan to below 6,000 yuan a month. It cites industry estimates that China’s intelligent-computing centers average about 30% utilization, versus continued shortages of newer Blackwell B200 cards priced above $8 per hour. The report attributes the divergence to older GPUs losing rental demand as major customers build their own clusters and model API prices fall, while supply remains uneven across locations and generations.
钛媒体 · 🔥 0 - KS3 benchmark reports faster convergence than MLP at similar GPU latency
Independent researcher u/1ncehost compared the third version of K-Splanifolds, KS3, with multilayer perceptrons and earlier KS versions while fitting a 4D Mandelbulb through gradient descent on random samples. The author reports that KS3 converged faster and had nearly identical GPU latency to an MLP. The author also says KS3 ranged from considerably faster convergence than an MLP in areas including noise removal, geometric fitting and financial prediction to roughly equal performance for large language models. These are self-reported results that have not been independently verified.
r/MachineLearning · 🔥 0 - AI Demand Raises NVIDIA GPU Rental Prices
Wccftech, citing Ornn Data statistics reported by a16z, says NVIDIA GPU rental prices increased from January 1, 2026. The H200 recorded the largest rise at 143%, followed by the B200 at 111%, RTX PRO 6000 at 73%, H100 at 54%, and A100 at 9%. The report also says the Tesla V100 and other older NVIDIA GPUs have gained popularity during the AI boom.
Wccftech · 🔥 0 - SGLang adds elastic expert-parallel scaling for live MoE deployments
SGLang now supports runtime scale-up for MoE inference deployments, adding GPU ranks in fine-grained increments without replacing the running deployment or restarting it. LMSYS Blog reported an illustrative expansion from 20 to 24 GPUs and said project-run tests on eight H100 GPUs with DeepSeek-V3-Lite FP8 reached the first completed request 5.3 to 8.2 times faster than restarting, though the measurements were not independently corroborated. Automatic rollback is not yet supported after joining ranks enter Mooncake WORLD, while scale-down and recovery after scale-up remain future work.
LMSYS Blog · 🔥 0 - FlashMask-3 targets masked distributed attention on Hopper GPUs
A FlashMask-3 paper introduces mask-aware distributed attention for long-context model training, combining a Hopper kernel built on FlashAttention-3 with zero-communication mask localization and compute-communication overlap. Its authors report higher single-GPU TFLOPs, distributed throughput, and end-to-end training throughput than the cited baselines, though the results have not been independently verified here.
r/LocalLLaMA · 🔥 0 - CME compute futures delayed as GPU rental becomes a tradable contract
Economic Observer, republished by 36Kr, reports that two compute futures designed by CME Group and Silicon Data on Nvidia H100 and B200 rental prices were originally slated to list on NYMEX on Oct 5 but were delayed after CFTC flagged the product as novel or complex, extending the review to a Nov 9 completion date, with CME marking the initial listing date as to be announced. Meanwhile ICE and Ornn began publishing Ornn Compute Index reference data, Kalshi already offers GPU compute price prediction contracts and forward curves, and Architect and Nodal Exchange are moving on similar products. Interviews with Chinese compute rental firms, cloud vendors, model companies and AIDC park operators found no mature public compute price index domestically, so firms rely on long-term contracts, prepayments and reserved capacity, while Nanhua Futures unit Henghua International signed a memorandum with Silicon Data.
36氪 人工智能 · 🔥 0 - NPCTalk brings unscripted voice dialogue to GTA 5
Universal Modder's open-source NPCTalk toolkit lets players speak with GTA 5 characters, which dynamically generate context-sensitive replies in AI-cloned voices and can perform animations or respond to spoken commands. IT之家 reports that NVIDIA Nemotron ASR handles transcription, Qwen 3.8 27B generates dialogue through Cerebras, Fish Audio Drama 3 synthesizes cloned voices, and TypeSafe Jev controls NPC actions. The project has been demonstrated only in GTA 5 Legacy single-player mode, requires separately integrated cloud and GPU infrastructure, and has not been confirmed as an immediately available one-click mod.
IT之家 AI · 🔥 0 - Databricks explains how its AI research team uses AI Runtime for GPU training
Databricks published a blog post describing how its AI Research team uses Databricks AI Runtime (AIR) to run the training and evaluation work behind models for products such as AI Functions, Genie and Smart Routing. The team says AIR provides resiliency for long-running jobs, fast job launches through its CLI and custom Docker containers, automatic MLflow experiment tracking, and governed data access via Unity Catalog, and that it supports an agent-driven "autoresearch" loop. Databricks says its models range from a few billion to nearly a trillion parameters and are trained on NVIDIA H100 or B300 GPUs, with the largest runs requiring hundreds of GPUs over days or weeks.
Databricks Blog · 🔥 0 - Modal explores mixed-precision, mixed-accelerator RL samplers
Modal published a technical post exploring whether large-model reinforcement learning can use samplers at different precisions and on different accelerators while keeping training stable. It says sampling already consumes 80–85% of GPUs in large RL runs, and reports fully asynchronous training of Qwen3.6-35B-A3B on agentic coding tasks using off-policy correction and autoscaling serverless GPUs. Samplers spanned six accelerator types — B200, B300, H100, H200, A100 and RTX PRO 6000 — feeding a BF16 trainer on B200, with evaluation on SWE-bench Pro V2 and its HARD-51 subset.
Modal Blog · 🔥 0 - Anthropic: small models may soon self-replicate on IoT devices
Anthropic researchers William Zhou and Daniel Freeman said their experiments suggest small AI models may be months away from self-replicating on commercial IoT devices such as smart ovens and off-brand Android TV boxes. In self-reported evaluations, a 9B model got inference running on 8 of 9 hardware types, and GLM-5.2 completed end-to-end replication in a simplified eight-node test; coverage noted that test used unauthenticated ADB ports and a pre-seeded initial node. The Verge reported the researchers have not demonstrated a full rogue replicator and described their end-of-year capability projection as a prediction beyond the experiments.
Hacker News · AI(100+ 分) · 🔥 0 - Flo Health fine-tunes open models with Databricks to boost medical safety and usefulness
A Databricks blog post describes how Flo Health, a women's health app with 81 million monthly active users, built safer and more useful custom open models on Databricks AI Runtime. Flo first created an evaluation system of 26 AI judges (12 medical-safety, 6 micro-behavior, 8 usefulness) to turn medical standards into a training signal, generated more than 15,000 privacy-first synthetic questions, then ran supervised fine-tuning and DPO on 32 NVIDIA H100 GPUs using LLM Foundry and Compose-RL with MLflow tracking. Flo reports medical safety rising from 34% to about 61%, usefulness from 42% to 76%, and the share of responses meeting both from 16% to 47%, and estimates tailored models can cut inference costs by an order of magnitude versus frontier APIs; it plans to apply the pipeline to newer open-weight models such as Gemma, Qwen and Kimi.
Databricks Blog · 🔥 0 - Biren plans HK$4.02B placement, total raise hits HK$17.26B
Biren Technology announced on Oct. 8 a placement of 130 million H shares at HK$31.8 apiece to no fewer than six placees, about 4.76% of post-issue share capital, for estimated net proceeds of roughly HK$4.02 billion. The price was a 9.76% discount to the previous close, and the stock fell 11.85% to HK$30.36 that day, closing at HK$31 on Oct. 9 for a market value of about HK$80.6 billion. Including a roughly HK$6.204 billion net raise at its January listing and a HK$7.038 billion placement in July, Biren has raised about HK$17.261 billion (about RMB 14.7 billion) since listing, the most among listed Chinese GPU makers. The company says about 70% of this round goes to strategic supply-chain procurement, production preparation and commercialization for its next-generation flagship BR20X, which it benchmarks against NVIDIA's H200 and expects to enter post-tape-out validation and customer testing in Q4, with large-scale deployment in 2027.
钛媒体 · 🔥 0 - Microsoft open-sources TRELLIS.2, a 4B image-to-3D model with PBR output
Microsoft has published TRELLIS.2 on GitHub, a 4-billion-parameter image-to-3D generative model built on a "field-free" sparse voxel representation called O-Voxel, which the repo says handles open surfaces, non-manifold geometry and internal enclosed structures and predicts PBR surface attributes such as base color, roughness, metallic and opacity. The project reports generation times on an NVIDIA H100 of about 3 seconds at 512³ (2s shape + 1s material), roughly 17 seconds at 1024³ and about 60 seconds at 1536³, plus under 10 seconds on a single CPU to convert a textured mesh to O-Voxel and under 100ms on CUDA for the reverse. Code, data tooling and training scripts are provided and the TRELLIS.2-4B weights are on Hugging Face, but the code is Linux-only and needs an NVIDIA GPU with at least 24GB of memory (verified on A100 and H100, CUDA 12.4).
GitHub Trending · Python · 🔥 0 - Ai2 replaces priority scheduler with fair-share GPU budgets and time-slicing contracts
Ai2's AI Infrastructure team says it replaced its priority-based cluster scheduler with GPU time budgets, hierarchical fair-share allocation and a time-slicing contract for dividing scarce compute among research projects. Ai2 manages thousands of NVIDIA H100, B200 and B300 GPUs in clusters ranging from 88 to 1024 GPUs, serving about 150 internal researchers, with submitted workloads requesting 2–3x the available capacity at any time. The post says the old setup led to GPU "squatting," priority inflation and manual negotiations over shutting down jobs, and that the new contract asks workloads to declare a minimum runtime during which they cannot be preempted before being requeued. Ai2 also reports a 74% reduction in repairs requiring human intervention, a self-reported figure, and says it is investigating whether capacity fragmentation could increase queue waits for the largest workloads.
Ai2 Blog · 🔥 0
Experience and discussion from the community
Share my Nvidia H100 experienceAsk about Nvidia H100
Nobody has shared their experience with Nvidia H100 yet.