AWS Machine Learning Blog details AssemblyAI’s production speech-to-text inference architecture, combining Amazon ECS, EC2 Spot and On-Demand capacity across multiple NVIDIA GPU families, and Amazon SQS retries. The design supports regional data-residency requirements and absorbs Spot interruptions; AssemblyAI reports that it reduced inference-compute costs by 70% compared with On-Demand pricing.
A Wall Street Journal profile, cited by Wccftech and TechSpot, says NVIDIA used its balance sheet to finance AI startups and data-center expansion so they could absorb shipments of TSMC silicon that the chipmaker had ordered in excess. The coverage says interim CEO Colette Kress reduced NVIDIA’s “circular financing” commitments to smaller cloud providers and AI firms including OpenAI and Anthropic. It also reports that NVIDIA sought to reduce upcoming chip orders and characterizes the financing as creating artificial demand to avoid a supply glut and lower GPU prices.
A New York Times report says Nvidia held stakes worth $48 billion in 229 private companies at the end of July, including OpenAI and Anthropic. It also says Nvidia offered $165 billion in cloud backstops. Some investors and founders said they had lost an ally in Jensen Huang.
NVIDIA says cuda-bindings 13.3.0 introduces cuda.bindings.cudla, a Python layer over the cuDLA C++ API for managing and orchestrating inference on NVIDIA Deep Learning Accelerator hardware. On Jetson AGX Orin, the bindings support hybrid workflows that coordinate GPU preprocessing and postprocessing with DLA inference through CUDA streams. The documented image-classification example covers loading a compiled network, allocating buffers, submitting work, synchronization, and retrieving output, while standalone mode remains unsupported in this release.
Gary Marcus argues that generative AI’s finances may be unraveling, citing lower prices, heavier competition, elusive profits and high training and inference costs. He says Nvidia, Oracle and CoreWeave have lost momentum, while Anthropic’s perceived valuation has declined, and interprets the figures as signs of a bubble popping, though he acknowledges his judgment could be wrong. Marcus also notes that technical improvement is possible but may not be fast enough to justify trillions in investment. He argues that many AI companies depend on Nvidia’s financing and could face trouble if that support changes.
Where’s Your Ed At alleges that Megaspeed and related entities form a multinational GPU-smuggling operation backed by NVIDIA. Citing Culper Research and The Wall Street Journal, the commentary says an alleged spy operated a purchasing front for the Chinese to buy GPUs. Culper estimated that the operation might account for more than 20% of NVIDIA’s fiscal 2026 revenue, or over $43 billion. The report says the situation was developing rapidly, and the allegations were not independently verified in the supplied material.
Cornelis has launched CN6000, a family of 800G network cards and switches designed for AI clusters and supercomputers, positioning the products as an alternative to Nvidia’s InfiniBand. The main card uses Intel’s Omni-Path technology and supports chips from AMD, Intel, Nvidia and Qualcomm, while Dell, Lenovo and Supermicro plan supporting systems. Cornelis says its card handles 1.6 billion messages per second and is 21% faster for small-message transfers, based on its own tests; partner systems are expected in early 2027.
A Bloomberg report says Nvidia CEO Jensen Huang stepped down after revelations of an extramarital relationship with a company vice president, which violated the company’s code of conduct. The report says Huang structured the company around himself, with no chairman, second-in-command or public succession plan, leaving his successor to manage an organization built around a leader who is no longer there. Bloomberg Opinion columnist Beth Kowitt discusses the case as an example of the “key-man” CEO issue.
The New York Times reported that Nvidia’s $500 billion lending consortium is in flux, with at least one lender potentially exiting following Jensen Huang’s ouster. Wall Street figures fear Huang’s departure could slow Nvidia’s AI dealmaking, a concern that has not been established as an outcome.
Ai2, with researchers from Carnegie Mellon, NVIDIA, and Johns Hopkins, released XYBench, a benchmark containing 8,115 questions about programming, cooking, home repair, and other practical tasks. It evaluates whether assistants identify misconceptions, address the user’s underlying goal, and prioritize effective solutions over the requested approach. Ai2 reports that Claude Sonnet 4.6, GPT-5, Gemini 3.1 Pro, Qwen3.5-9B, and DeepSeek-V4 Pro often retained users’ mistaken approaches and that XYBench received the Best Resource Paper Award at EMNLP 2026.
NVIDIA Technical Blog shows how to serve the quantized 753-billion-parameter GLM-5.3 locally with vLLM across two connected NVIDIA DGX Stations. Tensor parallelism splits weights and computation between the GB300 GPUs, keeping the roughly 464 GB checkpoint in GPU memory behind one OpenAI-compatible API. In NVIDIA’s SPEED-Bench test, throughput peaked at 607.8 tokens per second at concurrency 16 before falling to 385.0 tokens per second at concurrency 32.
The Information argues that Jensen Huang’s resignation does not amount to the end of the AI boom, despite reactions suggesting otherwise on X. The commentary credits NVIDIA’s role in training AI models but says the boom also propelled Huang to prominence, framing the period after his departure around the broader momentum of AI rather than one executive.
Michelle Weaver, head of US thematic research at Morgan Stanley, said on Bloomberg Surveillance that AI fundamentals remain strong despite recent market volatility and Nvidia-related fallout. She cited continuing compute demand and gains from AI adoption as positive signals, though the report provided no supporting metrics.
According to a report from IT之家, Apple rose 1.49% to $360.18 per share during U.S. trading, reaching a record high and putting its market capitalization at $5.24 trillion. Nvidia fell 1.93% to a reported $3.93 trillion market capitalization, leaving Apple more than $1.3 trillion ahead. The report also said Nvidia's board had announced Jensen Huang's resignation as president, CEO and board member. These market figures were not independently confirmed in the supplied evidence.
Check Point Forensics investigators reported that the four leading Chinese AI labs built their newest models on NVIDIA's advanced Blackwell chips, according to a Reddit r/OpenAI post summarizing the investigation. The post says the chips are barred from export to China, but the supplied report provides no chip-level verification, named labs, or laboratory confirmation.
The New York Times reported that Jensen Huang’s biographer, Stephen Witt, said Nvidia had a culture of omertà and deference toward Huang that enabled him to “be his worst self.” The report also said Huang has helped make the age of artificial intelligence possible.
cnBeta reports that Jensen Huang resigned as NVIDIA’s president, CEO and director with immediate effect, while CFO Colette Kress was named interim CEO and the board began seeking a permanent successor, including internal and external candidates. After Naval Ravikant argued on X that founders cannot simply be replaced, Elon Musk replied, “True words.” The report also notes that Musk had earlier said hiring Huang would be “an honor.”
TSMC reportedly plans to establish a $500 million venture fund focused on chip startups, suppliers, and other upstream partners. The proposed fund would extend beyond direct foundry customers and is larger than the $200 million emerging-enterprise fund TSMC created in 2021; TSMC may also expand it if returns warrant.
The Financial Times reported that Jensen Huang’s rapid downfall exposed Nvidia’s internal politics. An unnamed source alleged that Huang ran the company as a “feudal system,” with his daughter and son-in-law holding powerful positions. After 33 years building Nvidia into the world’s most valuable company, Huang’s career collapsed in less than two weeks.
Dyania Health’s Synapsis AI, running on NVIDIA-accelerated servers inside Cleveland Clinic’s network, reviewed records from more than 7,800 aortic valve replacement patients treated between 2005 and 2021, according to NVIDIA and The Next Web. The system connected notes, reports and lab results, answered 88 questions per patient, and supported a model estimating replacement-valve failure risk at three, five and ten years after surgery. Doctors reviewed the evidence and made the clinical decisions, while Dyania said outside validation remains needed and the study did not demonstrate improved patient outcomes.
Israeli investors say Nvidia's leadership transition may create an opening for AI-chip and inference-software competitors, though TechCrunch AI reports that stronger economics—not the change alone—will determine whether they win business. Nvidia employs about 6,000 people in Israel, where it operates a major R&D facility following its $6.9 billion Mellanox acquisition and has planned a multibillion-dollar campus. Colette Kress is serving as interim CEO while the permanent succession remains tentative.
After Jensen Huang resigned, CFO Colette Kress became interim CEO, leaving Nvidia’s 10-member board to select a permanent successor. Governance and executive-search experts criticized the board for inadequate succession planning, while Bloomberg reported that it is working with an external firm to identify candidates. In James Drury’s 2026 ranking of about 650 large public companies, Nvidia’s board placed 609th; the report said the assessment considered directors’ experience, achievements, and relevance. Nvidia did not immediately respond to a request for comment.
The Wall Street Journal reports that Jensen Huang interrupted Colette Kress’s presentation at an August 2026 finance meeting, calling her “a deer in the headlights” and “a reporting CFO.” The report also says that interim CEO Colette Kress had questioned some of Huang’s dealmaking.
CNBC's Arjun Kharpal, who interviewed Nvidia CEO Jensen Huang a few weeks ago at GTC Berlin, says three weeks later the company is grappling with "a world without him." In the original report, he characterizes the change as everything having come "crashing down" for the popular CEO. The supplied report does not describe specific operational, strategic or financial developments during that period, and the "crashing down" language is the reporter's own framing rather than a set of documented incidents.
CNBC Technology compares Nvidia's move away from founder-led leadership with transitions at Apple, Alphabet and Uber, saying Nvidia's case will be harder. Experts cited by CNBC Technology argue that Jensen Huang's central role could make replacing him difficult.
Richard Windsor says Nvidia’s immediate damage from Jensen Huang’s departure is reputational, while its products, contracts, and financial outlook remain intact. He argues that Huang’s successor must preserve the rapid product-development cycle that underpinned Nvidia’s dominance, warning that a slowdown could cost the company market share and margins.
The Wall Street Journal, as relayed by TechCrunch, reported that Jensen Huang called interim CEO and CFO Colette Kress “a deer in the headlights” during a finance-team meeting about Nvidia’s data-center guarantees. The report said Huang also questioned Kress’s ability to help steer strategy and decision-making, while Kress had pressed for clearer deal selection, guarantee valuation and return calculations. Nvidia is searching for a permanent CEO.
Silicon Valley supporters said Huang should not have given up control to Nvidia's board. They characterized his departure as a governance lesson for founders to retain control of their companies.
A supplied report says Nvidia is facing its biggest crisis in its 33-year history, with founder Jensen Huang resigning as CEO. It presents a retrospective on Huang’s rise and fall and frames the episode as casting doubt on Nvidia’s AI dominance.
A supplied report says Jensen Huang’s Nvidia controversy is fueling calls for tighter restrictions on chip sales to China. The report also describes Huang as a mediating voice between the two AI superpowers.
What problem it solves
AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation.
Key features
Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…
What problem it solves
Serving large language models requires efficient memory management, flexible model execution, and practical integration with existing models and APIs. vLLM addresses these needs with inference and serving capabilities spanning batching, caching, quantization, distributed execution, and multiple hardware platforms.
Key features
Efficient memory and serving — vLLM manages atte…
What problem it solves
AI agents need product-specific instructions to use NVIDIA software reliably across physical AI, robotics, simulation, CUDA-X libraries, RAG, and platform workflows. The catalog centralizes these skills while keeping them maintained in their respective product repositories and synchronized through an automated pipeline.
Key features
Agent-discoverable skill catalog — The NVI…
What problem it solves
AI agent skills need to be checked for quality, security, duplication, and their actual effect on agent behavior. Static checks alone cannot establish whether guidance improves task results, so evaluation must also support live comparison with and without a skill.
Key features
Three-tier evaluation pipeline — Independent tiers validate skill safety and structure, detect over…
What problem it solves
Running large language and vision-language models can require substantial setup and may depend on the available hardware. The project aims to make inference accessible across a wide range of local and cloud hardware with minimal setup.
Key features
Minimal-setup inference — The project provides installation options for common platforms, including scripts, Docker, pre-built b…
What problem it solves
Serving language models requires reading checkpoints, tokenizing requests, and running accelerated kernels while managing a local model server. TensorFold addresses these requirements with a native binary that can run on Apple Silicon and NVIDIA GPUs without requiring Python or MLX for serving.
Key features
Native Metal and CUDA inference — The Zig-based engine executes mode…
What problem it solves
Interactive multimodal and speech systems often require generation to span heterogeneous stages with different compute patterns, dependency structures, and resource needs. Serving these pipelines requires coordinated stage lifecycles, inter-stage transport, model integrations, and a unified API surface.
Key features
Coordinated multi-stage runtime — Models generation as coor…
What problem it solves
Data analysis workflows often require expressive query composition, flexible execution models, and interoperability with columnar data. Polars addresses these needs by allowing the DataFrame API and SQL to share the same optimizer and engine, with support for large workloads and custom extensions.
Key features
Unified DataFrame and SQL Queries — Queries can be written with e…
What problem it solves
Running frontier-scale open-weight models locally requires an inference platform that can make efficient use of the heterogeneous hardware available on a personal device. The project addresses this by treating GPUs, CPUs, host memory, and interconnects as a unified, elastic inference platform.
Key features
Edge-native MoE runtime — The runtime provides MoE serving with bandw…
What problem it solves
Autonomous AI agents often need to read files, install packages, call APIs, and use credentials, but unrestricted access can expose host data, secrets, and networks. OpenShell provides these capabilities within an isolated runtime where declared policies constrain agent access.
Key features
Kernel-level runtime enforcement — Agents run in isolated sandboxes where kernel cont…
What problem it solves
AI agent skills execute with implicit trust and often receive minimal vetting before installation. SkillSpector helps users assess whether a skill contains vulnerabilities, malicious patterns, or other security risks before installing it.
Key features
Multi-format scanning — Scan agent skills supplied as Git repositories, URLs, zip files, directories, or individual files.
So…
What problem it solves
Mosaics obscure portions of videos and images, making it difficult to view the affected content without changing the rest of the picture. Users need a restoration workflow that can identify selected mosaic regions and process them with GPU-accelerated video handling.
Key features
Targeted mosaic restoration — Detects mosaics in videos and restores them while leaving the rest…
What problem it solves
Deep learning models often need to be adapted for efficient deployment across different inference frameworks. Model Optimizer addresses this by providing a unified set of optimization techniques and export workflows for quantized checkpoints.
Key features
Post-training quantization — Compress models with quantization techniques available for Hugging Face, Megatron-Bridge, Di…
What problem it solves
Platform teams need to create and operate isolated Kubernetes clusters for customers on infrastructure they supply and control. They need a management plane that can provision GPU machines, manage cluster lifecycle operations, and establish node identity before issuing join credentials.
Key features
Independent workload clusters — Create workload clusters through the NVKE AP…
What problem it solves
Running AI models locally can require integrating multiple inference engines, model formats, hardware accelerators, and API surfaces. LocalAI addresses this with a small core, on-demand backends, and compatible APIs that work across supported hardware without requiring a GPU.
Key features
Composable inference backends — Backends are packaged separately and pulled only when a…
What problem it solves
LLM and Visual Gen inference requires specialized kernels, efficient runtime orchestration, and flexible deployment across NVIDIA GPU configurations. Developers also need a modular framework that supports customization while integrating with established inference tooling.
Key features
Optimized inference kernels — Custom kernels accelerate common inference operations, includ…
What problem it solves
Rust developers need host-side access to the CUDA runtime and tools for expressing GPU kernels while preserving Rust's ownership and borrowing rules. The platform provides separate programming models for workloads that require direct thread-level control and workloads naturally expressed through tensor operations.
Key features
Shared CUDA runtime — Host-side crates provide d…
What problem it solves
Agents can retrieve documents and query databases, but unreliable results undermine agentic analytics. Teams need a context layer that records where data lives, what its definitions mean, whether it is usable, how it should be queried, its provenance, and related concepts.
Key features
Enterprise ontology generation — Generate semantic ontologies from database metadata, infe…