Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

NVIDIA

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1493

  1. NVIDIA releases four open-weight Cosmos 3 Nano checkpoints

    Hugging Face, reporting NVIDIA's announcement, says the Cosmos 3 family gained four downloadable, open-weight checkpoints with 16 billion trainable parameters each. The models target multi-view driving-data generation, synchronized camera and LiDAR streaming, simulator-to-video conversion, and video prediction from bimanual robot or camera actions; NVIDIA's quality, realism, and synchronization claims have not been independently evaluated in the report.

    Hugging Face · 🔥 0
  2. AI Costs Fall as Data Center Backlash Looms

    AI inference costs have fallen so far this year despite rising server-rental prices, with Artificial Analysis finding that GPT-6.1 Sol costs about one-fifth as much per task as GPT-6 Astra at a high reasoning setting. Anthropic has promoted similar efficiency gains in its latest models, though that claim comes from the vendor, while buying or renting Nvidia hardware has become substantially more expensive. The Information reports that post-election restrictions on data-center expansion could raise operating costs, but the scale and timing of any effect remain uncertain.

    The Information · 🔥 0
  3. About 600,000 Nvidia H200 Chips Reportedly Stored in Hong Kong

    Reuters cited sources saying about 600,000 Nvidia H200 AI chips are stored in Hong Kong, awaiting shipment to mainland China. The sources said Beijing is withholding approval for large-scale imports. The supplied report provides no official statement or independent confirmation.

    Techmeme · 🔥 0
  4. TPUv7 Ironwood posts first long-context AgentX results

    SemiAnalysis published the first official long-context, multi-turn AgentX results for Google’s TPUv7 Ironwood across Muse Spark Open, GLM-5.2, Qwen3.5, and Kimi K3. The report says Ironwood was competitive or achieved the best performance-per-dollar result in these submissions, including 1.2x to 2.7x the tokens per dollar of NVIDIA B200, B300, and AMD MI355X for GLM-5.2 at FP8. Results varied by precision and workload: NVIDIA’s FP4 offerings led some comparisons, while Rubin figures remain preview submissions that SemiAnalysis could not independently reproduce.

    SemiAnalysis · 🔥 0
  5. Reddit user reports Nemotron 3.5 Bolt E4B at 27.7 tok/s on Jetson Orin Nano Super

    A Reddit user reported running NVIDIA’s Nemotron 3.5 Bolt E4B on a Jetson Orin Nano Super at 27.7 tokens per second, compared with a stated 15 tok/s result from the official llama.cpp release. The poster also offered hosted access to the model and a local TensorRT engine with int4 quantization. The performance figures, comparison and claim that the model can program games come from a single community report without independent corroboration.

    r/LocalLLaMA · 🔥 0
  6. NVIDIA details DSX OS tools for operating GPU Kubernetes clusters

    NVIDIA describes DSX OS, the open-source software layer within its DSX AI Factory Platform, as a set of tools for configuring, certifying, and maintaining accelerated Kubernetes infrastructure. AICR provides version-locked configuration recipes, NVCRE tests whether clusters are ready for production workloads, and NVSentinel monitors health and can support remediation and revalidation. NVIDIA says all three projects are licensed under Apache 2.0 and welcome external contributions.

    NVIDIA Technical Blog · 🔥 0
  7. Colony Sees AI Investment Continuing Despite Tech Selloff

    Bloomberg Technology reports that Forrester Research founder and CEO George Colony expects AI investment to continue despite a technology selloff that pressured chipmakers and Nvidia. He said the AI boom may be entering a new phase in which custom chips could challenge Nvidia’s dominance and more industry value may shift toward software.

    Bloomberg Technology · 🔥 0
  8. OpenShell Brings Kubernetes-Level Controls to AI Agents

    SiliconANGLE reports that Red Hat, Nvidia and the broader community are developing OpenShell, an early-stage open-source secure runtime for AI agents in Kubernetes environments. According to Red Hat interviewees, the runtime applies access and execution boundaries in the operating environment and includes isolated sandboxes that limit the files agents can reach; these security capabilities have not been independently verified in the supplied report.

    SiliconANGLE AI · 🔥 0
  9. NVIDIA Links Full-Stack Codesign to Higher AI Memory Efficiency

    NVIDIA published two technical posts on November 5 describing a “full-stack codesign” approach that designs GPUs, CPUs, networking, storage and software together to increase useful output per byte of memory during AI inference. The company says HBM is the fastest, most expensive and most contested tier, where model weights and KV cache compete, while CPU memory, local SSDs and shared storage trade speed for capacity and lower cost per bit. The approach includes NVFP4 for weights and KV cache, weight distribution across up to 72 GPUs in NVL72 systems, large-capacity LPDDR in the Vera CPU, Dynamo KV-cache offloading and reuse, CMX context memory storage, and keeping RAG indexes outside HBM. Citing its own SemiAnalysis AgentX results, NVIDIA says Vera Rubin NVL72 delivers up to 30 times the throughput per megawatt of GB300 NVL72 at 160 tokens per second per user. A separate comparison says Vera Rubin delivers up to 30 times the throughput per dollar at 125 tokens per second per user, while HBM capacity per GPU increased about 3% from Blackwell Ultra. These figures have not been independently verified in the supplied reports.

    NVIDIA Blog · 🔥 0
  10. Beginner guide and open-source script for local LLM deployment

    A beginner-oriented article presents a workflow for running a quantized LLM locally on Windows 11 with Python 3.12, llama-cpp-python, an RTX 4060 with 8 GB of VRAM, and the Qwen2.5 1.5B Instruct GGUF model. It describes environment checks, model downloading and setup, path and parameter configuration, VRAM estimation, error handling, and troubleshooting for incompatible Python wheels, missing llama.dll dependencies, closing script windows, encoding errors, and incorrect model paths. The accompanying local-llm-easy-deploy code is described as open source.

    掘金 · 人工智能 · 🔥 0
  11. NVIDIA marks 20 years of GeForce 8800 GTX with a free Steam demo

    NVIDIA released a free Steam technical demo titled "GeForce 8800 GTX - 20 Years of a Legend" to mark the card's 20th anniversary. Created by Unreal Engine artist Dylan Browne, the demo recreates a 2006 gaming room where players can unbox, inspect and install the 8800 GTX in an era-accurate PC tower. It uses path tracing, DLSS 4.5 Ray Reconstruction, Dynamic Multi Frame Generation and RTX Mega Geometry. The GeForce 8800 GTX launched on November 8, 2006, as NVIDIA's first CUDA-capable GPU, with 128 CUDA cores on the 90nm G80 chip and 768MB of GDDR3 at a $599 launch price. The demo requires at least an RTX 4070 and recommends an RTX 5080, prompting criticism from some gamers amid high graphics-card prices.

    Tom’s Hardware · 🔥 0
  12. Hogwarts Legacy Adds DLSS 5 Neural Rendering on GeForce NOW

    According to NVIDIA, Hogwarts Legacy now supports NVIDIA DLSS 5 with 3D-Guided Neural Rendering through GeForce NOW. NVIDIA says the update adds lighting and material detail while retaining the game’s underlying geometry and textures; Avalanche Software tuned the integration using DLSS 5 developer controls. The same report covers other GeForce NOW additions, including World of Warcraft: Forever and expansions for Tom Clancy’s The Division 2 and Anno 117: Pax Romana.

    NVIDIA Blog · 🔥 0
  13. Box Integrates Nvidia's Nemotron Embeddings into New Content Retrieval Feature

    At its developer conference, Box announced Box Content Retrieval, a feature that embeds Nvidia's Nemotron embedding system into the core of its product so agents can answer queries using Nemotron-generated embedded metadata. Box says this yields faster, more accurate and less expensive queries, while Nvidia's Kari Briski told TechCrunch she expects answers four times faster, 20% fewer errors and 90% fewer tokens used. The feature implements Nvidia's Nemotron Embed project and its open-weight embedding models, and will roll out to all Box Enterprise Advance customers early next year.

    TechCrunch AI · 🔥 0
  14. Midterm Election Drives Sell-Off in AI Infrastructure Stocks

    A commentary from Miaotou APP says investors interpreted the U.S. midterm election results as increasing scrutiny of data-center construction, contributing to selling in neocloud, optical-networking and data-center stocks. The report cited gains in Apple, Amazon and Microsoft and declines in CoreWeave, Micron Technology, Nvidia and Oracle. It characterized this divergence as market pricing for concern that AI capital spending may slow, while emphasizing that major technology companies had not already cut AI investments across the board.

    虎嗅 AI · 🔥 0
  15. Moonshot AI Seeks European Access to Nvidia Blackwell GPUs

    CNBC, citing anonymous sources, reported that Moonshot AI sought leasing agreements with European neocloud providers for access to advanced Nvidia chips as U.S. export controls restrict their availability in China. One source said talks covered a European cluster of at least 8,000 Nvidia Blackwell GPUs for inference, while another said Moonshot was also interested in training capacity. Moonshot AI did not respond to requests for comment.

    CNBC Technology · 🔥 0
  16. Micron Taoyuan workers strike, exposing labor unrest in Taiwan's AI chip boom

    About a dozen workers at Micron Technology's Taoyuan plant in Taiwan went on strike in October, the first strike in the island's semiconductor industry, after union and company talks on salaries and bonuses broke down. Rest of World reports that Micron reached an October 22 agreement with the Taichung union covering higher salaries, quarterly bonuses and larger pension contributions, but many members rejected the secret deal and the Taoyuan union remained dissatisfied. Union membership across Micron's two Taiwan plants surged from about 440 to more than 13,000 over recent months, and Taiwan's Ministry of Labor said it would help mediate further talks.

    Rest of World · 🔥 0
  17. DLSS 5 neural rendering shown in Astral Chain PC port

    A new video from No Music Gaming showcases the recently released unofficial native PC port of Astral Chain running with NVIDIA DLSS 5 neural rendering. Wccftech reported that the technology adds more detailed textures and slightly moodier lighting to the game’s environments, leading the outlet to characterize the port as having “remaster” qualities. A November 4 update also added non-Xbox controller support, experimental uncapped frame rates, in-game settings and rumble, while most of the port’s code, tooling, reverse engineering and documentation were reportedly written with Claude Code.

    Wccftech · 🔥 0
  18. GPT-6 Astra reshapes the embodied-AI debate

    TMTPost reports that GPT-6 Astra can control robotic arms using visual inputs and task instructions, prompting debate over whether general multimodal models will displace specialized embodied models. Tests attributed to NVIDIA and Galaxy General reportedly found that Astra outperformed π0.5 on selected tasks, but also showed substantial latency and token costs. The article says demand for embodied data increased after the release, while practitioners remain divided over long-horizon reliability and the division of work between general and specialized models.

    钛媒体 · 🔥 0
  19. Record SK Hynix Earnings Meet a 50% Share-Price Drawdown

    TMTPost reports that SK Hynix posted quarterly revenue of 104.6155 trillion won and an 80% operating margin, while Samsung Electronics also exceeded 100 trillion won in quarterly operating profit. SK Hynix’s shares had nevertheless fallen roughly 50% from their midyear high, and the selloff spread to US memory stocks amid broader pressure on AI hardware and changing US AI data-center regulation expectations. The report also examines how long-term supply agreements, rising DRAM and NAND prices, and higher inventory risk are reshaping the memory market.

    钛媒体 · 🔥 0
  20. Microsoft raises $25 billion in bonds as Big Tech turns to external financing

    According to a TMTPost commentary, Microsoft issued $25 billion in corporate bonds on October 29, returning to the bond market after nine years. The offering comprised ten tranches with maturities ranging from two to 40 years, with the longest due in 2066, and reportedly attracted orders of up to $115 billion. The commentary said Amazon, Alphabet, Microsoft, Meta and Oracle had combined capital spending that exceeded operating cash flow in the first nine months of the year and increasingly used debt or equity financing. These broader financial figures were not independently verified in the supplied material.

    钛媒体 · 🔥 0
  21. NVIDIA open-sources Auto Ontology for governed NL-to-SQL

    The supplied reports describe NVIDIA’s open-source Auto Ontology as a semantic catalog and business-ontology system for natural-language SQL generation over structured data. It ingests database metadata to draft terms, column mappings, relationships and reusable SQL attributes, which users can revise and certify before query agents use them to retrieve context, generate and check SQL, and execute queries. The project exposes Web, authenticated REST API, CLI and MCP interfaces. The reports caution that generated definitions require business-owner approval, final SQL is still model-generated, and successful execution does not guarantee a correct business answer. They also note validation, retry and fallback paths, meaning returned SQL should not automatically be treated as a successfully executed or authoritative result.

    掘金 · 人工智能 · 🔥 0
  22. Hon Hai October Sales Rise 46% on Nvidia Server Demand

    Hon Hai Precision Industry reported a 46% increase in October sales. The report said the rise reflected resilient demand for Nvidia servers used in global AI infrastructure.

    Bloomberg Technology · 🔥 0
  23. TrendForce Sees 18x CPO Optical Engine Demand by 2028

    TrendForce analyst Gao Leyun forecast that optical engine demand could reach about 62 million units in 2028, 18 times the 2027 level, as opticalization reaches 18% and roughly 80% of demand comes from scale-up interconnects. He identified wafer capacity, lasers, packaging, and testing as the four main mass-production bottlenecks, with PIC platform qualification, shorter testing times, and passive alignment required in 2027. The report says NVIDIA and Broadcom are primarily promoting CPO, while Chinese companies such as Huawei and Alibaba are developing NPO.

    科技新报 · 🔥 0
  24. Johor’s data-center boom raises power and water concerns

    Malaysia’s data-center expansion is accelerating as Johor attracts about 50 projects in three years, including projects from ByteDance and Microsoft, while Google, Amazon, Nvidia, and Alibaba have committed investments linked to AI and cloud demand. DC Byte says planned and under-construction capacity in Johor grew 100 times over five years, but local officials and residents report concerns over electricity and water shortages; Malaysia’s national electricity company estimates data-center demand could exceed 5,000 MW by 2035.

    Rest of World · 🔥 0
  25. GPU solver cuLoRADS cracks 18-year-old quantum ordered-search problem

    A Shanghai Jiao Tong University team used the GPU-accelerated solver cuLoRADS to directly solve the full semidefinite program for five quantum ordered-search queries, confirming that the maximum searchable ordered-list length is 7,265 and that the scheme fails at 7,266, according to MIT Technology Review China citing a PNAS paper. The program had grown quadratically with list length for 18 years, beyond the reach of CPU solvers at the time. The paper reports that on a single NVIDIA H100, a set of 10-million-order MaxCut semidefinite relaxations was solved in 10 seconds to one minute, versus tens of hours for previously reported CPU methods.

    MIT科技评论中文 · 🔥 0
  26. Realtime-Bench Tests 12 Frontier Models on Dynamic Tasks

    AIbase AI新闻 reports that NVIDIA and UT Austin introduced Realtime-Bench, a benchmark with 50 tasks across eight scenario types for assessing real-time perception, time-adaptive reasoning, and action timing. Researchers tested 12 frontier models under three environment-advancement clock protocols, and reportedly found that raising reasoning intensity did not reliably improve success. The report says GPT-6-Astra achieved a 44% task success rate when environments advanced according to actual reasoning time.

    AIbase AI新闻 · 🔥 0
  27. Whitepaper runs Qwen2.5-7B on an 8GB RTX 4060 with vLLM

    A version 0.3 whitepaper documents an author-run deployment of Qwen2.5-7B-Instruct-AWQ and Qwen2.5-7B-Instruct-GPTQ-Int4 with vLLM 0.33.0 on a Windows 11 laptop containing an RTX 4060 Laptop GPU with 8GB of memory. Using 4-bit quantization, an 8,192-token context limit, 0.85 GPU-memory utilization and eager mode, the test used about 7.3GB of GPU memory and reported roughly 53-54 tokens per second for a single 256-token request. The paper also reproduces three vLLM issues and publishes logs, scripts and patches, although its results cover one Windows machine and cannot provide same-system comparisons for bf16 or GGUF.

    掘金 · 人工智能 · 🔥 0
  28. Naraka Bladepoint now supports DLSS 5 neural rendering and up to 6x frame generation

    NetEase announced that Naraka Bladepoint now supports NVIDIA DLSS 5 and neural rendering, including frame generation of up to 6x, according to IT之家. The publisher said AI models assist with image reconstruction, refining texture details, skin subsurface scattering, contact shadows, and hair rendering. IT之家 reported improvements in distant architecture, water reflections, vegetation, skin, and hair in scenes including Jugge洲 and Penglai Island.

    IT之家 AI · 🔥 0
  29. Coherent Q1 revenue jumps 49.9% as AI optical demand drives growth

    Coherent reported fiscal 2027 first-quarter revenue of $2.37 billion, up 49.9% year over year, while adjusted non-GAAP EPS rose to $2.09 from $1.16, TechNews reported. Data center and communications revenue increased 79% to $1.9517 billion, and the company guided fiscal second-quarter revenue to $2.55 billion–$2.75 billion. Operating cash flow declined to negative $92.7 million from positive $46 million a year earlier.

    科技新报 · 🔥 0
  30. World-Model Funding Surges Despite a Fragmented Definition

    36氪 人工智能 reports that Chinese primary-market investors put 66.6 billion yuan into companies labeled “world models” during the first seven months of 2026, with 58 of 64 tracked companies receiving financing. The analysis notes that World Labs co-founder and CEO Li Fei-Fei and BAAI president Wang Zhongyuan use different taxonomies, while products such as Marble, GWM Worlds 2 and GigaWorld pursue distinct businesses under the same label. It also cites benchmark results suggesting that many such systems render convincing imagery faster than they demonstrate reliable physical reasoning.

    36氪 人工智能 · 🔥 0

← PreviousNext →

Experience and discussion from the community

Share my NVIDIA experienceAsk about NVIDIA

Switchyard: An open-source library that helps an AI agent choose which model handles each request.

What problem it solves AI agents need to choose among models while balancing task success, cost, and latency for their workloads. Applications also need flexibility in where routing runs and who controls model clients, credentials, retries, and service operation. Key features Multiple routing algorithms — Routing can be configured with Auto, Task, Execution, or Composite strategies, including mode…

github.comhttps://github.com/NVIDIA-NeMo/Switchyard

vllm: A fast and easy-to-use library for LLM inference and serving.

What problem it solves Serving large language models requires efficient memory management, flexible model execution, and practical integration with existing models and APIs. vLLM addresses these needs with inference and serving capabilities spanning batching, caching, quantization, distributed execution, and multiple hardware platforms. Key features Efficient memory and serving — vLLM manages atte…

github.comhttps://github.com/vllm-project/vllm

skills: Portable instruction sets that teach AI agents how to use NVIDIA software for end-to-end workflows.

What problem it solves AI agents need product-specific instructions to use NVIDIA software reliably across physical AI, robotics, simulation, CUDA-X libraries, RAG, and platform workflows. The catalog centralizes these skills while keeping them maintained in their respective product repositories and synchronized through an automated pipeline. Key features Agent-discoverable skill catalog — The NVI…

github.comhttps://github.com/NVIDIA/skills

SkillEvaluator: An open-source tool that checks AI agent skills and measures their effect on task results.

What problem it solves AI agent skills need to be checked for quality, security, duplication, and their actual effect on agent behavior. Static checks alone cannot establish whether guidance improves task results, so evaluation must also support live comparison with and without a skill. Key features Three-tier evaluation pipeline — Independent tiers validate skill safety and structure, detect over…

github.comhttps://github.com/NVIDIA/SkillEvaluator

llama.cpp: Plain C/C++ implementation for local and cloud LLM and VLM inference.

What problem it solves Running large language and vision-language models can require substantial setup and may depend on the available hardware. The project aims to make inference accessible across a wide range of local and cloud hardware with minimal setup. Key features Minimal-setup inference — The project provides installation options for common platforms, including scripts, Docker, pre-built b…

github.comhttps://github.com/ggml-org/llama.cpp

TensorFold: A native language-model inference engine for serving checkpoints on Apple Silicon and NVIDIA GPUs.

What problem it solves Serving language models requires reading checkpoints, tokenizing requests, and running accelerated kernels while managing a local model server. TensorFold addresses these requirements with a native binary that can run on Apple Silicon and NVIDIA GPUs without requiring Python or MLX for serving. Key features Native Metal and CUDA inference — The Zig-based engine executes mode…

github.comhttps://github.com/ashhart/TensorFold

sglang-omni: A multi-stage serving runtime for omni, speech, and TTS models.

What problem it solves Interactive multimodal and speech systems often require generation to span heterogeneous stages with different compute patterns, dependency structures, and resource needs. Serving these pipelines requires coordinated stage lifecycles, inter-stage transport, model integrations, and a unified API surface. Key features Coordinated multi-stage runtime — Models generation as coor…

github.comhttps://github.com/sgl-project/sglang-omni

polars: An analytical query engine written in Rust for DataFrame and SQL queries.

What problem it solves Data analysis workflows often require expressive query composition, flexible execution models, and interoperability with columnar data. Polars addresses these needs by allowing the DataFrame API and SQL to share the same optimizer and engine, with support for large workloads and custom extensions. Key features Unified DataFrame and SQL Queries — Queries can be written with e…

github.comhttps://github.com/pola-rs/polars

FreeToken: An edge-native MoE serving engine for running frontier-scale open-weight models on personal and consumer hardware.

What problem it solves Running frontier-scale open-weight models locally requires an inference platform that can make efficient use of the heterogeneous hardware available on a personal device. The project addresses this by treating GPUs, CPUs, host memory, and interconnects as a unified, elastic inference platform. Key features Edge-native MoE runtime — The runtime provides MoE serving with bandw…

github.comhttps://github.com/FlashML-org/FreeToken

OpenShell: A safe, private runtime for fleets of autonomous AI agents.

What problem it solves Autonomous AI agents often need to read files, install packages, call APIs, and use credentials, but unrestricted access can expose host data, secrets, and networks. OpenShell provides these capabilities within an isolated runtime where declared policies constrain agent access. Key features Kernel-level runtime enforcement — Agents run in isolated sandboxes where kernel cont…

github.comhttps://github.com/NVIDIA/OpenShell

SkillSpector: Security scanner for AI agent skills.

What problem it solves AI agent skills execute with implicit trust and often receive minimal vetting before installation. SkillSpector helps users assess whether a skill contains vulnerabilities, malicious patterns, or other security risks before installing it. Key features Multi-format scanning — Scan agent skills supplied as Git repositories, URLs, zip files, directories, or individual files. So…

github.comhttps://github.com/NVIDIA/SkillSpector

jasna: Restores mosaics in videos and images through a simple app and command line that run on your GPU.

What problem it solves Mosaics obscure portions of videos and images, making it difficult to view the affected content without changing the rest of the picture. Users need a restoration workflow that can identify selected mosaic regions and process them with GPU-accelerated video handling. Key features Targeted mosaic restoration — Detects mosaics in videos and restores them while leaving the rest…

github.comhttps://github.com/Kruk2/jasna

Model-Optimizer: A library for composing model optimization techniques and exporting optimized quantized checkpoints.

What problem it solves Deep learning models often need to be adapted for efficient deployment across different inference frameworks. Model Optimizer addresses this by providing a unified set of optimization techniques and export workflows for quantized checkpoints. Key features Post-training quantization — Compress models with quantization techniques available for Hugging Face, Megatron-Bridge, Di…

github.comhttps://github.com/NVIDIA/Model-Optimizer

nvke: A self-hosting management plane for creating and operating Kubernetes clusters on NVIDIA GPU infrastructure.

What problem it solves Platform teams need to create and operate isolated Kubernetes clusters for customers on infrastructure they supply and control. They need a management plane that can provision GPU machines, manage cluster lifecycle operations, and establish node identity before issuing join credentials. Key features Independent workload clusters — Create workload clusters through the NVKE AP…

github.comhttps://github.com/dsx-ai-factory/nvke

LocalAI: An open-source AI engine for running models locally across modalities and hardware.

What problem it solves Running AI models locally can require integrating multiple inference engines, model formats, hardware accelerators, and API surfaces. LocalAI addresses this with a small core, on-demand backends, and compatible APIs that work across supported hardware without requiring a GPU. Key features Composable inference backends — Backends are packaged separately and pulled only when a…

github.comhttps://github.com/mudler/LocalAI

TensorRT-LLM: An open-source library for optimizing LLM and Visual Gen inference on NVIDIA GPUs.

What problem it solves LLM and Visual Gen inference requires specialized kernels, efficient runtime orchestration, and flexible deployment across NVIDIA GPU configurations. Developers also need a modular framework that supports customization while integrating with established inference tooling. Key features Optimized inference kernels — Custom kernels accelerate common inference operations, includ…

github.comhttps://github.com/NVIDIA/TensorRT-LLM

cuda-rust: NVIDIA's CUDA platform for Rust, providing host-side runtime crates and GPU kernel programming models in idiomatic Rust.

What problem it solves Rust developers need host-side access to the CUDA runtime and tools for expressing GPU kernels while preserving Rust's ownership and borrowing rules. The platform provides separate programming models for workloads that require direct thread-level control and workloads naturally expressed through tensor operations. Key features Shared CUDA runtime — Host-side crates provide d…

github.comhttps://github.com/NVIDIA/cuda-rust

auto-ontology: An open library that builds a context layer from enterprise metadata and exposes it to agent harnesses.

What problem it solves Agents can retrieve documents and query databases, but unreliable results undermine agentic analytics. Teams need a context layer that records where data lives, what its definitions mean, whether it is usable, how it should be queried, its provenance, and related concepts. Key features Enterprise ontology generation — Generate semantic ontologies from database metadata, infe…

github.comhttps://github.com/NVIDIA/auto-ontology