NVIDIA Cosmos builds physical-AI datasets in two prompts
NVIDIA Technical Blog details NVIDIA Cosmos Data Factory, a platform component with five cloud-native blueprints and six composable skills for data curation, processing, and synthetic-data generation. The demonstrated workflow uses a coding agent and two prompts to cover driving scenarios, image and video augmentation, rare-event videos, and defect images for physical-AI training. NVIDIA also reports compute costs and throughput figures, while noting that setup, storage, source-data preparation, agent use, and human review may add costs.
The workflow combines agent orchestration with reusable data-generation components, offering physical-AI teams a concrete route from prompts to annotated training data, although its claimed effectiveness and economics remain vendor-reported.
World model accuracy starts with high-quality, diverse training datasets. Yet capturing rare defects, nighttime incidents, and other challenging scenarios is costly and time-consuming. Turning raw data into training-ready datasets adds complexity, particularly when using disconnected tools and manual processes for curation, labeling, generation, and evaluation.
NVIDIA technology is helping developers more easily build high-quality, diverse training datasets at scale for physical AI. NVIDIA Cosmos is an open platform of frontier models, datasets, frameworks, and skills for world model development. As part of this platform, NVIDIA Cosmos Data Factory (CDF) is a collection of five cloud-native blueprints and six composable skills to accelerate data curation, processing, and synthetic data generation (SDG). Frontier AI agents can be used to orchestrate these blueprints, enabling prompt-to-data without human steering.
This post walks you through how to curate and augment datasets or create anomalous events for physical AI model training with just two prompts in Cosmos. It features five different use cases.
Video 1. Learn how to use a coding agent to turn a single warehouse image into labeled synthetic fall-event videos—with just a few prompts
#NVIDIA#NVIDIA Cosmos Data Factory#Cosmos3-Super-Image2Video#Cosmos Evaluator#Cosmos 3 Super#NVIDIA Isaac Sim#Qwen-Image-Edit