NVIDIA Adds Four Open Cosmos 3 Simulation Checkpoints

In a company blog post, NVIDIA released four open-weight checkpoints for its Cosmos 3 world model platform. Cosmos3-Nano-Transfer-Auto, Cosmos3-Nano-Sim-Auto, Cosmos3-Nano-Sim-Transfer, and Cosmos3-Nano-Sim-Bimanual each have 16 billion trainable parameters and use the OpenMDW 1.1 license for commercial and noncommercial use.

Cosmos3-Nano-Transfer-Auto generates synchronized driving video across as many as 11 camera views, with optional joint RGB and LiDAR output. Developers can control scene structure, traffic, weather, lighting, and time of day. Cosmos3-Nano-Sim-Auto is a distilled streaming version that generates successive camera and LiDAR segments from driving controls and previous output.

Cosmos3-Nano-Sim-Transfer converts simulator controls and text prompts into video while leaving physics and scene state calculations to the simulator. Cosmos3-Nano-Sim-Bimanual predicts observations from camera movements and two-arm robot actions, with support for YAM and AgiBot systems.

Running the published setup requires Linux, an NVIDIA GPU, Docker, and NVIDIA Container Toolkit.