Nvidia controls robots using Apple Vision Pro

Nvidia controls robots using Apple Vision Pro

NVIDIA uses the Apple Vision Pro headset to develop its humanoid robots. Vision Pro captures human demonstrations, which are then simulated in NVIDIA Isaac Sim and used to generate synthetic datasets via the MimicGen NIM microservice.

This process helps train the GR00T humanoid foundation model with both real and synthetic data, saving time and reducing costs. In addition, Robocasa’s NIM microservice helps retrain the robot model in Isaac Labs, while NVIDIA’s OSMO efficiently manages computing tasks, streamlining the development process.

See how it looks in the video below.

Source: 9to5Mac