NVIDIA GTC Taipei at COMPUTEX
Recorded talk

NVIDIA Isaac AMR | End-to-End Autonomy Platform for Next Generation AMRs

enplatform captions
Summary

Manufacturing and warehousing operations are moving from manual forklifts and guided vehicles to fully autonomous mobile robots to raise productivity and improve worker safety. NVIDIA Isaac AMR is an integrated end-to-end platform built around NOVA Orin (a sensor suite plus on-board compute) and a cloud mapping service that produces detailed 3D voxel maps which can be sliced into 2D maps for different robots. On-robot Lidar or cost‑effective cameras provide navigation, Isaac Mission Control (using cuOpt) optimizes routes, and Isaac Sim + NVIDIA Omniverse let teams train and fully validate autonomy in realistic digital twins before real-world deployment. The result is faster, lower-cost migration to full autonomy with a simulation-based validation guardrail and an explicit trade-off between higher-performance Lidar and lower-cost camera solutions.

Key technical points

  • Problem: factories and warehouses are migrating from manual forklifts and guided vehicles to full autonomy to improve productivity and worker safety.
  • Isaac AMR is positioned as an integrated end-to-end solution for deploying fully autonomous mobile robots.
  • Core system component: NOVA Orin — a combined advanced sensor suite and on-robot computing hardware that supports mapping, autonomy, and simulation workloads.
  • NOVA's advanced sensors accelerate the mapping process by feeding a cloud-based service that generates an accurate, detailed 3D voxel map of the facility.
  • The 3D voxel map can be sliced across a plane to generate 2D maps tailored for different autonomous robot types operating in the same facility (multi-platform map output).
  • On-robot navigation can use either Lidar or cost-effective cameras; both are presented as options that enable reliable autonomous navigation in complex, dynamic environments.
  • Isaac Mission Control performs route planning optimization using the cuOpt library (route planning optimization component).
  • Isaac Sim together with NVIDIA Omniverse enables creation of realistic digital twins of the operating environment for training autonomous robots on complex tasks entirely in simulation.
  • Simulation is used not only for training but also for full validation: all operations can be fully validated in Isaac Sim prior to real-world deployment (production validation guardrail).
  • End-to-end deployment pipeline implied: capture environment with NOVA sensors -> cloud generates 3D voxel map -> slice to robot-specific 2D maps -> onboard sensors handle navigation -> Mission Control (cuOpt) optimizes routes -> train and validate behaviors in Isaac Sim -> deploy to real robots.
  • Inputs: NOVA sensor data for mapping and on-robot Lidar/camera streams for navigation. Outputs: detailed 3D voxel maps, robot-specific 2D maps, optimized routes, and validated autonomous policies.
  • Trade-off explicitly noted: a choice between on-robot Lidar versus cost-effective cameras, balancing sensor cost against expected navigation capability.
  • Reliability claim: the navigation stack (with chosen sensors and maps) is described to work reliably in the most complex and dynamic environments encountered in facilities.
  • Primary outcomes: accelerates migration to full autonomy, reduces deployment costs, and speeds time-to-deployment for next-generation AMRs.
  • Production guardrails and iteration loop emphasize simulation-first development: train in digital twin, validate in Isaac Sim, then deploy to reduce risk in the physical environment.
Engineering relevance

For software and systems engineers this talk defines an explicit, repeatable pipeline and integration points: NOVA Orin for sensor capture and on-board compute, a cloud mapping service that outputs 3D voxel maps, a map-slicing step to produce robot-specific 2D maps, and a navigation stack that accepts either Lidar or camera inputs. Route optimization integrates cuOpt via Isaac Mission Control. Use Isaac Sim and Omniverse to create digital twins for training and full validation before field deployment, which serves as a production guardrail and shortens iteration cycles. Key design decisions to evaluate: sensor selection (Lidar vs camera) for cost vs performance, how to integrate cloud-generated 3D voxel maps into on-robot localization stacks, and embedding cuOpt-based mission planning into your fleet manager. The platform emphasizes simulation-first testing to reduce real-world risk and speed deployment, so plan CI/CD and validation workflows around Isaac Sim artifacts and the digital-twin models.

Japan relevance

The described end-to-end approach maps directly to typical Japanese industrial and logistics sites that prioritize safety, space efficiency, and mixed-robot fleets. The ability to generate a single high-fidelity 3D voxel map and slice it into 2D maps for different robot classes supports mixed deployments common in Japanese factories and warehouses. Sensor-cost trade-offs (Lidar vs cameras) are particularly relevant for cost-sensitive deployments across manufacturing and distribution centers in Japan. Using Isaac Sim and Omniverse to validate autonomy in a digital twin reduces disruption to continuous-production lines and helps comply with strict uptime expectations. Overall, the platform’s simulation-first validation and route-optimization (cuOpt) features can help Japanese engineering teams accelerate safe, low-risk migration to full AMR autonomy while controlling operational costs.

Full transcript

Transcript

platform captions
To improve productivity and increase worker safety, factories and warehouses are migrating away from manual forklifts and guided vehicles to full autonomy. NVIDIA Isaac AMR provides an integrated end-to-end solution to deploy fully autonomous mobile robots. The core of the solution is NOVA Orin, a sensor suite and computing hardware that enables mapping, autonomy, and simulation. NOVA’s collection of advanced sensors speeds the mapping process, leveraging our cloud-based service to generate an accurate and detailed 3D voxel map. This 3D map can then be sliced across a plane to generate 2D maps tailored for different autonomous robots that might operate in a facility. With these maps in place, on-robot Lidar, or cost-effective cameras provide autonomous navigation that works reliably in the most complex and dynamic environments. Isaac Mission Control optimizes route planning using the cuOpt library. To improve operations, developers can use Isaac Sim and NVIDIA Omniverse to create realistic digital twins of the operating environment. This allows fully autonomous robots to be trained on complex tasks entirely in simulation. All operations can be fully validated using Isaac Sim before deployment to the real world. Isaac AMR accelerates your migration to full autonomy, reducing costs and speeding deployment of the next generation of AMRs.