NVIDIA GTC Taipei at COMPUTEX
Recorded talk

Foxconn Builds Robotics for Healthcare With NVIDIA Physical AI

enplatform captions
Summary

Hospitals face clinician shortages and rising patient demand, with Taiwan's nurse shortage highlighted as urgent. Foxcon is building physical AI for digital hospitals using NVIDIA's stack: DGX for model training, Isaac for healthcare robotics development and simulation, and Jetson Orurin with NVIDIA holoskin for edge execution. Example Neurobot — powered by the Fox Brain LLM and trained virtually in a digital twin ward — navigates, delivers specimens and medications, and interacts with staff and patients, freeing nurses for clinical work. Early real-world deployment is reported as positive, but the source provides no quantitative metrics or detailed failure-mode analysis.

Key technical points

  • Global hospital pressures: not enough clinicians, rising patient demand; Taiwan nurse shortages are especially urgent (problem statement).
  • Foxcon's approach is 'physical AI for digital hospitals' combining generative AI, robotics, and realtime compute (overall system concept).
  • NVIDIA DGX is used to train models that interpret clinical and operational data, predict complications, and power intelligent agents (data-center training role).
  • Foxcon develops both physical (robots) and digital agents spanning the full spectrum of AI (mixed agent architecture).
  • Neurobot is an AI-powered nursing assistant developed in Taiwan's first digital twin hospital ward (example system + testbed).
  • Neurobot capabilities explicitly described: hallway navigation, delivery of specimens and medications, and interaction with staff and patients to free up nurses (inputs → actions/outputs).
  • Neurobot is built on Isaac for healthcare, identified as a healthcare robotics development platform (robotics development framework).
  • The platform uses three NVIDIA computing tiers: training foundation models in the data center, learning in simulation, and running AI at the edge (three-stage pipeline).
  • Edge execution component specified as NVIDIA holoskin running on Jetson Orurin (edge runtime and hardware).
  • Neurobot is powered by the Fox Brain LLM; models are trained virtually (simulation) then deployed into real-world wards (sim-to-real training/deployment loop).
  • Stated objectives: improve patient care, support overburdened staff, enable more personalized treatment plans, and ultimately improve outcomes (intended impact).
  • Reported deployment status: Neurobot has been deployed in a digital twin ward and is 'already making a difference'—the source gives qualitative evidence but no quantitative evaluation metrics.
  • The work is a collaboration between Foxcon and NVIDIA to build smarter hospitals and shape future technology that supports clinical staff (partnership context).
Engineering relevance

Architecture: a three-tier pipeline—DGX-based data-center training of foundation models, Isaac-driven simulation and digital-twin learning, and edge inference on Jetson Orurin with NVIDIA holoskin. Inputs and outputs: models ingest clinical/operational data to interpret conditions and predict complications, then drive agent behaviors (navigation, deliveries, staff/patient interactions). Deployment/iteration loop: virtual training in simulation (digital twin) followed by real-world deployment (sim-to-real). Components explicitly named: NVIDIA DGX, Isaac for healthcare, NVIDIA holoskin, Jetson Orurin, Fox Brain LLM. Evidence: qualitative early real-world deployment in Taiwan's digital twin ward. Not provided in the source: quantitative evaluation metrics, production guardrails, specific failure modes, or detailed validation procedures—these were not described and must be obtained from further documentation before production rollout.

Japan relevance

For Japanese software and AI engineers, the system demonstrates a concrete design pattern for hospital robotics: centralized foundation-model training (DGX) + simulation-driven learning (digital twin, Isaac) + edge LLM inference on dedicated hardware (holoskin on Jetson Orurin). The Neurobot example shows how sim-to-real pipelines and LLM-powered agents can address clinician shortages by automating logistics and routine interactions; similar challenges appear in Japan's healthcare systems. Key technical elements to study from this project are the digital-twin testbed, integration of a domain LLM (Fox Brain) with robotics middleware, and the explicit split of training, simulation, and edge execution — though practitioners should note the source lacks published metrics, guardrails, and failure-mode analysis that would be necessary for local deployment and regulatory compliance.

Full transcript

Transcript

platform captions
Hospitals worldwide face a growing crisis. Not enough clinicians, rising patient demand, and a need for smarter, safer care. In Taiwan, nurse shortages make this challenge even more urgent. Foxcon is addressing it with physical AI for digital hospitals powered by NVIDIA's generative AI, robotics, and realtime compute. The goal, better patient care. It starts with NVIDIA DGX training models to interpret data, predict complications, and power intelligent agents. Foxcon builds both physical and digital agents spanning the full spectrum of AI. One example is Neurobot, an AI powered nursing assistant developed in Taiwan's first digital twin hospital ward. It navigates hallways, delivers specimens and medications, and interacts with staff and patients, freeing up nurses to focus on care. Neurobot brings physical AI to life using Isaac for healthcare. A healthcare robotics development platform powered by all three of NVIDIA's computing platforms training foundation models in the data center learning in simulation and running AI at the edge with NVIDIA holoskin running on Jetson Orurin. Powered by the Fox Brain LLM, Neurobot is trained virtually then deployed in the real world where it's already making a difference. Together, Foxcon and Nvidia are not just building smarter hospitals. They're shaping a future where technology supports overburdened staff, creates more personalized treatment plans, and ultimately improves patient outcomes. [Music]