The data bottleneck in surgical robotics
Building a robot that can safely navigate a human body is fundamentally different from training a large language model. A language model learns from text. A surgical robot has to learn from physical experience — the give of tissue, the resistance of a calcified artery, the precise amount of force needed to manipulate a catheter without causing damage.
That kind of embodied learning normally requires thousands of hours of real clinical procedures. But in healthcare, physical bodies are scarce, tightly regulated, and slow to generate the edge cases a robot actually needs to see. A kidney stone lodged at an unusual angle or a guidewire catching on a vessel wall might only appear in a fraction of cases. Waiting for them to happen in an operating theatre is not a viable training strategy.
Nvidia thinks it has a solution. The company’s new Medical Physics Simulation framework, announced as an open-source addition to its Nvidia Isaac for Healthcare platform, treats surgical robots as physical AI systems. The idea: generate the embodied experience computationally, at scale, before a scalpel ever touches a patient.
How the framework works: classical physics meets generative AI
The framework combines two modelling approaches. Classical physics simulation handles the mechanical rules that are already well understood — how a catheter bends, how much resistance a vessel wall applies, how contact forces shift as an instrument moves through tissue.
Generative AI handles what’s harder to hand-code: visual scene dynamics learned from procedural data. That part comes through a component Nvidia calls Cosmos-H Dreams.
Together, they form what the company calls a physical AI proposition. Classical simulation gives a robot policy the physics it must obey. Generative simulation gives it the range of visual and anatomical variation it needs to generalise. Run at scale on GPUs using Nvidia’s Warp and Newton libraries, the framework can execute thousands of parallel training environments instead of one scene at a time.
Nvidia claims a benchmark running 8,192 parallel environments cut training time from over five hours to under two minutes. But that measures throughput, not clinical reliability. It says nothing about how a policy trained this way performs against incomplete imaging, delayed sensor readings, or anatomy that falls outside anything the simulation modelled.
A language model that underperforms on an edge case produces a bad answer. A physical AI system that underperforms on an edge case is operating inside a patient. The parallel-simulation approach is a real advance in how fast developers can explore failure modes. Whether those simulated failure modes match what actually goes wrong in a surgical suite is a separate question — one none of the early adopters has published answers to yet.
Who is testing the approach — and how far along they really are
The organisations Nvidia names as early adopters are applying the physical AI approach at different depths. The list is worth reading with that in mind rather than treating it as a uniform roster of deployments.
CMR Surgical and Cambridge Consultants, the Capgemini-owned engineering firm, have gone furthest on the data side. CMR has contributed close to 500 hours of anonymised clinical data from its Versius Surgical Robotic System to the Open-H Embodiment dataset. The data spans cholecystectomy, prostatectomy, hernia repair and hysterectomy procedures. The pair are using Cosmos-H Dreams to model soft-tissue interaction physics and produce patient-specific simulations.
“Open-source models allow us to build on shared knowledge, accelerating responsible innovation and, ultimately, gives us the potential to deliver more consistent care and better outcomes for patients worldwide,” said Chris Fryer, CTO at CMR Surgical.
Johnson & Johnson MedTech is using the framework alongside a Cosmos-based foundation model to build a digital twin of its endoluminal MONARCH platform, focused on kidney-stone scenarios in urology.
XCath is applying it to endovascular autonomy policy training — teaching a system the physical behaviour of navigating blood vessels without a human hand on the controls. Inner Logic is generating synthetic data to validate device mechanics and says it intends to produce in silico evidence to support regulatory submissions. No submission built on that evidence has been confirmed publicly.
Medtronic Structural Heart sits earliest in the group, exploring simulated X-ray sensing for catheter navigation research.
Each of these is a training exercise or dataset contribution. None is a deployed system operating on a patient with policies learned this way. Nvidia doesn’t claim otherwise.
Why open source matters for physical AI in healthcare
Healthcare robotics carries a governance requirement most physical AI applications — including industrial and warehouse robots — don’t face to the same degree. Regulators and clinical review boards need to see how a system arrived at its behaviour, not just confirm the behaviour looked acceptable in testing.
An open-source framework lets developers inspect the physics assumptions inside the simulation, reproduce results across different anatomies, and build an evidence trail suited to a submission before the FDA or an equivalent body.
That’s a stronger argument for openness in physical AI than it is in most software categories, where a closed vendor pipeline hides the assumptions a team would otherwise need to defend to a regulator. It doesn’t settle the validation question on its own. Open code lets outside reviewers check the model’s logic, but it doesn’t confirm the model’s physical behaviour matches what happens in a body. That confirmation still has to come from testing that none of these companies has published yet.
The road ahead: simulation as infrastructure, not replacement
Nvidia has built infrastructure that could shorten the pre-hardware phase of physical AI development for surgical and diagnostic robots. Running training at this scale in parallel is a departure from rebuilding a custom simulation scene for every workflow. For teams that previously spent months gathering enough clinical data to train a single policy, the ability to generate thousands of parallel training environments on demand is a real shift.
But simulation remains a tool for exploration, not a substitute for clinical validation. The companies testing Nvidia’s framework are still early in the process. None has published results showing a policy trained entirely in simulation performing reliably on real patients. The gap between simulated failure modes and real surgical complications is the gap that will determine whether this approach delivers on its promise.
For now, Nvidia has given the healthcare robotics community a faster way to ask better questions. The answers will take longer to arrive.
For more on how simulation is reshaping medical training and device development, see AI in drug discovery and healthcare robotics trends.
CyberSecurity7 months ago
How To6 months ago
How To6 months ago
How To4 months ago
How To5 months ago
How To6 months ago
Social Media7 months ago