Artificial Intelligence

Australia warns doctors: AI scribing tools pose privacy and safety risks as use surges

Published

on

AI scribes are everywhere in Australian clinics. Regulators are scrambling to catch up.

Australian health authorities have issued a blunt warning to doctors about the rapid spread of AI-powered scribing tools in clinics. The technology, which records and summarises doctor-patient conversations into clinical notes, has exploded in popularity. But regulators say oversight has not kept pace.

Internal government documents, obtained by The Guardian through freedom of information requests, reveal that Australia’s federal health department sees significant risks tied to AI scribing tools. Briefing papers prepared for Senate Estimates in February 2026 describe the technology as operating with “little oversight.” Some vendors, the documents note, market their products as falling outside existing medical device regulations — even though they are used in real clinical settings.

Adoption has nearly doubled in 18 months

The numbers tell a stark story. An online survey by the Royal Australian College of General Practitioners (RACGP) found that the share of Australian doctors using AI scribes jumped from 22 percent in August 2024 to 40 percent by November 2025. That is nearly double in just over a year.

Tech providers claim their platforms have processed hundreds of millions of consultations globally over the past 18 months. The appeal is obvious. AI scribes reduce the administrative burden of note-taking, letting doctors focus on patients instead of screens. The health department acknowledges the tools can improve productivity and help cut burnout.

But the same documents warn that these systems inherit the flaws of the large language models they run on. Errors in transcription or summarisation are not hypothetical. They could affect patient safety, clinical accountability, and the quality of data flowing into Australia’s digital health infrastructure.

Privacy and consent: two big unknowns

Privacy is where the alarm bells ring loudest. Officials found that some vendors claim their products are privacy-compliant while offering little transparency about how patient data is actually handled. In some cases, healthcare providers may not even know that patient conversations are being transmitted to cloud servers outside Australia.

That is a serious concern. Sensitive medical information stored abroad may face different legal protections — or none at all.

Patient consent is another flashpoint. The government found huge variation in how clinics obtain permission before recording consultations. Meaningful informed consent, officials argue, requires patients to understand both the benefits and the limitations of AI-assisted documentation. Consumer groups have reported instances where patients were told they would need to find another doctor if they refused to have AI scribes used during their appointments. That is not consent — that is coercion.

Marketing claims under scrutiny

The health department also questioned vendor claims that AI scribes can boost doctor revenue by roughly 30 percent without longer hours or more patients. Officials worry that if higher billing becomes the main incentive for adoption, it could have knock-on effects on Australia’s publicly funded Medicare system.

Who is watching the watchers?

Regulatory oversight is currently split between three bodies: the Therapeutic Goods Administration (TGA), the Australian Health Practitioner Regulation Agency (Ahpra), and the Office of the Australian Information Commissioner. That fragmentation makes coherent oversight difficult.

The TGA is now reviewing whether AI scribes should be formally classified as medical devices. That decision, expected in the coming months, could bring many platforms under much stricter rules. If the TGA says yes, vendors will face tougher requirements around safety, accuracy, and transparency.

For now, the government is urging doctors to proceed with caution. The warning is clear: just because a tool is popular does not mean it is safe.

What this means beyond Australia

This is not just an Australian story. The same tensions are playing out in healthcare systems around the world. AI scribes promise to cut paperwork and give doctors more time with patients. But governments are being forced to ask harder questions about privacy, accuracy, and accountability when artificial intelligence becomes part of medical decision-making.

The Australian warning is a signal. Regulators are watching. And the era of unchecked AI adoption in healthcare may be coming to an end.

Leave a Reply

Your email address will not be published. Required fields are marked *

Trending

Exit mobile version