However, RMIT experts question whether AI technology is truly ready for healthcare settings and whether the sector itself is prepared to adopt these advanced tools.
Dean of the School of Computing Technologies at RMIT University Professor Karin Verspoor warns that current AI technologies are not yet “medical grade” and could pose risks if used as a “Dr ChatGPT” resource.
She explains that generative AI systems, particularly commercial ones not trained specifically for clinical knowledge, integrate information from a wide range of sources, from anecdotal data to medical literature. They also lack access to electronic health records, making the reliability of their information unclear.
Professor Verspoor points out that while AI-assisted dictation tools have been used in clinical practice for many years, the newer versions that rely on generative AI introduce significant uncertainty.
“While this can work well when systems are directly adapted to specific contexts and use cases, there is insufficient evidence about just how well they work in real-world clinical contexts,” she says.
She highlights a recent study in NEJM Catalyst that documented errors and confabulations by AI. More research is needed to understand their impact on patient experience, clinician behaviour, and clinical workflows.
“More targeted tools are needed, that can be tailored to specific types of clinical questions, and be probed for accuracy and robustness.”
Read also: How technology is enhancing patient interaction
Similarly, Professor Vishaal Kishore, Executive Director of the RMIT-Cisco Health Transformation Lab, acknowledges AI’s potential in healthcare but urges caution.
He notes that while AI can support clinical decisions, there are significant challenges related to its efficacy, cybersecurity, and integration with existing systems.
“The healthcare sector is already teeming with emerging AI-driven innovations, from automated diagnostics to predictive analytics. The real challenge lies in integration and humility: recognising AI’s limitations, while building resilient, adaptable systems that are prepared to harness its power without losing sight of the human element.” he says, stressing the importance of redesigning care models to blend digital tools with human expertise.
Ultimately, both experts agree that while AI offers immense promise, it must be approached with humility and caution, ensuring that technology serves as a support system rather than a replacement for the irreplaceable human touch in healthcare.
A new knowledge platform and website aimed at assisting the communications industry and its professionals. Contribute your op-ed, press releases, how-to articles, videos and infographics at media@commsroom.co
Public feedback drives the 2024 Telecommunications Review
Read more