Evaluating both AI algorithms and human users is key for safe adoption in high-stakes healthcare settings, according to an Ohio State study.
Key Details
- 1Researchers studied 462 nursing students and professionals using AI-assisted patient monitoring simulations.
- 2Accurate AI predictions improved decision making by up to 60%, but inaccurate AI caused over a 100% drop in correct decisions.
- 3Explanations and supporting data had minimal impact; participants were highly influenced by AI predictions.
- 4The study calls for simultaneous evaluation of both algorithms and clinical users in safety-critical settings.
- 5Findings appear in npj Digital Medicine (DOI: 10.1038/s41746-025-01784-y).
Why It Matters
This work highlights the risks of over-reliance on AI in clinical workflows and underscores the necessity for robust, joint evaluation protocols in radiology and other safety-critical healthcare applications, ensuring that human-AI teams can handle both good and poor system performance.
Source
EurekAlert
Related News
•EurekAlert
AI Pathology Tool SÉMIL Improves Stage II Bowel Cancer Risk Assessment
A La Trobe University-developed AI tool accurately predicts relapse risk in stage II bowel cancer using digital pathology images and descriptions.
•EurekAlert
AI-Guided Handheld Cardiac Ultrasound Reduces Referrals and Costs in Spain
AI-guided handheld cardiac ultrasound enables primary care physicians to detect heart failure, reducing specialist referrals and saving costs.
•EurekAlert
AI Tool Predicts Which Rectal Cancer Patients Benefit from Intensive Therapy
UCL researchers developed an AI that analyzes biopsy slides to identify rectal cancer patients who benefit from adding irinotecan to standard chemoradiotherapy.