Decide-AI

By Baptiste Vasey

“Developing new reporting guidelines for the early-stage clinical evaluation of decision support systems driven by artificial intelligence.”

“Developing new reporting guidelines for the early-stage clinical evaluation of decision support systems driven by artificial intelligence.”

 

Much like IDEAL 2a/2b studies, comprehensive early formative evaluation, with an emphasis on the human users, is a necessary bridge from the development of clinical decision support systems driven by artificial intelligence (AI) to their clinical implementation. Early-stage studies are also important steppingstones toward the large-scale comparative trials needed to generate robust evidence about these systems’ effectiveness. The objective of DECIDE-AI is to improve reporting of clinical AI studies along four main axes:

  • the performance of the AI systems when first used with humans in small-scale, actual clinical settings,
  • the safety profile of the AI systems prior to large-scale utilisation,
  • the human factors (ergonomic) evaluation of the AI systems,
  • the preparatory steps towards large-scale (randomised controlled) clinical trials.

 

An international, multi stakeholder Delphi process is currently being conducted and the guidelines are expected for late 2021/early 2022.

You can read more about the project in a correspondence to the editors of Nature Medicine: https://www.nature.com/articles/s41591-021-01229-5

People:

  • From the IDEAL Collaboration: Baptiste Vasey (University of Oxford), Dr Mudathir Ibrahim (Maimonides Medical Center), Prof Bruce Campbell (University of Exeter), Prof Peter McCulloch (University of Oxford)
  • External collaborators: Myura Nagendran (Imperial College London), Prof David Clifton (University of Oxford), Prof Gary Collins (University of Oxford), Prof Alastair Denniston (University of Birmingham), Dr Livia Faes (Moorfields Eye Hospital), Dr Bart Geerts (healthplus.ai), Dr Xiaoxuan Liu (University of Birmingham), Dr Piyush Mathur (Cleveland Clinic, Ohio), Dr Lauren Morgan (Morgan Human Systems Ltd), Dr Suchi Saria (Johns Hopkins University), Dr Peter Watkinson (University of Oxford)

 

Link to the systematic review performed as part of the preliminary investigations: https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2777403

 

Contact: Baptiste Vasey, baptiste.vasey@nds.ox.ac.uk