“…..AI algorithms used for diagnosis and prognosis must be explainable and must not rely on a black box…..”.
The lack of explainability/interpretability: An “elephant in the room”
EU General Data Protection Regulation (GDPR): Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), OJ 2016 L 119/1.
AI applications with “intrinsic usability”: Moving the elephant out
Stop ignoring the elephant!
Post-hoc explainability: Is it really a solution?
EU General Data Protection Regulation (GDPR): Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), OJ 2016 L 119/1.
- Carrara M.
- Massari E.
- Cicchetti A.
- Giandini T.
- Avuzzi B.
- Palorini F.
- et al.
Beyond post-hoc interpretation. Interpretability-driven models: First build the model, then fit it to data
Reducing the elephant size: Guiding out of the black-box
- Carrara M.
- Massari E.
- Cicchetti A.
- Giandini T.
- Avuzzi B.
- Palorini F.
- et al.
Some concluding remarks: The elephant unveiled
References
- AI in medicine must be explainable.Nat Med. 2021; 27: 1328
https://en.wikipedia.org/wiki/Shinjini_Kundu.
- The practical implementation of artificial intelligence technologies in medicine.Nat Med. 2019; 25: 30-36
- High-performance medicine: the convergence of human and artificial intelligence.Nat Med. 2019; 25: 44-56
- Artificial intelligence in medicine: current trends and future possibilities.Brit J Gen Pract. 2018; 68: 143-144
- The reproducibility crisis in the age of digital medicine. npj Digit.Med. 2019; 2
- Machine learning and prediction in medicine-beyond the peak of inflated expectations.N Engl J Med. 2017; 376: 2507-2509
EU General Data Protection Regulation (GDPR): Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation), OJ 2016 L 119/1.
- Do no harm: a roadmap for responsible machine learning for health care.Nature Med. 2019; 25: 1337-1340
Holzinger A, Langs G, Denk H, Zatloukal K, Müller H. Causability and explainability of artificial intelligence in medicine (2019) Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 2019;9(4):art. no. e1312.
- What clinicians want: contextualizing explainable machine learning for clinical end use.PMLR. 2019; : 1-21
- The role of computational methods for automating and improving clinical target volume definition.Radiother Oncol. 2020; 153: 15-25
Wang G, Zhang Y, Ye X, Mou X. Machine learning for tomographic imaging. IOP Publishing, 2020 Bristol, UK.
- A review on applications of deep learning algorithms in external beam radiotherapy automated treatment planning.Front Oncol. 2020; 19: art 580919
- Implementation of automatic plan optimization in Italy: status and perspectives.Phys Med. 2021; 92: 86-94
- Grand challenges for medical physics in radiation oncology.Radiother Oncol. 2020; 153: 7-14
- Technology‐driven research for radiotherapy innovation.Mol Oncol. 2020; 14: 1500-1513
- Physics and medicine: an historical perspective.The Lancet. 2011; 379: 1517-1524
- Procurement, commissioning and QA of AI based solutions: An MPE’s perspective on introducing AI in clinical practice.Phys Med. 2021; 83: 257-263
- The EU medical device regulation: Implications for artificial intelligence-based medical device software in medical physics.Phys Med. 2021; 83: 1-8
- Requirements and reliability of AI in the medical context.Phys Med. 2021; 83: 72-78
- Expanding the medical physicist curricular and professional programme to include Artificial Intelligence.Phys Med. 2021; 83: 174-183
- Development of a ready-to-use graphical tool based on artificial neural network classification: application for the prediction of late fecal incontinence after prostate cancer radiation therapy.Int J Radiat Oncol Biol Phys. 2018; 102: 1533-1542
- The linear quadratic model: usage, interpretation and challenges.Phys Med Biol. 2018; 64: 01TR01
- A TCP-based early regression index predicts the pathological response in neo-adjuvant radio-chemotherapy of rectal cancer.Radiother Oncol. 2018; 128: 564-568
- Prospective evaluation of a tumor control probability model based on dynamic 18F-FMISO PET for head and neck cancer radiotherapy.J Nucl Med. 2019; 60: 1698-1704
- Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement.Ann Intern Med. 2015; 162: 55-63
- Radiomics: the bridge between medical imaging and personalized medicine.Nat Rev Clin Oncol. 2017; 14: 749-762
Astaraki M, Yang G, Zakko Y, Toma-Dasu I, Smedby Ö, Wang C. A comparative study of radiomics and deep-learning based methods for pulmonary nodule malignancy prediction in low dose CT images. Front Oncol 2021;11:art. no. 737368.
- The medical AI insurgency: what physicians must know about data to practice with intelligent machines.npj Digit Med. 2019; 2: 62
- Embracing phenomenological approaches to normal tissue complication probability modelling: a question of method.Int J Radiat Oncol Biol Phys. 2015; 91: 468-471
- Applied artificial intelligence and trust: the case of autonomous vehicles and medical assistance devices.Techn Forecast Soc Changes. 2016; 105: 105-120