Explaining the output of ensembles in medical decision support on a case by case basis

Robert Wall, Pádraig Cunningham, Paul Walsh, Stephen Byrne

Research output: Contribution to journalArticle

28 Citations (Scopus)

Abstract

The use of ensembles in machine learning (ML) has had a considerable impact in increasing the accuracy and stability of predictors. This increase in accuracy has come at the cost of comprehensibility as, by definition, an ensemble model is considerably more complex than its component models. This is of significance for decision support systems in medicine because of the reluctance to use models that are essentially black boxes. Work on making ensembles comprehensible has so far focused on global models that mirror the behaviour of the ensemble as closely as possible. With such global models there is a clear tradeoff between comprehensibility and fidelity. In this paper, we pursue another tack, looking at local comprehensibility where the output of the ensemble is explained on a case-by-case basis. We argue that this meets the requirements of medical decision support systems. The approach presented here identifies the ensemble members that best fit the case in question and presents the behaviour of these in explanation.

Original languageEnglish (US)
Pages (from-to)191-206
Number of pages16
JournalArtificial Intelligence in Medicine
Volume28
Issue number2
DOIs
StatePublished - Jun 2003
Externally publishedYes

Fingerprint

Systems Analysis
Decision support systems
Medicine
Learning systems
Mirrors
Machine Learning

Keywords

  • Anticoagulant drug therapy
  • Bronchiolitis
  • Medical decision support
  • Neural networks
  • Rules

ASJC Scopus subject areas

  • Artificial Intelligence
  • Medicine(all)

Cite this

Explaining the output of ensembles in medical decision support on a case by case basis. / Wall, Robert; Cunningham, Pádraig; Walsh, Paul; Byrne, Stephen.

In: Artificial Intelligence in Medicine, Vol. 28, No. 2, 06.2003, p. 191-206.

Research output: Contribution to journalArticle

Wall, Robert ; Cunningham, Pádraig ; Walsh, Paul ; Byrne, Stephen. / Explaining the output of ensembles in medical decision support on a case by case basis. In: Artificial Intelligence in Medicine. 2003 ; Vol. 28, No. 2. pp. 191-206.
@article{27a8628af66f473a8872b3938fc6a333,
title = "Explaining the output of ensembles in medical decision support on a case by case basis",
abstract = "The use of ensembles in machine learning (ML) has had a considerable impact in increasing the accuracy and stability of predictors. This increase in accuracy has come at the cost of comprehensibility as, by definition, an ensemble model is considerably more complex than its component models. This is of significance for decision support systems in medicine because of the reluctance to use models that are essentially black boxes. Work on making ensembles comprehensible has so far focused on global models that mirror the behaviour of the ensemble as closely as possible. With such global models there is a clear tradeoff between comprehensibility and fidelity. In this paper, we pursue another tack, looking at local comprehensibility where the output of the ensemble is explained on a case-by-case basis. We argue that this meets the requirements of medical decision support systems. The approach presented here identifies the ensemble members that best fit the case in question and presents the behaviour of these in explanation.",
keywords = "Anticoagulant drug therapy, Bronchiolitis, Medical decision support, Neural networks, Rules",
author = "Robert Wall and P{\'a}draig Cunningham and Paul Walsh and Stephen Byrne",
year = "2003",
month = "6",
doi = "10.1016/S0933-3657(03)00056-3",
language = "English (US)",
volume = "28",
pages = "191--206",
journal = "Artificial Intelligence in Medicine",
issn = "0933-3657",
publisher = "Elsevier",
number = "2",

}

TY - JOUR

T1 - Explaining the output of ensembles in medical decision support on a case by case basis

AU - Wall, Robert

AU - Cunningham, Pádraig

AU - Walsh, Paul

AU - Byrne, Stephen

PY - 2003/6

Y1 - 2003/6

N2 - The use of ensembles in machine learning (ML) has had a considerable impact in increasing the accuracy and stability of predictors. This increase in accuracy has come at the cost of comprehensibility as, by definition, an ensemble model is considerably more complex than its component models. This is of significance for decision support systems in medicine because of the reluctance to use models that are essentially black boxes. Work on making ensembles comprehensible has so far focused on global models that mirror the behaviour of the ensemble as closely as possible. With such global models there is a clear tradeoff between comprehensibility and fidelity. In this paper, we pursue another tack, looking at local comprehensibility where the output of the ensemble is explained on a case-by-case basis. We argue that this meets the requirements of medical decision support systems. The approach presented here identifies the ensemble members that best fit the case in question and presents the behaviour of these in explanation.

AB - The use of ensembles in machine learning (ML) has had a considerable impact in increasing the accuracy and stability of predictors. This increase in accuracy has come at the cost of comprehensibility as, by definition, an ensemble model is considerably more complex than its component models. This is of significance for decision support systems in medicine because of the reluctance to use models that are essentially black boxes. Work on making ensembles comprehensible has so far focused on global models that mirror the behaviour of the ensemble as closely as possible. With such global models there is a clear tradeoff between comprehensibility and fidelity. In this paper, we pursue another tack, looking at local comprehensibility where the output of the ensemble is explained on a case-by-case basis. We argue that this meets the requirements of medical decision support systems. The approach presented here identifies the ensemble members that best fit the case in question and presents the behaviour of these in explanation.

KW - Anticoagulant drug therapy

KW - Bronchiolitis

KW - Medical decision support

KW - Neural networks

KW - Rules

UR - http://www.scopus.com/inward/record.url?scp=0042669840&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0042669840&partnerID=8YFLogxK

U2 - 10.1016/S0933-3657(03)00056-3

DO - 10.1016/S0933-3657(03)00056-3

M3 - Article

C2 - 12893119

AN - SCOPUS:0042669840

VL - 28

SP - 191

EP - 206

JO - Artificial Intelligence in Medicine

JF - Artificial Intelligence in Medicine

SN - 0933-3657

IS - 2

ER -