Comparison of Classification with Reject Option Approaches on MIMIC-IV Dataset.

Gerta Salillari, Nadav Rappoport

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This work compares two machine learning approaches that use the reject option method, i.e., the possibility to abstain from outputting a prediction in case the model is not confident about it, thus rejecting the sample. We demonstrated the usability of such a model for predicting patients’ mortality risk in ICU while maintaining an adequate level of accepted samples, using data from the MIMIC-IV database. Two strategies have been compared: a single-model classifier, trained to directly predict the mortality rate of a patient in ICU and rejecting the sample if the confidence of the model is below a certain threshold, and a double-model boosted classifier which considers training a preceding model for determining whether a sample is predictable, i.e. a model classifies if the sample is going to be correctly predicted, and, only if it is, a second model outputs a mortality prediction, otherwise the sample is rejected since its prediction will likely be random. The hypothesis is that the second strategy could give better results than the first one, considering a trade-off between the error rate and the amount of rejected samples. We found that the two models are confident about two different classes: the Classifier-only Model is more confident to include in its predictions and to classify ICU staying instances in which the patient deceases, whereas the Boosted Reject Option Model considers those cases more difficult to predict, thus rejects them.

Original languageAmerican English
Title of host publicationArtificial Intelligence in Medicine - 20th International Conference on Artificial Intelligence in Medicine, AIME 2022, Proceedings
EditorsMartin Michalowski, Syed Sibte Raza Abidi, Samina Abidi
Pages210-219
Number of pages10
ISBN (Electronic)978-3-301-09342-5
DOIs
StatePublished - 9 Jul 2022
Event20th International Conference on Artificial Intelligence in Medicine, AIME 2022 - Halifax, Canada
Duration: 14 Jun 202217 Jun 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13263 LNAI

Conference

Conference20th International Conference on Artificial Intelligence in Medicine, AIME 2022
Country/TerritoryCanada
CityHalifax
Period14/06/2217/06/22

Keywords

  • Artificial intelligence
  • EHR
  • Electronic Health Record
  • Machine learning
  • Prediction models

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Comparison of Classification with Reject Option Approaches on MIMIC-IV Dataset.'. Together they form a unique fingerprint.

Cite this