OpenResearchAlpha

JMIR Medical Informatics · 13 Nov 2026

Interpretable Recalibration of a Sequential Organ Failure Assessment–Derived Score Using Machine Learning–Guided Optimization: Multicenter Cohort Study

Juan Dueñas-Ruizh-index 1, Yanelis Manzano Nieves, Anny María Hernández Cuello, Jaime Azpiazu Saiz, Ancor Sanz-García, Agustín Mayo-Íscar, Francisco Martín-Rodríguez, Isabel de la Torreh-index 53

0
Citations
no database records one yet
0
Citations in 2026
so far
53
Leading author's h-index
Isabel de la Torre, in QAI's scholar index
34
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0
  • Crossref0
  • Europe PMC0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

Abstract Background The Sequential Organ Failure Assessment (SOFA) score is central to risk stratification in intensive care units (ICUs), but its thresholds and 0- to 4-point increments were set by expert consensus in 1996 and never reestimated from outcome data. Machine learning models discriminate better while discarding the additive, point-based structure that makes SOFA auditable at the bedside, and methods for updating a legacy score rather than replacing it remain scarce. Objective This study aimed to develop and internally validate a data-driven recalibration of a SOFA-derived score that learns thresholds and integer weights from outcome data while preserving an additive, interpretable point-based structure and to test whether it improves discrimination for ICU mortality over a prespecified SOFA-derived reference score. Methods We conducted a retrospective multicenter cohort study using the eICU Collaborative Research Database (208 US hospitals, 2014‐2015). We analyzed 14,848 adult first ICU admissions with complete day 1 SOFA-related measurements; 133,684 (90%) of 148,532 encounters with outcome data were excluded because of at least 1 missing determination. As vasoactive dose units could not be harmonized and urine output was largely unavailable, a prespecified SOFA-derived reference score served as the comparator. The framework couples supervised discretization (univariate decision trees and interval number chosen by a penalized validation criterion) with constrained integer-weight optimization under monotonicity, integrality, and scale-anchoring constraints, plus logistic calibration. Performance was estimated from pooled out-of-fold predictions of 10-fold nested cross-validation grouped by hospital, with bootstrap CIs; final thresholds and weights were refit on the full cohort and contributed no performance estimate. Results ICU mortality was 17.03% (2529/14,848). The recalibrated score achieved an area under the receiver operating characteristic curve (AUROC) of 0.811 (95% CI 0.800‐0.819) versus 0.751 (95% CI 0.740‐0.761) for the reference score (paired difference 0.059, 95% CI 0.053‐0.067), and an area under the precision-recall curve of 0.495 (95% CI 0.477‐0.515) versus 0.393 (95% CI 0.377‐0.411; paired difference 0.102, 95% CI 0.087‐0.116). Improvement was consistent across all 10 hospital-grouped folds and length-of-stay strata. After unweighted logistic recalibration, global calibration was adequate; the Brier score was lower (0.112 vs 0.123), whereas other calibration-error measures were higher. Discrimination approached unconstrained XGBoost (Extreme Gradient Boosting; AUROC 0.818) and exceeded penalized logistic regression (AUROC 0.775) fitted on the same folds. The advantage persisted in all 1000 resampling replications and in a prespecified sensitivity analysis expanding the cohort to 61,469 encounters (median paired AUROC difference 0.037). Conclusions Data-driven recalibration under explicit structural constraints can update the cutpoints and integer weights of an established clinical score without abandoning its additive, bedside-computable form and should transfer to other legacy instruments. The recalibrated score is a mortality risk model on its own 0‐71 scale; an open-source calculator is provided, and external and prospective validation is required before clinical use.

What the data shows

  • No database records a citation yet, as is usual for a paper this new.
  • Isabel de la Torre has the highest h-index among the authors (53).

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (8)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (34)

What it cites, from open citation data, with Crossref's record of each.

"Why Should I Trust You?"
Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · 2016
14,937

Sign in to see 14 more references

A free account opens the rest of the citing papers and references on every paper’s page.