JMIR Medical Informatics · 13 Nov 2026
Interpretable Recalibration of a Sequential Organ Failure Assessment–Derived Score Using Machine Learning–Guided Optimization: Multicenter Cohort Study
Juan Dueñas-Ruizh-index 1, Yanelis Manzano Nieves, Anny María Hernández Cuello, Jaime Azpiazu Saiz, Ancor Sanz-García, Agustín Mayo-Íscar, Francisco Martín-Rodríguez, Isabel de la Torreh-index 53
Citations by database
Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.
- OpenCitations0
- Crossref0
- Europe PMC0
Citations per year
The current year is still counting.
- 2026 so far0
Abstract
Abstract Background The Sequential Organ Failure Assessment (SOFA) score is central to risk stratification in intensive care units (ICUs), but its thresholds and 0- to 4-point increments were set by expert consensus in 1996 and never reestimated from outcome data. Machine learning models discriminate better while discarding the additive, point-based structure that makes SOFA auditable at the bedside, and methods for updating a legacy score rather than replacing it remain scarce. Objective This study aimed to develop and internally validate a data-driven recalibration of a SOFA-derived score that learns thresholds and integer weights from outcome data while preserving an additive, interpretable point-based structure and to test whether it improves discrimination for ICU mortality over a prespecified SOFA-derived reference score. Methods We conducted a retrospective multicenter cohort study using the eICU Collaborative Research Database (208 US hospitals, 2014‐2015). We analyzed 14,848 adult first ICU admissions with complete day 1 SOFA-related measurements; 133,684 (90%) of 148,532 encounters with outcome data were excluded because of at least 1 missing determination. As vasoactive dose units could not be harmonized and urine output was largely unavailable, a prespecified SOFA-derived reference score served as the comparator. The framework couples supervised discretization (univariate decision trees and interval number chosen by a penalized validation criterion) with constrained integer-weight optimization under monotonicity, integrality, and scale-anchoring constraints, plus logistic calibration. Performance was estimated from pooled out-of-fold predictions of 10-fold nested cross-validation grouped by hospital, with bootstrap CIs; final thresholds and weights were refit on the full cohort and contributed no performance estimate. Results ICU mortality was 17.03% (2529/14,848). The recalibrated score achieved an area under the receiver operating characteristic curve (AUROC) of 0.811 (95% CI 0.800‐0.819) versus 0.751 (95% CI 0.740‐0.761) for the reference score (paired difference 0.059, 95% CI 0.053‐0.067), and an area under the precision-recall curve of 0.495 (95% CI 0.477‐0.515) versus 0.393 (95% CI 0.377‐0.411; paired difference 0.102, 95% CI 0.087‐0.116). Improvement was consistent across all 10 hospital-grouped folds and length-of-stay strata. After unweighted logistic recalibration, global calibration was adequate; the Brier score was lower (0.112 vs 0.123), whereas other calibration-error measures were higher. Discrimination approached unconstrained XGBoost (Extreme Gradient Boosting; AUROC 0.818) and exceeded penalized logistic regression (AUROC 0.775) fitted on the same folds. The advantage persisted in all 1000 resampling replications and in a prespecified sensitivity analysis expanding the cohort to 61,469 encounters (median paired AUROC difference 0.037). Conclusions Data-driven recalibration under explicit structural constraints can update the cutpoints and integer weights of an established clinical score without abandoning its additive, bedside-computable form and should transfer to other legacy instruments. The recalibrated score is a mortality risk model on its own 0‐71 scale; an open-source calculator is provided, and external and prospective validation is required before clinical use.
What the data shows
- No database records a citation yet, as is usual for a paper this new.
- Isabel de la Torre has the highest h-index among the authors (53).
Graph
This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.
Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.
Start with
Cited by 0 papers
Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.
References (34)
What it cites, from open citation data, with Crossref's record of each.
Sign in to see 14 more references
A free account opens the rest of the citing papers and references on every paper’s page.