OpenResearchAlpha

bioRxiv · 4 Nov 2026

Explainable Multimodal Prognostic Modeling Uncovers New Clinically Relevant Pathological Features in a Multi-Institutional Pancreatic Neuroendocrine Tumor Cohort

A. Sivasubramanian, M. Salimian, J. R. Vennapusa, L. Dequiedt, Y. Shen, V. Matos Romero, Y. Zhu, U.-A. Ebong, Z. Gaillard, I. Reucroft, H.-N. Yun, S.-M. Hong, J. Shin, A. Kasajima, G. Klöppel, J. He, R. H. Hruban, A. L. Kiemen

0
Citations
no database records one yet
0
Citations in 2026
so far
–
Leading author's h-index
no author has a profile yet
0
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

Although many patients with a well-differentiated pancreatic neuroendocrine tumor (PanNET) are cured after surgical resection, it is hard to predict outcome in these patients. Current prognostic assessment relies largely on Ki-67 proliferation index, tumor stage, and established adverse pathologic features, such as vascular and perineural invasion. However, individually, these variables incompletely explain why patients with similar clinicopathologic profiles sometimes experience markedly different outcomes. To address this challenge, we assembled three independent cohorts with a surgically resected PanNET. In total, we included 1,438 patients with approximately 30,000 histology images, and approximately 12,000 person-years of follow-up. We separately modeled structured clinicopathologic information with Cox regression and tumor-centered pathology images with deep learning on an internal cohort treated at Johns Hopkins Hospital and performed multimodal continuous-time survival modeling to reveal which clinical and pathologic features are most important in predicting patient outcome. Across Cox models of censored time to recurrence-free survival, a text-based clinicopathological model that incorporated known prognosticators achieved a C-index of approximately 0.87, the image-based histology model approximately 0.80, and decision-level late multimodal fusion approximately 0.88 on the internal test set. The clinical model demonstrated strong prognostic discrimination using established risk factors, mainly relying on the TNM stage and Ki-67 index. Primary tumor histology retained substantial prognostic signal, with analysis restricted to tumor-centered regions to reduce reliance on unrelated tissues that might indirectly indicate disease extent. Interpretation of high-attention image tiles revealed regions of importance in the primary tumor, including recognized adverse morphologic features such as the leading edge of the tumor and foci of vascular or perineural invasion. Unexpectedly, intratumoral and peritumoral stroma accounted for nearly 50% of the model's high-attention regions, suggesting that the stroma may yield equal prognostic information to neoplastic cells in recurrence-prediction models. To test generalizability, we further evaluated the trained models in independent cohorts from two institutions with different demographics, where discrimination varied by site (mean late-fusion C-indices of 0.864 and 0.723). Together with the improved discrimination achieved through late fusion, our findings suggest that current clinicopathologic variables can be modeled to form reliable prognosticators, and that routine hematoxylin and eosin (H&E) stained slides of the primary tumor contain additional prognostically important information not fully captured by conventional clinicopathologic assessment, such that together, the two sources provide complementary information.

Pathology

What the data shows

  • No database records a citation yet, as is usual for a paper this new.

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (18)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (0)

What it cites, from open citation data, with Crossref's record of each.

No references in the open citation data yet.