bioRxiv · 12 Nov 2026
RNAtomy: A Structure-Aware RNA Foundation Model for Transferable Structural and Functional Representations
A. Shirali, I. Garg, A. Vasilyev, P. Soni, P. Govindasamy, K. Mathee, P. Chapagain, G. Narasimhan
Citations by database
Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.
- OpenCitations0
Citations per year
The current year is still counting.
- 2026 so far0
Abstract
RNA plays a critical and diverse role in gene expression, catalysis, regulation, and molecular recognition. This functional versatility arises from the interplay between nucleotide sequence, structural organization, and cellular context. Nevertheless, most RNA foundation models are pretrained primarily using sequence or secondary-structure information, while the systematic integration of three-dimensional geometric and conformational features remains comparatively underexplored. Here, we introduce RNAtomy, a self-supervised RNA foundation model designed to learn the structural anatomy of RNA from inter-nucleotide geometry and residue-level conformational descriptors. Its design has three main components: 1) joint masked reconstruction of pairwise geometry and residue-level descriptors to connect spatial organization with local conformation; 2) a hybrid Mamba-Transformer backbone in which Mamba blocks efficiently propagate global context, while shifted-window attention compensates for the absence of explicit content-dependent token interactions in Mamba by modeling relationships within local regions of the pairwise map; and 3) axis-aware feature-wise linear modulation that maps nucleotide-level conformations to the row and column axes of pairwise geometry. We assess RNAtomy across seven diverse tasks involving structural and functional predictions at the nucleotide, nucleotide-pair, and RNA levels. RNAtomy achieved particularly strong performance on structural tasks, outperforming established RNA foundation models and task-specific approaches in contact and long-range base-pair prediction. Its representations also transferred effectively to interaction-related tasks, despite the substantial differences between these applications and the structural pretraining objective. On functional tasks, RNAtomy achieved superior performance in translation-related prediction and regulatory-element identification. Notably, RNAtomy achieved these results despite being pretrained on a substantially smaller training set than the RNA foundation models used as baselines. Together, these results highlight how rich structural information, when learned through an expressive architecture, can support transferable RNA representations across biologically distinct structural and functional applications.
What the data shows
- No database records a citation yet, as is usual for a paper this new.
Graph
This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.
Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.
Start with
Cited by 0 papers
Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.
References (0)
What it cites, from open citation data, with Crossref's record of each.