OpenResearchAlpha

bioRxiv · 12 Nov 2026

RNAtomy: A Structure-Aware RNA Foundation Model for Transferable Structural and Functional Representations

A. Shirali, I. Garg, A. Vasilyev, P. Soni, P. Govindasamy, K. Mathee, P. Chapagain, G. Narasimhan

0
Citations
no database records one yet
0
Citations in 2026
so far
–
Leading author's h-index
no author has a profile yet
0
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

RNA plays a critical and diverse role in gene expression, catalysis, regulation, and molecular recognition. This functional versatility arises from the interplay between nucleotide sequence, structural organization, and cellular context. Nevertheless, most RNA foundation models are pretrained primarily using sequence or secondary-structure information, while the systematic integration of three-dimensional geometric and conformational features remains comparatively underexplored. Here, we introduce RNAtomy, a self-supervised RNA foundation model designed to learn the structural anatomy of RNA from inter-nucleotide geometry and residue-level conformational descriptors. Its design has three main components: 1) joint masked reconstruction of pairwise geometry and residue-level descriptors to connect spatial organization with local conformation; 2) a hybrid Mamba-Transformer backbone in which Mamba blocks efficiently propagate global context, while shifted-window attention compensates for the absence of explicit content-dependent token interactions in Mamba by modeling relationships within local regions of the pairwise map; and 3) axis-aware feature-wise linear modulation that maps nucleotide-level conformations to the row and column axes of pairwise geometry. We assess RNAtomy across seven diverse tasks involving structural and functional predictions at the nucleotide, nucleotide-pair, and RNA levels. RNAtomy achieved particularly strong performance on structural tasks, outperforming established RNA foundation models and task-specific approaches in contact and long-range base-pair prediction. Its representations also transferred effectively to interaction-related tasks, despite the substantial differences between these applications and the structural pretraining objective. On functional tasks, RNAtomy achieved superior performance in translation-related prediction and regulatory-element identification. Notably, RNAtomy achieved these results despite being pretrained on a substantially smaller training set than the RNA foundation models used as baselines. Together, these results highlight how rich structural information, when learned through an expressive architecture, can support transferable RNA representations across biologically distinct structural and functional applications.

Bioengineering

What the data shows

  • No database records a citation yet, as is usual for a paper this new.

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (8)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (0)

What it cites, from open citation data, with Crossref's record of each.

No references in the open citation data yet.
RNAtomy: A Structure-Aware RNA Foundation Model for Transferable Structural and Functional Representations - QAI OpenResearch