Frontiers in Artificial Intelligence · 18 Nov 2026
Accessing the universe via algorithm: a baseline study for automating alt-text generation with NASA data and AI
Jessica Schonhut-Stasik, Tom Sgouros, Kimberly Arcand, Areshva Aisha Mir, Tianze Hua, Anna Ohrt, Sarah Kane, Nancy Wolk
Citations by database
Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.
- OpenCitations0
- Crossref0
Citations per year
The current year is still counting.
- 2026 so far0
Abstract
Introduction “Alt-text” is a textual substitute for visual information on digital platforms, primarily by users of screen readers. Effective image description is crucial for inclusive, accessible communication; unfortunately, alt-text creation is often limited by the time and skill constraints of the humans writing it. This baseline study aimed to develop an AI-driven method to semi-automate alt-text generation, with minimal expert moderation, for publicly released science images from NASA's Chandra X-ray Observatory. Methods We used pre-trained vision-language models and image metadata to generate alt-text; however, we found the results to be unreliable with this method alone. We iterated the process to include a two-tier fact-checking system of “exogenous” and “endogenous” checks to ensure the alt-text accurately represented the image and image caption. We then evaluated the alt-texts by using an automated “rubric” and investigated the tool's ability to discern “Good” from “Bad” alt-text using developed examples. Results We compared these scores with human evaluators and found that although human and AI scoring does not always agree, the AI rarely rates alt-text low when a human rates it high, indicating that the AI is proficient at noticing high-quality alt-text. Furthermore, our quantified multi-dimensional evaluation step enables adaptability to automated corrections or training improvements. Finally, we find that although the resulting alt-texts still need human editing, the time required for this (compared with writing the alt-text from scratch) reduces the human time burden by 96%. Discussion This multistage approach aligns with current AI research and demonstrates the role AI can play in creating alt-text for large scientific datasets, while our findings reinforce the importance of using these tools alongside human expertise. In addition to performing the research, we add our real-world results to the Chandra X-ray Observatory public database to improve access to the images.
What the data shows
- No database records a citation yet, as is usual for a paper this new.
Graph
This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.
Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.
Start with
Cited by 0 papers
Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.
References (37)
What it cites, from open citation data, with Crossref's record of each.
Sign in to see 17 more references
A free account opens the rest of the citing papers and references on every paper’s page.