OpenResearchAlpha

Frontiers in Artificial Intelligence · 18 Nov 2026

Accessing the universe via algorithm: a baseline study for automating alt-text generation with NASA data and AI

Jessica Schonhut-Stasik, Tom Sgouros, Kimberly Arcand, Areshva Aisha Mir, Tianze Hua, Anna Ohrt, Sarah Kane, Nancy Wolk

0
Citations
no database records one yet
0
Citations in 2026
so far
–
Leading author's h-index
no author has a profile yet
37
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0
  • Crossref0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

Introduction “Alt-text” is a textual substitute for visual information on digital platforms, primarily by users of screen readers. Effective image description is crucial for inclusive, accessible communication; unfortunately, alt-text creation is often limited by the time and skill constraints of the humans writing it. This baseline study aimed to develop an AI-driven method to semi-automate alt-text generation, with minimal expert moderation, for publicly released science images from NASA's Chandra X-ray Observatory. Methods We used pre-trained vision-language models and image metadata to generate alt-text; however, we found the results to be unreliable with this method alone. We iterated the process to include a two-tier fact-checking system of “exogenous” and “endogenous” checks to ensure the alt-text accurately represented the image and image caption. We then evaluated the alt-texts by using an automated “rubric” and investigated the tool's ability to discern “Good” from “Bad” alt-text using developed examples. Results We compared these scores with human evaluators and found that although human and AI scoring does not always agree, the AI rarely rates alt-text low when a human rates it high, indicating that the AI is proficient at noticing high-quality alt-text. Furthermore, our quantified multi-dimensional evaluation step enables adaptability to automated corrections or training improvements. Finally, we find that although the resulting alt-texts still need human editing, the time required for this (compared with writing the alt-text from scratch) reduces the human time burden by 96%. Discussion This multistage approach aligns with current AI research and demonstrates the role AI can play in creating alt-text for large scientific datasets, while our findings reinforce the importance of using these tools alongside human expertise. In addition to performing the research, we add our real-world results to the Chandra X-ray Observatory public database to improve access to the images.

What the data shows

  • No database records a citation yet, as is usual for a paper this new.

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (8)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (37)

What it cites, from open citation data, with Crossref's record of each.

Automatic Alt-text
Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · 2017
244

Sign in to see 17 more references

A free account opens the rest of the citing papers and references on every paper’s page.

Accessing the universe via algorithm: a baseline study for automating alt-text generation with NASA data and AI - QAI OpenResearch