OpenResearchAlpha

Proceedings of the National Academy of Sciences · 19 Nov 2026

Preemptive solving of future problems: Multitask Preplay in humans and machines

Wilka Carvalhoh-index 0, Sam Hall-McMaster, Honglak Lee, Samuel J. Gershmanh-index 42

3
Citations
OpenAlex's count; others 0
0
Citations in 2026
so far
42
Leading author's h-index
Samuel J. Gershman, in QAI's scholar index
22
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenAlex3
  • OpenCitations0
  • Crossref0
  • Europe PMC0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

Humans can pursue a near-infinite variety of tasks, but typically can only pursue a small number at the same time. We hypothesize that humans leverage experience on one task to preemptively learn solutions to other tasks that were accessible but not pursued. We formalize this idea as “Multitask Preplay”, an algorithm that replays experience on one task as the starting point for “preplay”—counterfactual simulation of an accessible but unpursued task. Preplay is used to learn a predictive representation that can support fast, adaptive task performance later on. When implemented within deep reinforcement learning, it predicts human generalization to novel tasks more accurately than traditional planning and predictive representation methods across grid-worlds and a 2D Minecraft domain. Additionally, Multitask Preplay improves an artificial agent’s ability to generalize to new environments sharing task co-occurrence structure. These findings demonstrate that Multitask Preplay is a scalable theory of human counterfactual learning and generalization; endowing artificial agents with this capacity can significantly improve their performance in challenging multitask environments.

What the data shows

  • OpenAlex counts 3 citations, the most of the databases. The others count 0.
  • Samuel J. Gershman has the highest h-index among the authors (42).

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (4)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (22)

What it cites, from open citation data, with Crossref's record of each.

Sign in to see 2 more references

A free account opens the rest of the citing papers and references on every paper’s page.

Preemptive solving of future problems: Multitask Preplay in humans and machines - QAI OpenResearch