arXiv · 30 Sept 2026
Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps
Yeongmin Kim, Arnaud Douceth-index 73, Andrew Campbell, Valentin De Bortoli, Thomas Mensink, David Ruhe
Citations by database
Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.
- OpenCitations0
- OpenAlex0
Citations per year
The current year is still counting.
- 2026 so far0
Abstract
We present Gumbel Straight Flow (GSF), a continuous flow map language model that leverages the noise-data coupling of a pretrained autoregressive language (AR) model. We theoretically demonstrate that the coupling between Gumbel noise and one-hot token sequences induced by an autoregressive model yields non-intersecting linear paths connecting the noise to the sequence representations. To further enhance high-quality few-step path sampling, we use a flow map semigroup objective where the tangent (velocity) condition is guided directly by the AR teacher. Across various benchmarks, including pretraining and downstream tasks, GSF can outperform current few-step language generation baselines.
What the data shows
- No database records a citation yet, as is usual for a paper this new.
- Arnaud Doucet has the highest h-index among the authors (73).
Graph
This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.
Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.
Start with
Cited by 0 papers
Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.
References (0)
What it cites, from open citation data, with Crossref's record of each.