Top Results for Autoregressive
XLNet is an autoregressive language model introduced in 2019 by researchers from Google Brain and Carnegie Mellon University. It uses permutation language modeling, predicting tokens under varied factorization orders so that training can capture bidirectional context without masking input tokens in...
Why this score
Important pretraining advance that beat BERT on many tasks; complex training limited lasting dominance.
Scoring methodology
Parti (Pathways Autoregressive Text-to-Image) is a text-to-image artificial intelligence model developed by Google Research and introduced in 2022. Unlike diffusion-based models that generate images iteratively from noise, Parti treats image generation as a sequence-to-sequence translation task usin...
Why this score
Notable autoregressive text-to-image research; strong results, less influential than diffusion-based Imagen and Stable Diffusion.
Scoring methodology
