English
Related papers

Related papers: Normalizing Flows with Multi-Scale Autoregressive …

200 papers

There exists recent work in computer vision, named VAR, that proposes a new autoregressive paradigm for image generation. Diverging from the vanilla next-token prediction, VAR structurally reformulates the image generation into a coarse to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Sucheng Ren , Yaodong Yu , Nataniel Ruiz , Feng Wang , Alan Yuille , Cihang Xie

Recent years witnessed the development of powerful generative models based on flows, diffusion or autoregressive neural networks, achieving remarkable success in generating data from examples with applications in a broad range of areas. A…

Disordered Systems and Neural Networks · Physics 2024-07-22 Davide Ghio , Yatin Dandi , Florent Krzakala , Lenka Zdeborová

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

Deep autoregressive models are one of the most powerful models that exist today which achieve state-of-the-art bits per dim. However, they lie at a strict disadvantage when it comes to controlled sample generation compared to latent…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Wilson Yan , Jonathan Ho , Pieter Abbeel

Molecular generation conditioned on textual descriptions is a fundamental task in computational chemistry and drug discovery. Existing methods often struggle to simultaneously ensure high-quality, diverse generation and fast inference. In…

Machine Learning · Computer Science 2025-08-08 Md Atik Ahamed , Qiang Ye , Qiang Cheng

Generative models can produce nonsensical text, unrealistic images, and unstable materials faster than simulation or human review can absorb; without per-sample confidence, trust erodes. Existing fixes run $k$ ensembles or stochastic…

Machine Learning · Statistics 2026-05-19 Friso de Kruiff , Dario Coscia , Max Welling , Erik Bekkers

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Each training step for a variational autoencoder (VAE) requires us to sample from the approximate posterior, so we usually choose simple (e.g. factorised) approximate posteriors in which sampling is an efficient computation that fully…

Machine Learning · Statistics 2018-05-29 Laurence Aitchison , Vincent Adam , Srinivas C. Turaga

We introduce a new paradigm for AutoRegressive (AR) image generation, termed Set AutoRegressive Modeling (SAR). SAR generalizes the conventional AR to the next-set setting, i.e., splitting the sequence into arbitrary sets containing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wenze Liu , Le Zhuo , Yi Xin , Sheng Xia , Peng Gao , Xiangyu Yue

We introduce a novel generative model for video prediction based on latent flow matching, an efficient alternative to diffusion-based models. In contrast to prior work, we keep the high costs of modeling the past during training and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Aram Davtyan , Sepehr Sameni , Paolo Favaro

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Arpit Sahni , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

Diffusion models promise efficient parallel text generation but rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregressive (AR) models. This incompatibility precludes reusing robust AR priors,…

Computation and Language · Computer Science 2026-05-29 Xiangyu Ma , Teng Xiao , Zuchao Li , Lefei Zhang

Non-autoregressive (NAR) language models offer notable efficiency in text generation by circumventing the sequential bottleneck of autoregressive decoding. However, accurately modeling dependencies in discrete sequences remains challenging…

Computation and Language · Computer Science 2026-05-05 Egor Sevriugov , Nikita Dragunov , Anton Razzhigaev , Andrey Kuznetsov , Ivan Oseledets

Generative modeling seeks to uncover the underlying factors that give rise to observed data that can often be modeled as the natural symmetries that manifest themselves through invariances and equivariances to certain transformation laws.…

Machine Learning · Computer Science 2022-08-16 Avishek Joey Bose , Marcus Brubaker , Ivan Kobyzev

Recent advancements in artificial intelligence have created transformative capabilities in image synthesis and generation, enabling diverse research fields to innovate at revolutionary speed and spectrum. In this study, we leverage this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Juhyung Park , Rokgi Hong , Roh-Eul Yoo , Jaehyeon Koo , Se Young Chun , Seung Hong Choi , Jongho Lee

Accurate channel state information (CSI) is vital for multiple-input multiple-output (MIMO) systems. However, superimposed pilots (SIP), which reduce overhead, introduce severe pilot contamination and data interference, complicating joint…

Signal Processing · Electrical Eng. & Systems 2026-02-26 Ruhao Zhang , Yupeng Li , Yitong Liu , Shijian Gao , Jing Jin , Hongwen Yang , Jiangzhou Wang

Accelerated magnetic resonance (MR) imaging attempts to reduce acquisition time by collecting data below the Nyquist rate. As an ill-posed inverse problem, many plausible solutions exist, yet the majority of deep learning approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-06-05 Jeffrey Wen , Rizwan Ahmad , Philip Schniter

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Defect segmentation is central to computer vision based inspection of infrastructure assets during both construction and operation. However, deployment remains limited due to scarce pixel-level labels and domain shift across environments.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Babak Asadi , Peiyang Wu , Mani Golparvar-Fard , Ramez Hajj

Recent progress in brain-guided image generation has improved the quality of fMRI-based reconstructions; however, fundamental challenges remain in preserving object-level structure and semantic fidelity. Many existing approaches overlook…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Mohammad Moradi , Morteza Moradi , Marco Grassia , Giuseppe Mangioni