English
Related papers

Related papers: Progressive Checkerboards for Autoregressive Multi…

200 papers

We introduce Autoregressive Diffusion Models (ARDMs), a model class encompassing and generalizing order-agnostic autoregressive models (Uria et al., 2014) and absorbing discrete diffusion (Austin et al., 2021), which we show are special…

Machine Learning · Computer Science 2022-02-03 Emiel Hoogeboom , Alexey A. Gritsenko , Jasmijn Bastings , Ben Poole , Rianne van den Berg , Tim Salimans

There exists recent work in computer vision, named VAR, that proposes a new autoregressive paradigm for image generation. Diverging from the vanilla next-token prediction, VAR structurally reformulates the image generation into a coarse to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Sucheng Ren , Yaodong Yu , Nataniel Ruiz , Feng Wang , Alan Yuille , Cihang Xie

A novel algorithm is proposed for segmenting an image into multiple levels using its mean and variance. Starting from the extreme pixel values at both ends of the histogram plot, the algorithm is applied recursively on sub-ranges computed…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Siddharth Arora , Jayadev Acharya , Amit Verma , Prasanta K. Panigrahi

Modeling the distribution of natural images is a landmark problem in unsupervised learning. This task requires an image model that is at once expressive, tractable and scalable. We present a deep neural network that sequentially predicts…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Aaron van den Oord , Nal Kalchbrenner , Koray Kavukcuoglu

Deep learning based single image super-resolution models have been widely studied and superb results are achieved in upscaling low-resolution images with fixed scale factor and downscaling degradation kernel. To improve real world…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Zhihong Pan , Baopu Li , Dongliang He , Mingde Yao , Wenhao Wu , Tianwei Lin , Xin Li , Errui Ding

Magnetic Resonance Image (MRI) acquisition is an inherently slow process which has spurred the development of two different acceleration methods: acquiring multiple correlated samples simultaneously (parallel imaging) and acquiring fewer…

Image and Video Processing · Electrical Eng. & Systems 2020-04-01 Anuroop Sriram , Jure Zbontar , Tullie Murrell , C. Lawrence Zitnick , Aaron Defazio , Daniel K. Sodickson

Deep metric learning maps visually similar images onto nearby locations and visually dissimilar images apart from each other in an embedding manifold. The learning process is mainly based on the supplied image negative and positive training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chang-Hui Liang , Wan-Lei Zhao , Run-Qing Chen

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Xianjun Han , Qianqian Chen , Zhaoyang Xie , Xuejun Li , Hongyu Yang

There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jiaojiao Fan , Haotian Xue , Qinsheng Zhang , Yongxin Chen

Recent advances in autoregressive (AR) models with continuous tokens for image generation show promising results by eliminating the need for discrete tokenization. However, these models face efficiency challenges due to their sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Zhihang Yuan , Yuzhang Shang , Hanling Zhang , Tongcheng Fang , Rui Xie , Bingxin Xu , Yan Yan , Shengen Yan , Guohao Dai , Yu Wang

Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such as super-resolution, inpainting, or deblurring, still require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Kushagra Pandey , Ruihan Yang , Stephan Mandt

Given a small number of images of a subject, personalized image generation techniques can fine-tune large pre-trained text-to-image diffusion models to generate images of the subject in novel contexts, conditioned on text prompts. In doing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shwetha Ram , Tal Neiman , Qianli Feng , Andrew Stuart , Son Tran , Trishul Chilimbi

Autoregressive models (ARMs) currently hold state-of-the-art performance in likelihood-based modeling of image and audio data. Generally, neural network based ARMs are designed to allow fast inference, but sampling from these models is…

Machine Learning · Computer Science 2020-07-09 Auke Wiggers , Emiel Hoogeboom

Video-based world models have recently garnered increasing attention for their ability to synthesize diverse and dynamic visual environments. In this paper, we focus on shared world modeling, where a model generates multiple videos from a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fan Wu , Jiacheng Wei , Ruibo Li , Yi Xu , Junyou Li , Deheng Ye , Guosheng Lin

We tackle the problem of modeling sequential visual phenomena. Given examples of a phenomena that can be divided into discrete time steps, we aim to take an input from any such time and realize this input at all other time steps in the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Siyang Wang , Justin Lazarow , Kwonjoon Lee , Zhuowen Tu

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Autoregressive Transformer models have demonstrated impressive performance in video generation, but their sequential token-by-token decoding process poses a major bottleneck, particularly for long videos represented by tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yang Ye , Junliang Guo , Haoyu Wu , Tianyu He , Tim Pearce , Tabish Rashid , Katja Hofmann , Jiang Bian

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake

Learning an efficient update rule from data that promotes rapid learning of new tasks from the same distribution remains an open problem in meta-learning. Typically, previous works have approached this issue either by attempting to train a…

Machine Learning · Computer Science 2020-02-19 Sebastian Flennerhag , Andrei A. Rusu , Razvan Pascanu , Francesco Visin , Hujun Yin , Raia Hadsell