中文
相关论文

相关论文: Marrying Autoregressive Transformer and Diffusion …

200 篇论文

Synthesizing high-quality tabular data is an important topic in many data science tasks, ranging from dataset augmentation to privacy protection. However, developing expressive generative models for tabular data is challenging due to its…

机器学习 · 计算机科学 2025-02-18 Juntong Shi , Minkai Xu , Harper Hua , Hengrui Zhang , Stefano Ermon , Jure Leskovec

This work tackles the information loss bottleneck of vector-quantization (VQ) autoregressive image generation by introducing a novel model architecture called the 2-Dimensional Autoregression (DnD) Transformer. The DnD-Transformer predicts…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Liang Chen , Sinan Tan , Zefan Cai , Weichu Xie , Haozhe Zhao , Yichi Zhang , Junyang Lin , Jinze Bai , Tianyu Liu , Baobao Chang

This study introduces LRDif, a novel diffusion-based framework designed specifically for facial expression recognition (FER) within the context of under-display cameras (UDC). To address the inherent challenges posed by UDC's image…

计算机视觉与模式识别 · 计算机科学 2024-02-02 Zhifeng Wang , Kaihao Zhang , Ramesh Sankaranarayana

In this work, we explore an untapped signal in diffusion model inference. While all previous methods generate images independently at inference, we instead ask if samples can be generated collaboratively. We propose Group Diffusion,…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Sicheng Mo , Thao Nguyen , Richard Zhang , Nick Kolkin , Siddharth Srinivasan Iyer , Eli Shechtman , Krishna Kumar Singh , Yong Jae Lee , Bolei Zhou , Yuheng Li

Diffusion models are a special type of generative model, capable of synthesising new data from a learnt distribution. We introduce DISPR, a diffusion-based model for solving the inverse problem of three-dimensional (3D) cell shape…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Dominik J. E. Waibel , Ernst Röell , Bastian Rieck , Raja Giryes , Carsten Marr

Directly modeling the explicit likelihood of the raw data distribution is key topic in the machine learning area, which achieves the scaling successes in Large Language Models by autoregressive modeling. However, continuous AR modeling over…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Guangting Zheng , Qinyu Zhao , Tao Yang , Fei Xiao , Zhijie Lin , Jie Wu , Jiajun Deng , Yanyong Zhang , Rui Zhu

We introduce Causal Diffusion as the autoregressive (AR) counterpart of Diffusion models. It is a next-token(s) forecasting framework that is friendly to both discrete and continuous modalities and compatible with existing next-token…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Chaorui Deng , Deyao Zhu , Kunchang Li , Shi Guang , Haoqi Fan

Conventional wisdom holds that autoregressive models for image generation are typically accompanied by vector-quantized tokens. We observe that while a discrete-valued space can facilitate representing a categorical distribution, it is not…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Tianhong Li , Yonglong Tian , He Li , Mingyang Deng , Kaiming He

We introduce a new paradigm for AutoRegressive (AR) image generation, termed Set AutoRegressive Modeling (SAR). SAR generalizes the conventional AR to the next-set setting, i.e., splitting the sequence into arbitrary sets containing…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Wenze Liu , Le Zhuo , Yi Xin , Sheng Xia , Peng Gao , Xiangyu Yue

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Ilia Sudakov , Artem Babenko , Dmitry Baranchuk

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Diffusion models (DMs) have emerged as powerful generative models for solving inverse problems, offering a good approximation of prior distributions of real-world image data. Typically, diffusion models rely on large-scale clean signals to…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Yifei Wang , Weimin Bai , Weijian Luo , Wenzheng Chen , He Sun

With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Yimin Zhou , Yichong Xia , Bin Chen , Mingyao Hong , Jiawei Li , Zhi Wang , Yaowei Wang

Deep learning is widely applied in computer-aided pathological diagnosis, which alleviates the pathologist workload and provide timely clinical analysis. However, most models generally require large-scale annotated data for training, which…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Zeyu Liu , Tianyi Zhang , Yufang He , Yunlu Feng , Yu Zhao , Guanglei Zhang

Super resolution techniques can enhance the spatial resolution of remote sensing images, enabling more efficient large scale earth observation applications. While single image SR methods enhance low resolution images, they neglect valuable…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Ce Wang , Wanjie Sun

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

机器学习 · 计算机科学 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Pre-trained Latent Diffusion Models (LDMs) have recently shown strong perceptual priors for low-level vision tasks, making them a promising direction for multi-exposure High Dynamic Range (HDR) reconstruction. However, directly applying…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Tao Hu , Weiyu Zhou , Yanjie Tu , Peng Wu , Wei Dong , Qingsen Yan , Yanning Zhang

Recent advances in autoregressive (AR) generative models have produced increasingly powerful systems for media synthesis. Among them, next-scale prediction has emerged as a popular paradigm, where models generate images in a coarse-to-fine…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Gengze Zhou , Chongjian Ge , Hao Tan , Feng Liu , Yicong Hong

Computed Tomography (CT) technology reduces radiation haz-ards to the human body through sparse sampling, but fewer sampling angles pose challenges for image reconstruction. Score-based generative models are widely used in sparse-view CT…

图像与视频处理 · 电气工程与系统科学 2025-12-22 Junyan Zhang , Mengxiao Geng , Pinhuang Tan , Yi Liu , Zhili Liu , Bin Huang , Qiegen Liu

Given the audio-visual clip of the speaker, facial reaction generation aims to predict the listener's facial reactions. The challenge lies in capturing the relevance between video and audio while balancing appropriateness, realism, and…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Jiaming Li , Sheng Wang , Xin Wang , Yitao Zhu , Honglin Xiong , Zixu Zhuang , Qian Wang