English
Related papers

Related papers: Marrying Autoregressive Transformer and Diffusion …

200 papers

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

We propose in this paper an analytically new construct of a diffusion model whose drift and diffusion parameters yield an exponentially time-decaying Signal to Noise Ratio in the forward process. In reverse, the construct cleverly carries…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Tanmay Asthana , Yufang Bao , Hamid Krim

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

Diffusion models have gained increasing attention for their impressive generation abilities but currently struggle with rendering accurate and coherent text. To address this issue, we introduce TextDiffuser, focusing on generating images…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Reconstructing high-fidelity magnetic resonance (MR) images from under-sampled k-space is a commonly used strategy to reduce scan time. The posterior sampling of diffusion models based on the real measurement data holds significant promise…

Image and Video Processing · Electrical Eng. & Systems 2024-07-04 Jiayue Chu , Chenhe Du , Xiyue Lin , Yuyao Zhang , Hongjiang Wei

Real-world databases are predominantly relational, comprising multiple interlinked tables that contain complex structural and statistical dependencies. Learning generative models on relational data has shown great promise in generating…

Machine Learning · Computer Science 2025-06-03 Valter Hudovernik , Minkai Xu , Juntong Shi , Lovro Šubelj , Stefano Ermon , Erik Štrumbelj , Jure Leskovec

Adapting the Diffusion Probabilistic Model (DPM) for direct image super-resolution is wasteful, given that a simple Convolutional Neural Network (CNN) can recover the main low-frequency content. Therefore, we present ResDiff, a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Shuyao Shang , Zhengyang Shan , Guangxing Liu , LunQian Wang , XingHua Wang , Zekai Zhang , Jinglin Zhang

With the advancement of AIGC, video frame interpolation (VFI) has become a crucial component in existing video generation frameworks, attracting widespread research interest. For the VFI task, the motion estimation between neighboring…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhilin Huang , Yijie Yu , Ling Yang , Chujun Qin , Bing Zheng , Xiawu Zheng , Zikun Zhou , Yaowei Wang , Wenming Yang

Faithful image super-resolution (SR) not only needs to recover images that appear realistic, similar to image generation tasks, but also requires that the restored images maintain fidelity and structural consistency with the input. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Junyang Chen , Jinshan Pan , Jiangxin Dong

Diffusion models have gained significant attention in the realm of image generation due to their exceptional performance. Their success has been recently expanded to text generation via generating all tokens within a sequence concurrently.…

Computation and Language · Computer Science 2023-12-14 Tong Wu , Zhihao Fan , Xiao Liu , Yeyun Gong , Yelong Shen , Jian Jiao , Hai-Tao Zheng , Juntao Li , Zhongyu Wei , Jian Guo , Nan Duan , Weizhu Chen

Visual autoregressive models achieve remarkable generation quality through next-scale predictions across multi-scale token pyramids. However, the conventional method uses uniform scale downsampling to build these pyramids, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiaofan Li , Chenming Wu , Yanpeng Sun , Jiaming Zhou , Delin Qu , Yansong Qu , Weihao Bo , Haibao Yu , Dingkang Liang

Autoregressive and diffusion models drive the recent breakthroughs on text-to-image generation. Despite their huge success of generating high-realistic images, a common shortcoming of these models is their high inference latency -…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Zhangyin Feng , Runyi Hu , Liangxin Liu , Fan Zhang , Duyu Tang , Yong Dai , Xiaocheng Feng , Jiwei Li , Bing Qin , Shuming Shi

Recent advances in text-to-image generative models have enabled numerous practical applications, including subject-driven generation, which fine-tunes pretrained models to capture subject semantics from only a few examples. While…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Jiwoo Chung , Sangeek Hyun , Hyunjun Kim , Eunseo Koh , MinKyu Lee , Jae-Pil Heo

Graph generation has been dominated by autoregressive models due to their simplicity and effectiveness, despite their sensitivity to ordering. Yet diffusion models have garnered increasing attention, as they offer comparable performance…

Machine Learning · Computer Science 2024-12-04 Lingxiao Zhao , Xueying Ding , Leman Akoglu

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

We present LayerDiffuse, an approach enabling large-scale pretrained latent diffusion models to generate transparent images. The method allows generation of single transparent images or of multiple transparent layers. The method learns a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Lvmin Zhang , Maneesh Agrawala

Diffusion models achieve great success in generating diverse and high-fidelity images, yet their widespread application, especially in real-time scenarios, is hampered by their inherently slow generation speed. The slow generation stems…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Shengkun Tang , Yaqing Wang , Caiwen Ding , Yi Liang , Yao Li , Dongkuan Xu

Data-driven and controllable human motion synthesis and prediction are active research areas with various applications in interactive media and social robotics. Challenges remain in these fields for generating diverse motions given past…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Wenjie Yin , Ruibo Tu , Hang Yin , Danica Kragic , Hedvig Kjellström , Mårten Björkman

Recent advancements in text-to-video (T2V) generation have been driven by two competing paradigms: autoregressive language models and diffusion models. However, each paradigm has intrinsic limitations: language models struggle with visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Aoxiong Yin , Kai Shen , Yichong Leng , Xu Tan , Xinyu Zhou , Juncheng Li , Siliang Tang