中文
相关论文

相关论文: RestoreVAR: Visual Autoregressive Generation for A…

200 篇论文

Although recent research applying text-to-image (T2I) diffusion models to real-world super-resolution (SR) has achieved remarkable progress, the misalignment of their targets leads to a suboptimal trade-off between inference speed and…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Yan Wang , Shijie Zhao , Kexin Zhang , Junlin Li , Li Zhang

We present DiffIR2VR-Zero, a zero-shot framework that enables any pre-trained image restoration diffusion model to perform high-quality video restoration without additional training. While image diffusion models have shown remarkable…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Chang-Han Yeh , Hau-Shiang Shiu , Chin-Yang Lin , Zhixiang Wang , Chi-Wei Hsiao , Ting-Hsuan Chen , Yu-Lun Liu

Super-resolution (SR) and image generation are important tasks in computer vision and are widely adopted in real-world applications. Most existing methods, however, generate images only at fixed-scale magnification and suffer from…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Jinseok Kim , Tae-Kyun Kim

In this paper we tackle Image Super Resolution (ISR), using recent advances in Visual Auto-Regressive (VAR) modeling. VAR iteratively estimates the residual in latent space between gradually increasing image scales, a process referred to as…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Enrique Sanchez , Isma Hadji , Adrian Bulat , Christos Tzelepis , Brais Martinez , Georgios Tzimiropoulos

With the rapid advancement of remote sensing technology, super-resolution image reconstruction is of great research and practical significance. Existing deep learning methods have made progress but still face limitations in handling complex…

计算机视觉与模式识别 · 计算机科学 2025-07-24 Shijie Lyu

Text-to-image generative models have made remarkable advancements in generating high-quality images. However, generated images often contain undesirable artifacts or other errors due to model limitations. Existing techniques to fine-tune…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Peyman Gholami , Robert Xiao

Diffusion models achieve state-of-the-art image generation but remain computationally costly due to iterative denoising. Latent-space models like Stable Diffusion reduce overhead yet lose fine detail, while retrieval-augmented methods…

机器学习 · 计算机科学 2025-12-23 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Masked auto-regressive diffusion models (MAR) benefit from the expressive modeling ability of diffusion models and the flexibility of masked auto-regressive ordering. However, vanilla MAR suffers from slow inference due to its hierarchical…

机器学习 · 计算机科学 2026-03-18 Yuxuan Gu , Weimin Bai , Yifei Wang , Weijian Luo , He Sun

Blind face restoration from low-quality (LQ) images is a challenging task that requires not only high-fidelity image reconstruction but also the preservation of facial identity. While diffusion models like Stable Diffusion have shown…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Runyi Li , Bin Chen , Jian Zhang , Radu Timofte

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

图像与视频处理 · 电气工程与系统科学 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Image-generative artificial intelligence (AI) has garnered significant attention in recent years. In particular, the diffusion model, a core component of generative AI, produces high-quality images with rich diversity. In this study, we…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Sho Ozaki , Shizuo Kaji , Toshikazu Imae , Kanabu Nawa , Hideomi Yamashita , Keiichi Nakagawa

Visual Autoregressive (VAR) models enable efficient image generation via next-scale prediction but face escalating computational costs as sequence length grows. Existing static pruning methods degrade performance by permanently removing…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Kaixin Zhang , Ruiqing Yang , Yuan Zhang , Shan You , Tao Huang

Visual autoregressive (AR) generation offers a promising path toward unifying vision and language models, yet its performance remains suboptimal against diffusion models. Prior work often attributes this gap to tokenizer limitations and…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Qiyuan He , Yicong Li , Haotian Ye , Jinghao Wang , Xinyao Liao , Pheng-Ann Heng , Stefano Ermon , James Zou , Angela Yao

Recent advances in diffusion models have enabled high-quality image generation, leading to increasing demand for post-generation editing that modifies local regions while preserving global structure. Achieving such flexible and precise…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Hanyi Wang , Han Fang , Zheng Wang , Shilin Wang , Ee-Chien Chang

Recently, diffusion models (DM) have been applied in magnetic resonance imaging (MRI) super-resolution (SR) reconstruction, exhibiting impressive performance, especially with regard to detailed reconstruction. However, the current DM-based…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Guangyuan Li , Chen Rao , Juncheng Mo , Zhanjie Zhang , Wei Xing , Lei Zhao

We investigate the fundamental limits of transformer-based foundation models, extending our analysis to include Visual Autoregressive (VAR) transformers. VAR represents a big step toward generating images using a novel, scalable,…

机器学习 · 计算机科学 2025-02-11 Yifang Chen , Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song

Essential to visual generation is efficient modeling of visual data priors. Conventional next-token prediction methods define the process as learning the conditional probability distribution of successive tokens. Recently, next-scale…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Jinhua Zhang , Wei Long , Minghao Han , Weiyi You , Shuhang Gu

In this paper, we explore a new generative approach for learning visual representations. Our method, DARL, employs a decoder-only Transformer to predict image patches autoregressively. We find that training with Mean Squared Error (MSE)…

机器学习 · 计算机科学 2024-06-05 Yazhe Li , Jorg Bornschein , Ting Chen