中文
相关论文

相关论文: Unified Diffusion Transformer for High-fidelity Te…

200 篇论文

Video restoration aims to reconstruct high quality video sequences from low quality inputs, addressing tasks such as super resolution, denoising, and deblurring. Traditional regression based methods often produce unrealistic details and…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Sicheng Gao , Nancy Mehta , Zongwei Wu , Radu Timofte

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

Diffusion MRI is a non-invasive, in-vivo biomedical imaging method for mapping tissue microstructure. Applications include structural connectivity imaging of the human brain and detecting microstructural neural changes. However, acquiring…

图像与视频处理 · 电气工程与系统科学 2023-10-09 Amir Sadikov , Xinlei Pan , Hannah Choi , Lanya T. Cai , Pratik Mukherjee

Image Restoration (IR), a classic low-level vision task, has witnessed significant advancements through deep models that effectively model global information. Notably, the emergence of Vision Transformers (ViTs) has further propelled these…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Bin Ren , Yawei Li , Jingyun Liang , Rakesh Ranjan , Mengyuan Liu , Rita Cucchiara , Luc Van Gool , Ming-Hsuan Yang , Nicu Sebe

Diffusion models excel at image restoration via probabilistic modeling of forward noise addition and reverse denoising, and their ability to handle complex noise while preserving fine details makes them well-suited for Low-Light Image…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Ying Liu , Junchao Zhang , Caiyun Wu

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

Image super-resolution (SR) aims to reconstruct high resolution images with both high perceptual quality and low distortion, but is fundamentally limited by the perception-distortion trade-off. GAN-based SR methods reduce distortion but…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Dan Wang , Haiyan Sun , Shan Du , Z. Jane Wang , Zhaochong An , Serge Belongie , Xinrui Cui

Diffusion Transformers (DiTs) excel at generation, but their global self-attention makes controllable, reference-image-based editing a distinct challenge. Unlike U-Nets, naively injecting local appearance into a DiT can disrupt its holistic…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Shengrong Gu , Ye Wang , Song Wu , Rui Ma , Qian Wang , Lanjun Wang , Zili Yi

Diffusion Transformers (DiT) have become a leading architecture in image generation. However, the quadratic complexity of attention mechanisms, which are responsible for modeling token-wise relationships, results in significant latency when…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Songhua Liu , Zhenxiong Tan , Xinchao Wang

Image captioning models often suffer from performance degradation when applied to novel datasets, as they are typically trained on domain-specific data. To enhance generalization in out-of-domain scenarios, retrieval-augmented approaches…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Hao Wu , Zhihang Zhong , Xiao Sun

Unified image restoration is a significantly challenging task in low-level vision. Existing methods either make tailored designs for specific tasks, limiting their generalizability across various types of degradation, or rely on training…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Huaqiu Li , Yong Wang , Tongwen Huang , Hailang Huang , Haoqian Wang , Xiangxiang Chu

Transformer based diffusion and vision-language models have achieved remarkable success; yet, efficiently removing undesirable or sensitive information without retraining remains a central challenge for model safety and compliance. We…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Ravi Ranjan , Utkarsh Grover , Xiaomin Lin , Agoritsa Polyzou

This paper explores a novel lightweight approach LightFair to achieve fair text-to-image diffusion models (T2I DMs) by addressing the adverse effects of the text encoder. Most existing methods either couple different parts of the diffusion…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Boyu Han , Qianqian Xu , Shilong Bao , Zhiyong Yang , Kangli Zi , Qingming Huang

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Deep learning has shown great potential in accelerating diffusion tensor imaging (DTI). Nevertheless, existing methods tend to suffer from Rician noise and eddy current, leading to detail loss in reconstructing the DTI-derived parametric…

图像与视频处理 · 电气工程与系统科学 2024-08-21 Wenxin Fan , Jian Cheng , Cheng Li , Jing Yang , Ruoyou Wu , Juan Zou , Shanshan Wang

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen

Here, we present a diffusion transformer (DiT)-based pixel super-resolution virtual staining approach to transform low-resolution FTIR microspectroscopic images of the unstained tissues into corresponding high-resolution H&E-stained images.…

光学 · 物理学 2026-03-10 Yudong Tian , Xiangyu Zhao , Yuqing Liu , Bofei Yang , Chongzhao Wu

Image deblurring is vital in computer vision, aiming to recover sharp images from blurry ones caused by motion or camera shake. While deep learning approaches such as CNNs and Vision Transformers (ViTs) have advanced this field, they often…

图像与视频处理 · 电气工程与系统科学 2025-11-17 Syed Mumtahin Mahmud , Mahdi Mohd Hossain Noki , Prothito Shovon Majumder , Abdul Mohaimen Al Radi , Md. Haider Ali , Md. Mosaddek Khan

Due to storage and bandwidth limitations, videos transmitted over the Internet often exhibit low quality, characterized by low-resolution and compression artifacts. Although video super-resolution (VSR) is an efficient video enhancing…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong