English
Related papers

Related papers: DiverGAN: An Efficient and Effective Single-Stage …

200 papers

Modern diffusion models, particularly those utilizing a Transformer-based UNet for denoising, rely heavily on self-attention operations to manage complex spatial relationships, thus achieving impressive generation performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Songhua Liu , Weihao Yu , Zhenxiong Tan , Xinchao Wang

In recent years, pre-trained visual-linguistic models have demonstrated tremendous potential, becoming a crucial foundational framework for numerous downstream tasks. However, the information density between text and images is not uniformly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Mengyuan Tian , Qiyan Zhao , Yanan Wang , Da-Han Wang

Camouflaged Object Detection (COD) aims to segment objects that are highly integrated with the background in terms of color, texture, and structure, making it a highly challenging task in computer vision. Although existing methods introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Min Zhang

High-fidelity text-to-image diffusion models have revolutionized visual content generation, but their widespread use raises significant ethical concerns, including intellectual property protection and the misuse of synthetic media. To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

Ultra-high-resolution text-to-image generation is increasingly vital for applications requiring fine-grained textures and global structural fidelity, yet state-of-the-art text-to-image diffusion models such as FLUX and SD3 remain confined…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yuyao Zhang , Yu-Wing Tai

Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yunji Kim , Jiyoung Lee , Jin-Hwa Kim , Jung-Woo Ha , Jun-Yan Zhu

Image generation from scene description is a cornerstone technique for the controlled generation, which is beneficial to applications such as content creation and image editing. In this work, we aim to synthesize images from scene…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Hung-Yu Tseng , Hsin-Ying Lee , Lu Jiang , Ming-Hsuan Yang , Weilong Yang

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Audio-visual Zero-Shot Learning (ZSL) has attracted significant attention for its ability to identify unseen classes and perform well in video classification tasks. However, modal imbalance in (G)ZSL leads to over-reliance on the optimal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 RunLin Yu , Yipu Gong , Wenrui Li , Aiwen Sun , Mengren Zheng

A unified diffusion framework for multi-modal generation and understanding has the transformative potential to achieve seamless and controllable image diffusion and other cross-modal tasks. In this paper, we introduce MMGen, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Jiepeng Wang , Zhaoqing Wang , Hao Pan , Yuan Liu , Dongdong Yu , Changhu Wang , Wenping Wang

Deep Convolutional Neural Networks (CNN) have drawn great attention in image super-resolution (SR). Recently, visual attention mechanism, which exploits both of the feature importance and contextual cues, has been introduced to image SR and…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Huapeng Wu , Zhengxia Zou , Jie Gui , Wen-Jun Zeng , Jieping Ye , Jun Zhang , Hongyi Liu , Zhihui Wei

While recent advancements in multimodal language models have enabled image generation from expressive multi-image instructions, existing methods struggle to maintain performance under complex interleaved instructions. This limitation stems…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yabo Zhang , Kunchang Li , Dewei Zhou , Xinyu Huang , Xun Wang

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Accurate and controllable image editing is a challenging task that has attracted significant attention recently. Notably, DragGAN is an interactive point-based image editing framework that achieves impressive editing results with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yujun Shi , Chuhui Xue , Jun Hao Liew , Jiachun Pan , Hanshu Yan , Wenqing Zhang , Vincent Y. F. Tan , Song Bai

Diffusion models have achieved remarkable success in image and video generation. However, their inherently multiple step inference process imposes substantial computational overhead, hindering real-world deployment. Accelerating diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jiajun jiao , Haowei Zhu , Puyuan Yang , Jianghui Wang , Ji Liu , Ziqiong Liu , Dong Li , Yuejian Fang , Junhai Yong , Bin Wang , Emad Barsoum

We propose Parallel WaveGAN, a distillation-free, fast, and small-footprint waveform generation method using a generative adversarial network. In the proposed method, a non-autoregressive WaveNet is trained by jointly optimizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-07 Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

Interleaved multimodal generation enables capabilities beyond unimodal generation models, such as step-by-step instructional guides, visual planning, and generating visual drafts for reasoning. However, the quality of existing interleaved…

Text-to-image generation has greatly advanced content creation, yet accurately rendering visual text remains a key challenge due to blurred glyphs, semantic drift, and limited style control. Existing methods often rely on pre-rendered glyph…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Yuanrui Wang , Cong Han , Yafei Li , Zhipeng Jin , Xiawei Li , SiNan Du , Wen Tao , Yi Yang , Shuanglong Li , Chun Yuan , Liu Lin

Despite the substantial progress in recent years, the image captioning techniques are still far from being perfect.Sentences produced by existing methods, e.g. those based on RNNs, are often overly rigid and lacking in variability. This…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 Bo Dai , Sanja Fidler , Raquel Urtasun , Dahua Lin