English
Related papers

Related papers: Modeling Image Composition for Complex Scene Gener…

200 papers

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Huan Zhang , Xu Zhang , Nian Cai , Jianglei Di , Yun Zhang

This paper focuses on the challenging crowd counting task. As large-scale variations often exist within crowd images, neither fixed-size convolution kernel of CNN nor fixed-size attention of recent vision transformers can well handle this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Hui Lin , Zhiheng Ma , Rongrong Ji , Yaowei Wang , Xiaopeng Hong

The point cloud learning community witnesses a modeling shift from CNNs to Transformers, where pure Transformer architectures have achieved top accuracy on the major learning benchmarks. However, existing point Transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Zhang Cheng , Haocheng Wan , Xinyi Shen , Zizhao Wu

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

We introduce the GANformer2 model, an iterative object-oriented transformer, explored for the task of generative modeling. The network incorporates strong and explicit structural priors, to reflect the compositional nature of visual scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Drew A. Hudson , C. Lawrence Zitnick

Transformer-based models have achieved remarkable results in low-level vision tasks including image super-resolution (SR). However, early Transformer-based approaches that rely on self-attention within non-overlapping windows encounter…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Cansu Korkmaz , A. Murat Tekalp

Transformer-based models have been widely adopted for sentiment analysis tasks due to their exceptional ability to capture contextual information. However, these methods often exhibit suboptimal accuracy in certain scenarios. By analyzing…

Artificial Intelligence · Computer Science 2025-12-25 Yawei Liu

Wang and Wang (2025) proposed the Task-Driven Fixation Network (TDFN) based on the fixation mechanism, which leverages low-resolution information along with high-resolution details near fixation points to accomplish specific visual tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Shuguang Wang , Yuanjing Wang

Vision Transformers (ViTs) have been shown to enhance visual recognition through modeling long-range dependencies with multi-head self-attention (MHSA), which is typically formulated as Query-Key-Value computation. However, the attention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chongjian Ge , Xiaohan Ding , Zhan Tong , Li Yuan , Jiangliu Wang , Yibing Song , Ping Luo

The end-to-end image fusion framework has achieved promising performance, with dedicated convolutional networks aggregating the multi-modal local appearance. However, long-range dependencies are directly neglected in existing CNN fusion…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu

We introduce a novel, training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs). Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shulei Wang , Wang Lin , Hai Huang , Hanting Wang , Sihang Cai , WenKang Han , Tao Jin , Jingyuan Chen , Jiacheng Sun , Jieming Zhu , Zhou Zhao

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

We introduce a new architecture for unsupervised object-centric representation learning and multi-object detection and segmentation, which uses a translation-equivariant attention mechanism to predict the coordinates of the objects present…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Bruno Sauvalle , Arnaud de La Fortelle

This paper proposes a novel deep learning-based video object matting method that can achieve temporally coherent matting results. Its key component is an attention-based temporal aggregation module that maximizes image matting networks'…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Yunke Zhang , Chi Wang , Miaomiao Cui , Peiran Ren , Xuansong Xie , Xian-sheng Hua , Hujun Bao , Qixing Huang , Weiwei Xu

Medical image segmentation is a critical task that plays a vital role in diagnosis, treatment planning, and disease monitoring. Accurate segmentation of anatomical structures and abnormalities from medical images can aid in the early…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Reza Azad , Amirhossein Kazerouni , Alaa Sulaiman , Afshin Bozorgpour , Ehsan Khodapanah Aghdam , Abin Jose , Dorit Merhof

Text-to-image generation using diffusion models has seen explosive popularity owing to their ability in producing high quality images adhering to text prompts. However, production-grade diffusion model serving is a resource intensive task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shubham Agarwal , Subrata Mitra , Sarthak Chakraborty , Srikrishna Karanam , Koyel Mukherjee , Shiv Saini

Existing methods for video interpolation heavily rely on deep convolution neural networks, and thus suffer from their intrinsic limitations, such as content-agnostic kernel weights and restricted receptive field. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhihao Shi , Xiangyu Xu , Xiaohong Liu , Jun Chen , Ming-Hsuan Yang

Existing approaches for controlling text-to-image diffusion models, while powerful, do not allow for explicit 3D object-centric control, such as precise control of object orientation. In this work, we address the problem of multi-object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Rishubh Parihar , Vaibhav Agrawal , Sachidanand VS , R. Venkatesh Babu

Fine-grained visual classification (FGVC) which aims at recognizing objects from subcategories is a very challenging task due to the inherently subtle inter-class differences. Most existing works mainly tackle this problem by reusing the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Ju He , Jie-Neng Chen , Shuai Liu , Adam Kortylewski , Cheng Yang , Yutong Bai , Changhu Wang