English
Related papers

Related papers: Joint multi-dimensional dynamic attention and tran…

200 papers

Active vision is inherently attention-driven: The agent actively selects views to attend in order to fast achieve the vision task while improving its internal representation of the scene being observed. Inspired by the recent success of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Min Liu , Yifei Shi , Lintao Zheng , Kai Xu , Hui Huang , Dinesh Manocha

Transformer-based diffusion models have recently superseded traditional U-Net architectures, with multimodal diffusion transformers (MM-DiT) emerging as the dominant approach in state-of-the-art models like Stable Diffusion 3 and Flux.1.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joonghyuk Shin , Alchan Hwang , Yujin Kim , Daneul Kim , Jaesik Park

Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Daquan Zhou , Yujun Shi , Bingyi Kang , Weihao Yu , Zihang Jiang , Yuan Li , Xiaojie Jin , Qibin Hou , Jiashi Feng

Transformer-based approaches have gained significant attention in image restoration, where the core component, i.e, Multi-Head Attention (MHA), plays a crucial role in capturing diverse features and recovering high-quality results. In MHA,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Shihao Zhou , Dayu Li , Jinshan Pan , Juncheng Zhou , Jinglei Shi , Jufeng Yang

Accurate segmentation of the region of interest in medical images can provide an essential pathway for devising effective treatment plans for life-threatening diseases. It is still challenging for U-Net, and its state-of-the-art variants,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-09 Md. Rayhan Ahmed , Adnan Ferdous Ashrafi , Raihan Uddin Ahmed , Swakkhar Shatabda , A. K. M. Muzahidul Islam , Salekul Islam

Vision transformers have gained popularity recently, leading to the development of new vision backbones with improved features and consistent performance gains. However, these advancements are not solely attributable to novel feature…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Xiaowei Hu , Min Shi , Weiyun Wang , Sitong Wu , Linjie Xing , Wenhai Wang , Xizhou Zhu , Lewei Lu , Jie Zhou , Xiaogang Wang , Yu Qiao , Jifeng Dai

Facial attribute editing has mainly two objectives: 1) translating image from a source domain to a target one, and 2) only changing the facial regions related to a target attribute and preserving the attribute-excluding details. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Ke Zhang , Yukun Su , Xiwang Guo , Liang Qi , Zhenbing Zhao

Deep CNN-based methods have so far achieved the state of the art results in multi-view 3D object reconstruction. Despite the considerable progress, the two core modules of these methods - multi-view feature extraction and fusion, are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Dan Wang , Xinrui Cui , Xun Chen , Zhengxia Zou , Tianyang Shi , Septimiu Salcudean , Z. Jane Wang , Rabab Ward

Transformers have recently emerged as a significant force in the field of image deraining. Existing image deraining methods utilize extensive research on self-attention. Though showcasing impressive results, they tend to neglect critical…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Yuhong He , Aiwen Jiang , Lingfang Jiang , Zhifeng Wang , Lu Wang

Convolutional Neural Networks (CNNs) have been consistently proved state-of-the-art results in image Super-Resolution (SR), representing an exceptional opportunity for the remote sensing field to extract further information and knowledge…

Image and Video Processing · Electrical Eng. & Systems 2020-11-02 Francesco Salvetti , Vittorio Mazzia , Aleem Khaliq , Marcello Chiaberge

In most recent years, deep convolutional neural networks (DCNNs) based image super-resolution (SR) has gained increasing attention in multimedia and computer vision communities, focusing on restoring the high-resolution (HR) image from a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Jingcai Guo , Shiheng Ma , Song Guo

A major challenge for high dynamic range (HDR) image reconstruction from multi-exposed low dynamic range (LDR) images, especially with dynamic scenes, is the extraction and merging of relevant contextual features in order to suppress any…

Image and Video Processing · Electrical Eng. & Systems 2022-11-09 Lingkai Zhu , Fei Zhou , Bozhi Liu , Orcun Göksel

Images captured under outdoor scenes usually suffer from low contrast and limited visibility due to suspended atmospheric particles, which directly affects the quality of photos. Despite numerous image dehazing methods have been proposed,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Chongyi Li , Jichang Guo , Fatih Porikli , Huazhu Fu , Yanwei Pang

Low-dose CT (LDCT) images are often accompanied by significant noise, which negatively impacts image quality and subsequent diagnostic accuracy. To address the challenges of multi-scale feature fusion and diverse noise distribution patterns…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Zhiting Zheng , Shuqi Wu , Wen Ding

This work aims at designing a lightweight convolutional neural network for image super resolution (SR). With simplicity bare in mind, we construct a pretty concise and effective network with a newly proposed pixel attention scheme. Pixel…

Image and Video Processing · Electrical Eng. & Systems 2020-10-05 Hengyuan Zhao , Xiangtao Kong , Jingwen He , Yu Qiao , Chao Dong

The UNet architecture, based on Convolutional Neural Networks (CNN), has demonstrated its remarkable performance in medical image analysis. However, it faces challenges in capturing long-range dependencies due to the limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Liang Xu , Mingxiao Chen , Yi Cheng , Pengfei Shao , Shuwei Shen , Peng Yao , Ronald X. Xu

Within Convolutional Neural Network (CNN), the convolution operations are good at extracting local features but experience difficulty to capture global representations. Within visual transformer, the cascaded self-attention modules can…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiliang Peng , Wei Huang , Shanzhi Gu , Lingxi Xie , Yaowei Wang , Jianbin Jiao , Qixiang Ye

Despite the fact real-world video deinterlacing and demosaicing are well-suited to supervised learning from synthetically degraded data because the degradation models are known and fixed, learned video deinterlacing and demosaicing have…

Image and Video Processing · Electrical Eng. & Systems 2024-04-22 Ronglei Ji , A. Murat Tekalp

With the powerfulness of convolution neural networks (CNN), CNN based face reconstruction has recently shown promising performance in reconstructing detailed face shape from 2D face images. The success of CNN-based methods relies on a large…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Yudong Guo , Juyong Zhang , Jianfei Cai , Boyi Jiang , Jianmin Zheng

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque