English
Related papers

Related papers: Dual Aggregation Transformer for Image Super-Resol…

200 papers

We present a novel architecture for dense correspondence. The current state-of-the-art are Transformer-based approaches that focus on either feature descriptors or cost volume aggregation. However, they generally aggregate one or the other…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Sunghwan Hong , Seokju Cho , Seungryong Kim , Stephen Lin

Multimodal large language models (MLLMs) have shown strong capability in semantic understanding and visual reasoning, yet their use on continuous video streams in bandwidth-constrained edge-cloud systems incurs prohibitive computation and…

Multimedia · Computer Science 2026-04-08 Qi Guo , Zheming Yang , Yunqing Hu , Chang Zhao , Wen Ji

Domain Adaptation (DA) aims to leverage the knowledge learned from a source domain with ample labeled data to a target domain with unlabeled data only. Most existing studies on DA contribute to learning domain-invariant feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiyu Wang , Pengxin Guo , Yu Zhang

Prior work on diagnosing Alzheimer's disease from magnetic resonance images of the brain established that convolutional neural networks (CNNs) can leverage the high-dimensional image information for classifying patients. However, little…

Image and Video Processing · Electrical Eng. & Systems 2021-09-24 Sebastian Pölsterl , Tom Nuno Wolf , Christian Wachinger

Deep learning based single image super resolution (SISR) algorithms has revolutionized the overall diagnosis framework by continually improving the architectural components and training strategies associated with convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Fayaz Ali Dharejo , Muhammad Zawish , Farah Deeba Yuanchun Zhou , Kapal Dev , Sunder Ali Khowaja , Nawab Muhammad Faseeh Qureshi

Transformers have recently emerged as a significant force in the field of image deraining. Existing image deraining methods utilize extensive research on self-attention. Though showcasing impressive results, they tend to neglect critical…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Yuhong He , Aiwen Jiang , Lingfang Jiang , Zhifeng Wang , Lu Wang

Recently, Transformer-based architecture has been introduced into single image deraining task due to its advantage in modeling non-local information. However, existing approaches tend to integrate global features based on a dense…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhentao Fan , Hongming Chen , Yufeng Li

Most existing text-to-image generation methods adopt a multi-stage modular architecture which has three significant problems: 1) Training multiple networks increases the run time and affects the convergence and stability of the generative…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zhenxing Zhang , Lambert Schomaker

Initially introduced as a machine translation model, the Transformer architecture has now become the foundation for modern deep learning architecture, with applications in a wide range of fields, from computer vision to natural language…

Computation and Language · Computer Science 2024-06-21 Martin Courtois , Malte Ostendorff , Leonhard Hennig , Georg Rehm

In recent years, transformer structures have been widely applied in image captioning with impressive performance. For good captioning results, the geometry and position relations of different visual objects are often thought of as crucial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chi Wang , Yulin Shen , Luping Ji

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Usman Muhammad , Jorma Laaksonen

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Transformers with remarkable global representation capacities achieve competitive results for visual tasks, but fail to consider high-level local pattern information in input images. In this paper, we present a generic Dual-stream Network…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Mingyuan Mao , Renrui Zhang , Honghui Zheng , Peng Gao , Teli Ma , Yan Peng , Errui Ding , Baochang Zhang , Shumin Han

Recently, with the advance of deep Convolutional Neural Networks (CNNs), person Re-Identification (Re-ID) has witnessed great success in various applications. However, with limited receptive fields of CNNs, it is still challenging to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Guowen Zhang , Pingping Zhang , Jinqing Qi , Huchuan Lu

The introduction of Transformer model has led to tremendous advancements in sequence modeling, especially in text domain. However, the use of attention-based models for video understanding is still relatively unexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Saurabh Sahu , Palash Goyal

To protect deep neural networks (DNNs) from adversarial attacks, adversarial training (AT) is developed by incorporating adversarial examples (AEs) into model training. Recent studies show that adversarial attacks disproportionately impact…

Machine Learning · Computer Science 2024-10-17 Fengpeng Li , Kemou Li , Haiwei Wu , Jinyu Tian , Jiantao Zhou

Recently, Transformer-based image restoration networks have achieved promising improvements over convolutional neural networks due to parameter-independent global interactions. To lower computational cost, existing works generally limit…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Jiale Zhang , Yulun Zhang , Jinjin Gu , Yongbing Zhang , Linghe Kong , Xin Yuan

Transformer has achieved great success in the NLP field by composing various advanced models like BERT and GPT. However, Transformer and its existing variants may not be optimal in capturing token distances because the position or distance…

Computation and Language · Computer Science 2021-04-13 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

Descriptive region features extracted by object detection networks have played an important role in the recent advancements of image captioning. However, they are still criticized for the lack of contextual information and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Yunpeng Luo , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Yongjian Wu , Feiyue Huang , Chia-Wen Lin , Rongrong Ji

Previous studies have demonstrated the effectiveness of point-based neural models on the point cloud analysis task. However, there remains a crucial issue on producing the efficient input embedding for raw point coordinates. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Zihao Li , Pan Gao , Kang You , Chuan Yan , Manoranjan Paul