English
Related papers

Related papers: MS-Former: Memory-Supported Transformer for Weakly…

200 papers

Semantic segmentation of night-time images holds significant importance in computer vision, particularly for applications like night environment perception in autonomous driving systems. However, existing methods tend to parse night-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yuwen Pan , Rui Sun , Naisong Luo , Tianzhu Zhang , Yongdong Zhang

Transformers have shown dominant performance across a range of domains including language and vision. However, their computational cost grows quadratically with the sequence length, making their usage prohibitive for resource-constrained…

Computation and Language · Computer Science 2023-10-24 Yinghan Long , Sayeed Shafayet Chowdhury , Kaushik Roy

Weakly supervised semantic segmentation (WSSS) must learn dense masks from noisy, under-specified cues. We revisit the SegFormer decoder and show that three small, synergistic changes make weak supervision markedly more effective-without…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Ali Torabi , Sanjog Gaihre , Yaqoob Majeed

We propose an attention-based approach for multimodal image patch matching using a Transformer encoder attending to the feature maps of a multiscale Siamese CNN. Our encoder is shown to efficiently aggregate multiscale image embeddings…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Aviad Moreshet , Yosi Keller

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

Recent advancements in industrial anomaly detection (AD) have demonstrated that incorporating a small number of anomalous samples during training can significantly enhance accuracy. However, this improvement often comes at the cost of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Hanxi Li , Jingqi Wu , Deyin Liu , Lin Wu , Hao Chen , Mingwen Wang , Chunhua Shen

How to identify and segment camouflaged objects from the background is challenging. Inspired by the multi-head self-attention in Transformers, we present a simple masked separable attention (MSA) for camouflaged object detection. We first…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bowen Yin , Xuying Zhang , Qibin Hou , Bo-Yuan Sun , Deng-Ping Fan , Luc Van Gool

Image-level weakly supervised semantic segmentation is a challenging problem that has been deeply studied in recent years. Most of advanced solutions exploit class activation map (CAM). However, CAMs can hardly serve as the object mask due…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yude Wang , Jie Zhang , Meina Kan , Shiguang Shan , Xilin Chen

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

Sound · Computer Science 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

Sequential Visual Place Recognition (Seq-VPR) leverages transformers to capture spatio-temporal features effectively. In practice, a transformer-based Seq-VPR model should be flexible to the number of frames per sequence (seq- length),…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yu Kiu , Lau , Chao Chen , Ge Jin , Chen Feng

Transformer has been very successful in various computer vision tasks and understanding the working mechanism of transformer is important. As touchstones, weakly-supervised semantic segmentation (WSSS) and class activation map (CAM) are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Lianghui Zhu , Yingyue Li , Jiemin Fang , Yan Liu , Hao Xin , Wenyu Liu , Xinggang Wang

Convolutional Neural Networks (CNNs) and Transformers have achieved remarkable success in computer vision tasks. However, their deep architectures often lead to high computational redundancy, making them less suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Novendra Setyawan , Ghufron Wahyu Kurniawan , Chi-Chia Sun , Jun-Wei Hsieh , Jing-Ming Guo , Wen-Kai Kuo

The challenge of fine-grained visual recognition often lies in discovering the key discriminative regions. While such regions can be automatically identified from a large-scale labeled dataset, a similar method might become less effective…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yangyang Shu , Baosheng Yu , Haiming Xu , Lingqiao Liu

While transformers have shown great potential on video recognition with their strong capability of capturing long-range dependencies, they often suffer high computational costs induced by the self-attention to the huge number of 3D tokens.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuxuan Liang , Pan Zhou , Roger Zimmermann , Shuicheng Yan

The evolution of Vision Transformers has led to their widespread adaptation to different domains. Despite large-scale success, there remain significant challenges including their reliance on extensive computational and memory resources for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Suyash Gaurav , Muhammad Farhan Humayun , Jukka Heikkonen , Jatin Chaudhary

Weakly supervised semantic segmentation receives much research attention since it alleviates the need to obtain a large amount of dense pixel-wise ground-truth annotations for the training images. Compared with other forms of weak…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Tianyi Zhang , Guosheng Lin , Jianfei Cai , Tong Shen , Chunhua Shen , Alex C. Kot

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Guoan Xu , Wenfeng Huang , Tao Wu , Ligeng Chen , Wenjing Jia , Guangwei Gao , Xiatian Zhu , Stuart Perry

In this paper, we aim to tackle the challenging few-shot segmentation task from a new perspective. Typical methods follow the paradigm to firstly learn prototypical features from support images and then match query features in pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Siyu Jiao , Gengwei Zhang , Shant Navasardyan , Ling Chen , Yao Zhao , Yunchao Wei , Humphrey Shi

Malicious image manipulation poses societal risks, increasing the importance of effective image manipulation detection methods. Recent approaches in image manipulation detection have largely been driven by fully supervised approaches, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Xinghao Wang , Tao Gong , Qi Chu , Bin Liu , Nenghai Yu

Arbitrary-shaped text detection is an important and challenging task in computer vision. Most existing methods require heavy data labeling efforts to produce polygon-level text region labels for supervised training. In order to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Mengbiao Zhao , Wei Feng , Fei Yin , Xu-Yao Zhang , Cheng-Lin Liu