中文
相关论文

相关论文: Revitalizing CNN Attentions via Transformers in Se…

200 篇论文

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

计算机视觉与模式识别 · 计算机科学 2019-05-22 Masanari Kimura , Masayuki Tanaka

Training deep learning based video classifiers for action recognition requires a large amount of labeled videos. The labeling process is labor-intensive and time-consuming. On the other hand, large amount of weakly-labeled images are…

计算机视觉与模式识别 · 计算机科学 2017-08-04 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Learning powerful discriminative features for remote sensing image scene classification is a challenging computer vision problem. In the past, most classification approaches were based on handcrafted features. However, most recent…

计算机视觉与模式识别 · 计算机科学 2019-02-22 Jun Li , Daoyu Lin , Yang Wang , Guangluan Xu , Chibiao Ding

Since Transformer has found widespread use in NLP, the potential of Transformer in CV has been realized and has inspired many new approaches. However, the computation required for replacing word tokens with image patches for Transformer…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Hezheng Lin , Xing Cheng , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Qing Song , Wei Yuan

Transformer, an attention-based encoder-decoder model, has already revolutionized the field of natural language processing (NLP). Inspired by such significant achievements, some pioneering works have recently been done on employing…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Yang Liu , Yao Zhang , Yixin Wang , Feng Hou , Jin Yuan , Jiang Tian , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

There is a resurging interest in developing a neural-network-based solution to the supervised machine learning problem. The convolutional neural network (CNN) will be studied in this note. To begin with, we introduce a RECOS transform as a…

计算机视觉与模式识别 · 计算机科学 2017-02-21 C. -C. Jay Kuo

Self-Supervised Learning (SSL) for Vision Transformers (ViTs) has recently demonstrated considerable potential as a pre-training strategy for a variety of computer vision tasks, including image classification and segmentation, both in…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Yannis Kaltampanidis , Alexandros Doumanoglou , Dimitrios Zarpalas

Self-supervised learning (SSL) is a powerful technique for learning from unlabeled data. By learning to remain invariant to applied data augmentations, methods such as SimCLR and MoCo can reach quality on par with supervised approaches.…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Marcin Przewięźlikowski , Mateusz Pyla , Bartosz Zieliński , Bartłomiej Twardowski , Jacek Tabor , Marek Śmieja

Recent studies have used deep residual convolutional neural networks (CNNs) for JPEG compression artifact reduction. This study proposes a scalable CNN called S-Net. Our approach effectively adjusts the network scale dynamically in a…

计算机视觉与模式识别 · 计算机科学 2019-07-24 Bolun Zheng , Rui Sun , Xiang Tian , Yaowu Chen

Advanced deep Convolutional Neural Networks (CNNs) have shown great success in video-based person Re-Identification (Re-ID). However, they usually focus on the most obvious regions of persons with a limited global representation ability.…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Xuehu Liu , Chenyang Yu , Pingping Zhang , Huchuan Lu

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

计算机视觉与模式识别 · 计算机科学 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

Generating 3D models from multi-view 2D RGB images has gained significant attention, extending the capabilities of technologies like Virtual Reality, Robotic Vision, and human-machine interaction. In this paper, we introduce a hybrid…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Ajith Balakrishnan , Sreeja S , Linu Shine

Recently, deep convolution neural networks (CNNs) steered face super-resolution methods have achieved great progress in restoring degraded facial details by jointly training with facial priors. However, these methods have some obvious…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Guangwei Gao , Zixiang Xu , Juncheng Li , Jian Yang , Tieyong Zeng , Guo-Jun Qi

We introduce a novel self-attention mechanism, which we call CSA (Chromatic Self-Attention), which extends the notion of attention scores to attention _filters_, independently modulating the feature channels. We showcase CSA in a…

机器学习 · 计算机科学 2023-04-24 Romain Menegaux , Emmanuel Jehanno , Margot Selosse , Julien Mairal

We propose a semi-supervised learning approach for video classification, VideoSSL, using convolutional neural networks (CNN). Like other computer vision tasks, existing supervised video classification methods demand a large amount of…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Longlong Jing , Toufiq Parag , Zhe Wu , Yingli Tian , Hongcheng Wang

Encoder-decoder based Sequence to Sequence learning (S2S) has made remarkable progress in recent years. Different network architectures have been used in the encoder/decoder. Among them, Convolutional Neural Networks (CNN) and Self…

计算与语言 · 计算机科学 2018-07-05 Kaitao Song , Xu Tan , Di He , Jianfeng Lu , Tao Qin , Tie-Yan Liu

Transformer has been very successful in various computer vision tasks and understanding the working mechanism of transformer is important. As touchstones, weakly-supervised semantic segmentation (WSSS) and class activation map (CAM) are…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Lianghui Zhu , Yingyue Li , Jiemin Fang , Yan Liu , Hao Xin , Wenyu Liu , Xinggang Wang

In recent developments in the field of Computer Vision, a rise is seen in the use of transformer-based architectures. They are surpassing the state-of-the-art set by CNN architectures in accuracy but on the other hand, they are…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Durvesh Malpure , Onkar Litake , Rajesh Ingle

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end (E2E) Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by…

音频与语音处理 · 电气工程与系统科学 2019-10-22 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Shinji Watanabe , Takaaki Hori , Hynek Hermansky

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Hyungtae Lee , Heesung Kwon