中文
相关论文

相关论文: Attentive Convolution: Equipping CNNs with RNN-sty…

200 篇论文

Convolutional neural networks (CNNs) have demonstrated gratifying results at learning discriminative features. However, when applied to unseen domains, state-of-the-art models are usually prone to errors due to domain shift. After…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Rang Meng , Xianfeng Li , Weijie Chen , Shicai Yang , Jie Song , Xinchao Wang , Lei Zhang , Mingli Song , Di Xie , Shiliang Pu

Recently, three dimensional (3D) convolutional neural networks (CNNs) have emerged as dominant methods to capture spatiotemporal representations in videos, by adding to pre-existing 2D CNNs a third, temporal dimension. Such 3D CNNs,…

计算机视觉与模式识别 · 计算机科学 2019-09-04 Gurkirt Singh , Fabio Cuzzolin

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

计算与语言 · 计算机科学 2016-04-08 Ye Zhang , Byron Wallace

Convolutional neural networks (CNNs) have been recently used for a variety of histology image analysis. However, availability of a large dataset is a major prerequisite for training a CNN which limits its use by the computational pathology…

计算机视觉与模式识别 · 计算机科学 2018-03-07 Ruqayya Awan , Navid Alemi Koohbanani , Muhammad Shaban , Anna Lisowska , Nasir Rajpoot

As new data-sets for real-world visual reasoning and compositional question answering are emerging, it might be needed to use the visual feature extraction as a end-to-end process during training. This small contribution aims to suggest new…

计算机视觉与模式识别 · 计算机科学 2019-11-01 Jean-Benoit Delbrouck , Antoine Maiorca , Nathan Hubens , Stéphane Dupont

Sentiment Analysis has seen much progress in the past two decades. For the past few years, neural network approaches, primarily RNNs and CNNs, have been the most successful for this task. Recently, a new category of neural networks,…

计算与语言 · 计算机科学 2018-12-20 Artaches Ambartsoumian , Fred Popowich

We show how to augment any convolutional network with an attention-based global map to achieve non-local reasoning. We replace the final average pooling by an attention-based aggregation layer akin to a single transformer block, that…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Hugo Touvron , Matthieu Cord , Alaaeldin El-Nouby , Piotr Bojanowski , Armand Joulin , Gabriel Synnaeve , Hervé Jégou

Convolutional Neural Networks (CNNs), architectures consisting of convolutional layers, have been the standard choice in vision tasks. Recent studies have shown that Vision Transformers (VTs), architectures based on self-attention modules,…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Kishaan Jeeveswaran , Senthilkumar Kathiresan , Arnav Varma , Omar Magdy , Bahram Zonooz , Elahe Arani

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

机器学习 · 计算机科学 2019-12-10 Mohamed Karim Belaid

Attention mechanisms have significantly advanced visual models by capturing global context effectively. However, their reliance on large-scale datasets and substantial computational resources poses challenges in data-scarce and…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Chenghao Li , Chaoning Zhang , Boheng Zeng , Yi Lu , Pengbo Shi , Qingzi Chen , Jirui Liu , Lingyun Zhu , Yang Yang , Heng Tao Shen

Convolutional Neural Networks (CNNs) have performed extremely well on data represented by regularly arranged grids such as images. However, directly leveraging the classic convolution kernels or parameter sharing mechanisms on sparse 3D…

计算机视觉与模式识别 · 计算机科学 2019-09-30 Mingtao Feng , Liang Zhang , Xuefei Lin , Syed Zulqarnain Gilani , Ajmal Mian

Convolutional neural networks (CNN) exhibit unmatched performance in a multitude of computer vision tasks. However, the advantage of using convolutional networks over fully-connected networks is not understood from a theoretical…

机器学习 · 计算机科学 2020-10-06 Eran Malach , Shai Shalev-Shwartz

A novel convolution neural network model, abbreviated NL-CNN is proposed, where nonlinear convolution is emulated in a cascade of convolution + nonlinearity layers. The code for its implementation and some trained models are made publicly…

机器学习 · 计算机科学 2021-02-03 Radu Dogaru , Ioana Dogaru

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

音频与语音处理 · 电气工程与系统科学 2019-08-12 Mirco Ravanelli , Yoshua Bengio

First derived from human intuition, later adapted to machine translation for automatic token alignment, attention mechanism, a simple method that can be used for encoding sequence data based on the importance score each element is assigned,…

计算与语言 · 计算机科学 2018-11-15 Dichao Hu

In this work, we aim to predict human eye fixation with view-free scenes based on an end-to-end deep learning architecture. Although Convolutional Neural Networks (CNNs) have made substantial improvement on human attention prediction, it is…

计算机视觉与模式识别 · 计算机科学 2018-03-26 Wenguan Wang , Jianbing Shen

The convolutional neural network (CNN) has become a basic model for solving many computer vision problems. In recent years, a new class of CNNs, recurrent convolution neural network (RCNN), inspired by abundant recurrent connections in the…

计算机视觉与模式识别 · 计算机科学 2021-06-08 Jianfeng Wang , Xiaolin Hu

Deep convolutional neural networks (CNNs) have brought breakthroughs in processing clinical electrocardiograms (ECGs), speaker-independent speech and complex images. However, typical CNNs require a fixed input size while it is common to…

机器学习 · 计算机科学 2022-10-07 Linpeng Jin

Deep Convolutional Neural Networks (CNNs) have significantly advanced deep learning, driving breakthroughs in computer vision, natural language processing, medical diagnosis, object detection, and speech recognition. Architectural…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Saddam Hussain Khan , Rashid Iqbal

Context plays an important role in human language understanding, thus it may also be useful for machines learning vector representations of language. In this paper, we explore an asymmetric encoder-decoder structure for unsupervised…

神经与进化计算 · 计算机科学 2018-06-04 Shuai Tang , Hailin Jin , Chen Fang , Zhaowen Wang , Virginia R. de Sa