English
Related papers

Related papers: Attention-based Information Fusion using Multi-Enc…

200 papers

Recommendations can greatly benefit from good representations of the user state at recommendation time. Recent approaches that leverage Recurrent Neural Networks (RNNs) for session-based recommendations have shown that Deep Learning models…

Information Retrieval · Computer Science 2017-06-26 Elena Smirnova , Flavian Vasile

A core technology that has emerged from the artificial intelligence revolution is the recurrent neural network (RNN). Its unique sequence-based architecture provides a tractable likelihood estimate with stable training paradigms, a…

Disordered Systems and Neural Networks · Physics 2020-07-01 Mohamed Hibat-Allah , Martin Ganahl , Lauren E. Hayward , Roger G. Melko , Juan Carrasquilla

The fusion of images taken by heterogeneous sensors helps to enrich the information and improve the quality of imaging. In this article, we present a hybrid model consisting of a convolutional encoder and a Transformer-based decoder to fuse…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yu Yuan , Jiaqi Wu , Zhongliang Jing , Henry Leung , Han Pan

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

Context in image is crucial for scene labeling while existing methods only exploit local context generated from a small surrounding area of an image patch or a pixel, by contrast long-range and global contextual information is ignored. To…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Heng Fan , Xue Mei , Danil Prokhorov , Haibin Ling

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Since sequential information plays an important role in modeling user behaviors, various sequential recommendation methods have been proposed. Methods based on Markov assumption are widely-used, but independently combine several most recent…

Information Retrieval · Computer Science 2016-09-20 Qiang Liu , Shu Wu , Diyi Wang , Zhaokang Li , Liang Wang

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

Understanding the internal dynamics of Recurrent Neural Networks (RNNs) is crucial for advancing their interpretability and improving their design. This study introduces an innovative information-theoretic method to identify and analyze…

Machine Learning · Computer Science 2025-10-03 Arend Hintze , Asadullah Najam , Jory Schossau

Knowing which words have been attended to in previous time steps while generating a translation is a rich source of information for predicting what words will be attended to in the future. We improve upon the attention model of Bahdanau et…

Neural and Evolutionary Computing · Computer Science 2016-07-19 Zichao Yang , Zhiting Hu , Yuntian Deng , Chris Dyer , Alex Smola

We propose here an extended attention model for sequence-to-sequence recurrent neural networks (RNNs) designed to capture (pseudo-)periods in time series. This extended attention model can be deployed on top of any RNN and is shown to yield…

Machine Learning · Computer Science 2017-08-22 Yagmur G. Cinar , Hamid Mirisaee , Parantapa Goswami , Eric Gaussier , Ali Ait-Bachir , Vadim Strijov

Multiresolution image fusion is a key problem for real-time satellite imaging and plays a central role in detecting and monitoring natural phenomena such as floods. It aims to solve the trade-off between temporal and spatial resolution in…

Image and Video Processing · Electrical Eng. & Systems 2025-09-17 Haoqing Li , Ricardo Borsoi , Tales Imbiriba , Pau Closas

Recurrent neural networks (RNNs) are widely used in computational neuroscience and machine learning applications. In an RNN, each neuron computes its output as a nonlinear function of its integrated input. While the importance of RNNs,…

Neurons and Cognition · Quantitative Biology 2012-07-10 Sebastian Bitzer , Stefan J. Kiebel

Encouraged by the success of deep learning in a variety of domains, we investigate the suitability and effectiveness of Recurrent Neural Networks (RNNs) in a domain where deep learning has not yet been used; namely detecting confusion from…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Shane D. Sims , Vanessa Putnam , Cristina Conati

Recently the crowd counting has received more and more attention. Especially the technology of high-density environment has become an important research content, and the relevant methods for the existence of extremely dense crowd are not…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Mengxiao Tian , Hao Guo , Chengjiang Long

In clinical data sets we often find static information (e.g. patient gender, blood type, etc.) combined with sequences of data that are recorded during multiple hospital visits (e.g. medications prescribed, tests performed, etc.). Recurrent…

Machine Learning · Computer Science 2016-11-18 Cristóbal Esteban , Oliver Staeck , Yinchong Yang , Volker Tresp

Integration of multiple microphone data is one of the key ways to achieve robust speech recognition in noisy environments or when the speaker is located at some distance from the input device. Signal processing techniques such as…

Machine Learning · Computer Science 2016-01-11 Suyoun Kim , Ian Lane

Semantic segmentation is one of the core tasks in the field of computer vision, and its goal is to accurately classify each pixel in an image. The traditional Unet model achieves efficient feature extraction and fusion through an…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xuan Li , Quanchao Lu , Yankaiqi Li , Muqing Li , Yijiashun Qi

3D scene understanding is important for robots to interact with the 3D world in a meaningful way. Most previous works on 3D scene understanding focus on recognizing geometrical or semantic properties of the scene independently. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-06-01 Yu Xiang , Dieter Fox

Recurrent Neural Network (RNN) has been successfully applied in many sequence learning problems. Such as handwriting recognition, image description, natural language processing and video motion analysis. After years of development,…

Machine Learning · Computer Science 2018-11-01 Guoqiang Zhong , Guohua Yue , Xiao Ling