English
Related papers

Related papers: Self-Attention Mechanism in Multimodal Context for…

200 papers

Standard attention mechanisms in transformers employ static token representations that remain unchanged across all pair-wise computations in each layer. This limits their representational alignment with the potentially diverse relational…

Machine Learning · Computer Science 2026-05-26 Hunjae Lee , Corey Clark

In this paper, we propose a novel sequence-aware recommendation model. Our model utilizes self-attention mechanism to infer the item-item relationship from user's historical interactions. With self-attention, it is able to estimate the…

Information Retrieval · Computer Science 2018-08-28 Shuai Zhang , Yi Tay , Lina Yao , Aixin Sun

Transformers have proven highly effective across modalities, but standard softmax attention scales quadratically with sequence length, limiting long context modeling. Linear attention mitigates this by approximating attention with kernel…

Machine Learning · Computer Science 2026-02-10 Ashkan Shahbazi , Chayne Thrash , Yikun Bai , Keaton Hamm , Navid NaderiAlizadeh , Soheil Kolouri

Knowing which words have been attended to in previous time steps while generating a translation is a rich source of information for predicting what words will be attended to in the future. We improve upon the attention model of Bahdanau et…

Neural and Evolutionary Computing · Computer Science 2016-07-19 Zichao Yang , Zhiting Hu , Yuntian Deng , Chris Dyer , Alex Smola

Attention-based autoregressive models have achieved state-of-the-art performance in various sequence-to-sequence tasks, including Text-To-Speech (TTS) and Neural Machine Translation (NMT), but can be difficult to train. The standard…

Computation and Language · Computer Science 2022-11-08 Qingyun Dou , Mark Gales

Deep learning models with attention mechanisms have achieved exceptional results for many tasks, including language tasks and recommendation systems. Whereas previous studies have emphasized allocation of phone agents, we focused on inbound…

Machine Learning · Computer Science 2020-05-28 Ta-Chun Su , Guan-Ying Chen

The self-attention mechanism has significantly advanced the field of natural language processing, facilitating the development of advanced language-learning machines. Although its utility is widely acknowledged, the precise mechanisms of…

Computation and Language · Computer Science 2026-02-04 Tal Halevi , Yarden Tzach , Ronit D. Gross , Shalom Rosner , Ido Kanter

Vision Transformers are very popular nowadays due to their state-of-the-art performance in several computer vision tasks, such as image classification and action recognition. Although their performance has been greatly enhanced through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dimitrios Konstantinidis , Ilias Papastratis , Kosmas Dimitropoulos , Petros Daras

The self-attention mechanism has been a key factor in the advancement of vision Transformers. However, its quadratic complexity imposes a heavy computational burden in high-resolution scenarios, restricting the practical application.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Dongchen Han , Tianyu Li , Ziyi Wang , Gao Huang

Normalizing flows provide an elegant method for obtaining tractable density estimates from distributions by using invertible transformations. The main challenge is to improve the expressivity of the models while keeping the invertibility…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Avideep Mukherjee , Badri Narayan Patro , Vinay P. Namboodiri

The Business Process Modeling Notation (BPMN) is a widely used standard notation for defining intra- and inter-organizational workflows. However, the informal description of the BPMN execution semantics leads to different interpretations of…

Software Engineering · Computer Science 2024-10-09 Tim Kräuter , Adrian Rutle , Harald König , Yngve Lamo

A novel constructive mathematical model based on the multifractal formalism in order to accurately characterizing the localized fluctuations present in the course of traffic flows today high-speed computer networks is presented. The…

Networking and Internet Architecture · Computer Science 2021-06-29 G. Millán , G. Lefranc , R. Osorio-Comparán

The multi-head self-attention mechanism of the transformer model has been thoroughly investigated recently. In one vein of study, researchers are interested in understanding why and how transformers work. In another vein, researchers…

Computation and Language · Computer Science 2022-10-28 Raymond Li , Wen Xiao , Linzi Xing , Lanjun Wang , Gabriel Murray , Giuseppe Carenini

Transformers are built upon multi-head scaled dot-product attention and positional encoding, which aim to learn the feature representations and token dependencies. In this work, we focus on enhancing the distinctive representation by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Litao Yu , Jian Zhang

Multimodal learning has gained much success in recent years. However, current multimodal fusion methods adopt the attention mechanism of Transformers to implicitly learn the underlying correlation of multimodal features. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Thanh-Dat Truong , Christophe Bobda , Nitin Agarwal , Khoa Luu

Many sequence-to-sequence tasks in natural language processing are roughly monotonic in the alignment between source and target sequence, and previous work has facilitated or enforced learning of monotonic attention behavior via specialized…

Computation and Language · Computer Science 2021-04-09 Annette Rios , Chantal Amrhein , Noëmi Aepli , Rico Sennrich

Data annotated by humans is a source of knowledge by describing the peculiarities of the problem and therefore fueling the decision process of the trained model. Unfortunately, the annotation process for subjective natural language…

Computation and Language · Computer Science 2023-12-14 Kamil Kanclerz , Julita Bielaniewicz , Marcin Gruza , Jan Kocon , Stanisław Woźniak , Przemysław Kazienko

Auto-regressive sequence-to-sequence models with attention mechanisms have achieved state-of-the-art performance in various tasks including Text-To-Speech (TTS) and Neural Machine Translation (NMT). The standard training approach, teacher…

Computation and Language · Computer Science 2021-04-06 Qingyun Dou , Yiting Lu , Potsawee Manakul , Xixin Wu , Mark J. F. Gales

Transformer-based models have achieved top performance on major video recognition benchmarks. Benefiting from the self-attention mechanism, these models show stronger ability of modeling long-range dependencies compared to CNN-based models.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Rui Wang , Zuxuan Wu , Dongdong Chen , Yinpeng Chen , Xiyang Dai , Mengchen Liu , Luowei Zhou , Lu Yuan , Yu-Gang Jiang

The paper addresses the problem of recognition of actions in video with low inter-class variability such as Table Tennis strokes. Two stream, "twin" convolutional neural networks are used with 3D convolutions both on RGB data and optical…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Pierre-Etienne Martin , Jenny Benois-Pineau , Renaud Péteri , Julien Morlier