English
Related papers

Related papers: SARN: Relational Reasoning through Sequential Atte…

200 papers

This paper is concerned with learning to solve tasks that require a chain of interdependent steps of relational inference, like answering complex questions about the relationships between objects, or solving puzzles where the smaller…

Artificial Intelligence · Computer Science 2018-11-30 Rasmus Berg Palm , Ulrich Paquet , Ole Winther

Semantic role labeling (SRL) is a task to recognize all the predicate-argument pairs of a sentence, which has been in a performance improvement bottleneck after a series of latest works were presented. This paper proposes a novel…

Computation and Language · Computer Science 2019-08-08 Chaoyu Guan , Yuhao Cheng , Hai Zhao

While attention mechanisms have been proven to be effective in many NLP tasks, majority of them are data-driven. We propose a novel knowledge-attention encoder which incorporates prior knowledge from external lexical resources into deep…

Computation and Language · Computer Science 2020-03-05 Pengfei Li , Kezhi Mao , Xuefeng Yang , Qi Li

Heretofore, neural networks with external memory are restricted to single memory with lossy representations of memory interactions. A rich representation of relationships between memory pieces urges a high-order and segregated relational…

Machine Learning · Computer Science 2020-06-12 Hung Le , Truyen Tran , Svetha Venkatesh

With the fast development of effective and low-cost human skeleton capture systems, skeleton-based action recognition has attracted much attention recently. Most existing methods use Convolutional Neural Network (CNN) and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Wu Zheng , Lin Li , Zhaoxiang Zhang , Yan Huang , Liang Wang

Transformer-based sequential recommendation (SR) has been booming in recent years, with the self-attention mechanism as its key component. Self-attention has been widely believed to be able to effectively select those informative and…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Qichen Ye , Yueqi Xie , Jingqi Gao , Shoujin Wang , Jae Boum Kim , Chenyu You , Sunghun Kim

The aim of this work is to introduce simplicial attention networks (SANs), i.e., novel neural architectures that operate on data defined on simplicial complexes leveraging masked self-attentional layers. Hinging on formal arguments from…

Machine Learning · Computer Science 2022-03-29 L. Giusti , C. Battiloro , P. Di Lorenzo , S. Sardellitti , S. Barbarossa

Support vector machine (SVM) and neural networks (NN) have strong complementarity. SVM focuses on the inner operation among samples while NN focuses on the operation among the features within samples. Thus, it is promising and attractive to…

Machine Learning · Computer Science 2023-09-26 Qiaoling Yang , Linkai Luo , Haoyu Zhang , Hong Peng , Ziyang Chen

Relational reasoning is a central component of intelligent behavior, but has proven difficult for neural networks to learn. The Relation Network (RN) module was recently proposed by DeepMind to solve such problems, and demonstrated…

Computation and Language · Computer Science 2019-09-10 Martin Andrews , Sam Witteveen

In this paper, we address referring expression comprehension: localizing an image region described by a natural language expression. While most recent work treats expressions as a single unit, we propose to decompose them into three modular…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Licheng Yu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Mohit Bansal , Tamara L. Berg

Reason and inference require process as well as memory skills by humans. Neural networks are able to process tasks like image recognition (better than humans) but in memory aspects are still limited (by attention mechanism, size). Recurrent…

Machine Learning · Computer Science 2017-03-03 Amit Sahu

Visual Commonsense Reasoning (VCR) remains a significant yet challenging research problem in the realm of visual reasoning. A VCR model generally aims at answering a textual question regarding an image, followed by the rationale prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zhenyang Li , Yangyang Guo , Kejie Wang , Fan Liu , Liqiang Nie , Mohan Kankanhalli

We investigate response selection for multi-turn conversation in retrieval-based chatbots. Existing studies pay more attention to the matching between utterances and responses by calculating the matching score based on learned features,…

Computation and Language · Computer Science 2021-01-18 Yongkang Liu , Shi Feng , Daling Wang , Kaisong Song , Feiliang Ren , Yifei Zhang

Graph representation learning methods have mostly been limited to the modelling of node-wise interactions. Recently, there has been an increased interest in understanding how higher-order structures can be utilised to further enhance the…

Machine Learning · Computer Science 2022-04-21 Christopher Wei Jin Goh , Cristian Bodnar , Pietro Liò

Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution (SISR). However, very deep networks can suffer from training difficulty and hardly achieve further performance gain. There are…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Alexander Panaetov , Karim Elhadji Daou , Igor Samenko , Evgeny Tetin , Ilya Ivanov

We present Searn, an algorithm for integrating search and learning to solve complex structured prediction problems such as those that occur in natural language, speech, computational biology, and vision. Searn is a meta-algorithm that…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , John Langford , Daniel Marcu

Learning a matching function between two text sequences is a long standing problem in NLP research. This task enables many potential applications such as question answering and paraphrase identification. This paper proposes Co-Stack…

Computation and Language · Computer Science 2018-10-09 Yi Tay , Luu Anh Tuan , Siu Cheung Hui

It has been well recognized that modeling object-to-object relations would be helpful for object detection. Nevertheless, the problem is not trivial especially when exploring the interactions between objects to boost video object detectors.…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Jiajun Deng , Yingwei Pan , Ting Yao , Wengang Zhou , Houqiang Li , Tao Mei

This paper proposes a novel Attention-based Multi-Reference Super-resolution network (AMRSR) that, given a low-resolution image, learns to adaptively transfer the most similar texture from multiple reference images to the super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Marco Pesavento , Marco Volino , Adrian Hilton

Over the past few years, question answering and information retrieval systems have become widely used. These systems attempt to find the answer of the asked questions from raw text sources. A component of these systems is Answer Selection…

Computation and Language · Computer Science 2019-11-13 Jamshid Mozafari , Mohammad Ali Nematbakhsh , Afsaneh Fatemi