English
Related papers

Related papers: Attention-Based Capsule Networks with Dynamic Rout…

200 papers

Capsule networks (see e.g. Hinton et al., 2018) aim to encode knowledge of and reason about the relationship between an object and its parts. In this paper we specify a generative model for such data, and derive a variational algorithm for…

Machine Learning · Computer Science 2023-03-29 Alfredo Nazabal , Nikolaos Tsagkas , Christopher K. I. Williams

Capsule Networks (CapsNets) have been re-introduced as a more compact and interpretable alternative to standard deep neural networks. While recent efforts have proved their compression capabilities, to date, their interpretability…

Machine Learning · Computer Science 2024-12-16 Saja Tawalbeh , José Oramas

Dependency trees convey rich structural information that is proven useful for extracting relations among entities in text. However, how to effectively make use of relevant information while ignoring irrelevant information from the…

Computation and Language · Computer Science 2020-09-08 Zhijiang Guo , Yan Zhang , Wei Lu

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Juan P. Vigueras-Guillén , Arijit Patra , Ola Engkvist , Frank Seeliger

In this study, a novel method for extracting named entities and relations from unstructured text based on the table representation is presented. By using contextualized word embeddings, the proposed method computes representations for…

Computation and Language · Computer Science 2022-01-28 Youmi Ma , Tatsuya Hiraoka , Naoaki Okazaki

A recently proposed method in deep learning groups multiple neurons to capsules such that each capsule represents an object or part of an object. Routing algorithms route the output of capsules from lower-level layers to upper-level layers.…

Machine Learning · Computer Science 2021-01-20 David Peer , Sebastian Stabinger , Antonio Rodriguez-Sanchez

Relation extraction as an important natural Language processing (NLP) task is to identify relations between named entities in text. Recently, graph convolutional networks over dependency trees have been widely used to capture syntactic…

Computation and Language · Computer Science 2024-11-13 Xin Wang , Xinyi Bai

Relation triple extraction, which outputs a set of triples from long sentences, plays a vital role in knowledge acquisition. Large language models can accurately extract triples from simple sentences through few-shot learning or fine-tuning…

Computation and Language · Computer Science 2024-04-16 Zepeng Ding , Wenhao Huang , Jiaqing Liang , Deqing Yang , Yanghua Xiao

Capsule networks excel in understanding spatial relationships in 2D data for vision related tasks. Even though they are not designed to capture 1D temporal relationships, with TimeCaps we demonstrate that given the ability, capsule networks…

Transformer hugely benefits from its key design of the multi-head self-attention network (SAN), which extracts information from various perspectives through transforming the given input into different subspaces. However, its simple linear…

Computation and Language · Computer Science 2020-05-01 Sufeng Duan , Juncheng Cao , Hai Zhao

Named entities are usually composable and extensible. Typical examples are names of symptoms and diseases in medical areas. To distinguish these entities from general entities, we name them \textit{compound entities}. In this paper, we…

Computation and Language · Computer Science 2018-11-28 Qi Wang , Chenming Xu , Yangming Zhou , Tong Ruan , Daqi Gao , Ping He

Distantly supervised relation extraction has been widely used to find novel relational facts from plain text. To predict the relation between a pair of two target entities, existing methods solely rely on those direct sentences containing…

Computation and Language · Computer Science 2017-09-15 Wenyuan Zeng , Yankai Lin , Zhiyuan Liu , Maosong Sun

We present group equivariant capsule networks, a framework to introduce guaranteed equivariance and invariance properties to the capsule network idea. Our work can be divided into two contributions. First, we present a generic routing by…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Jan Eric Lenssen , Matthias Fey , Pascal Libuschewski

The performance of relation extraction models has increased considerably with the rise of neural networks. However, a key issue of neural relation extraction is robustness: the models do not scale well to long sentences with multiple…

Computation and Language · Computer Science 2021-04-23 Heike Adel , Jannik Strötgen

User reviews contain rich semantics towards the preference of users to features of items. Recently, many deep learning based solutions have been proposed by exploiting reviews for recommendation. The attention mechanism is mainly adopted in…

Information Retrieval · Computer Science 2019-07-02 Chenliang Li , Cong Quan , Li Peng , Yunwei Qi , Yuming Deng , Libing Wu

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Liheng Zhang , Marzieh Edraki , Guo-Jun Qi

Joint entity and relation extraction is the fundamental task of information extraction, consisting of two subtasks: named entity recognition and relation extraction. However, most existing joint extraction methods suffer from issues of…

Computation and Language · Computer Science 2024-03-28 Wenjun Kong , Yamei Xia

Being able to recognize words as slots and detect the intent of an utterance has been a keen issue in natural language understanding. The existing works either treat slot filling and intent detection separately in a pipeline manner, or…

Computation and Language · Computer Science 2019-07-09 Chenwei Zhang , Yaliang Li , Nan Du , Wei Fan , Philip S. Yu

Multi-label classification plays a momentous role in perceiving intricate contents of an aerial image and triggers several related studies over the last years. However, most of them deploy few efforts in exploiting label relations, while…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Yuansheng Hua , Lichao Mou , Xiao Xiang Zhu

Unsupervised learning of compact and relevant state representations has been proved very useful at solving complex reinforcement learning tasks. In this paper, we propose a recurrent capsule network that learns such representations by…

Machine Learning · Computer Science 2019-02-25 Louis Annabi , Michael Garcia Ortiz