English
Related papers

Related papers: Improved Relation Classification by Deep Recurrent…

200 papers

Recursive Neural Networks (RvNNs), which compose sequences according to their underlying hierarchical syntactic structure, have performed well in several natural language processing tasks compared to similar models without structural…

Computation and Language · Computer Science 2021-06-14 Jishnu Ray Chowdhury , Cornelia Caragea

Recurrent Neural Networks (RNNs) achieve state-of-the-art results in many sequence-to-sequence modeling tasks. However, RNNs are difficult to train and tend to suffer from overfitting. Motivated by the Data Processing Inequality (DPI), we…

Machine Learning · Statistics 2018-05-24 Ziv Aharoni , Gal Rattner , Haim Permuter

In image labeling, local representations for image units are usually generated from their surrounding image patches, thus long-range contextual information is not effectively encoded. In this paper, we introduce recurrent neural networks…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Bing Shuai , Zhen Zuo , Gang Wang , Bing Wang

In this paper, we study the challenging problem of categorizing videos according to high-level semantics such as the existence of a particular human action or a complex event. Although extensive efforts have been devoted in recent years,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Yu-Gang Jiang , Zuxuan Wu , Jun Wang , Xiangyang Xue , Shih-Fu Chang

Despite their impressive performance, Deep Neural Networks (DNNs) typically underperform Gradient Boosting Trees (GBTs) on many tabular-dataset learning tasks. We propose that applying a different regularization coefficient to each weight…

Machine Learning · Statistics 2018-10-25 Ira Shavitt , Eran Segal

Deep learning research on relation classification has achieved solid performance in the general domain. This study proposes a convolutional neural network (CNN) architecture with a multi-pooling operation for medical relation classification…

Computation and Language · Computer Science 2018-05-18 Bin He , Yi Guan , Rui Dai

Recurrent Neural Networks (RNNs) produce state-of-art performance on many machine learning tasks but their demand on resources in terms of memory and computational power are often high. Therefore, there is a great interest in optimizing the…

Neural and Evolutionary Computing · Computer Science 2017-02-28 Joachim Ott , Zhouhan Lin , Ying Zhang , Shih-Chii Liu , Yoshua Bengio

Automated ranking of pre-trained Deep Neural Networks (DNNs) reduces the required time for selecting optimal pre-trained DNN and boost the classification performance in transfer learning. In this paper, we introduce a novel algorithm to…

Machine Learning · Computer Science 2020-12-29 Mostafa Kalhor , Ahmad Kalhor , Mehdi Rahmani

This work proposes a novel approach to the deep hierarchical classification task, i.e., the problem of classifying data according to multiple labels organized in a rigid parent-child structure. It consists in a multi-output deep neural…

Artificial Intelligence · Computer Science 2024-10-07 Lorenzo Fiaschi , Marco Cococcioni

This study introduces database expansion using the Minimum Description Length (MDL) algorithm to expand the database for better relation extraction. Different from other previous relation extraction researches, our method improves system…

Information Retrieval · Computer Science 2020-07-31 Diyah Puspitaningrum

Natural language processing (NLP) and neural networks (NNs) have both undergone significant changes in recent years. For active learning (AL) purposes, NNs are, however, less commonly used -- despite their current popularity. By using the…

Computation and Language · Computer Science 2020-08-18 Christopher Schröder , Andreas Niekler

Deep learning techniques are often criticized to heavily depend on a large quantity of labeled data. This problem is even more challenging in medical image analysis where the annotator expertise is often scarce. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Florian Dubost , Gerda Bortsova , Hieab Adams , M. Arfan Ikram , Wiro Niessen , Meike Vernooij , Marleen de Bruijne

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be…

Optimization and Control · Mathematics 2019-07-26 S. Günther , L. Ruthotto , J. B. Schroder , E. C. Cyr , N. R. Gauger

Despite achieving state-of-the-art performance, deep learning methods generally require a large amount of labeled data during training and may suffer from overfitting when the sample size is small. To ensure good generalizability of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xiaoxu Li , Liyun Yu , Xiaochen Yang , Zhanyu Ma , Jing-Hao Xue , Jie Cao , Jun Guo

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie

This survey provides an examination of the use of Deep Neural Networks (DNN) in Collaborative Filtering (CF) recommendation systems. As the digital world increasingly relies on data-driven approaches, traditional CF techniques face…

Artificial Intelligence · Computer Science 2024-12-03 Pang Li , Shahrul Azman Mohd Noah , Hafiz Mohd Sarim

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

Relation classification is an important semantic processing task in the field of natural language processing (NLP). In this paper, we present a novel model, Structure Regularized Bidirectional Recurrent Convolutional Neural…

Computation and Language · Computer Science 2017-11-08 Ji Wen

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

Machine Learning · Computer Science 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De