English
Related papers

Related papers: Deep Tree Transductions - A Short Survey

200 papers

Neural networks with tree-based sentence encoders have shown better results on many downstream tasks. Most of existing tree-based encoders adopt syntactic parsing trees as the explicit structure prior. To study the effectiveness of…

Computation and Language · Computer Science 2018-08-30 Haoyue Shi , Hao Zhou , Jiaze Chen , Lei Li

We introduce a new dataset of logical entailments for the purpose of measuring models' ability to capture and exploit the structure of logical expressions against an entailment prediction task. We use this task to compare a series of…

Neural and Evolutionary Computing · Computer Science 2018-02-26 Richard Evans , David Saxton , David Amos , Pushmeet Kohli , Edward Grefenstette

We propose a novel method for approximate inference in Bayesian networks (BNs). The idea is to sample data from a BN, learn a latent tree model (LTM) from the data offline, and when online, make inference with the LTM instead of the…

Machine Learning · Computer Science 2014-01-16 Yi Wang , Nevin L. Zhang , Tao Chen

Efficient prediction of internet traffic is an essential part of Self Organizing Network (SON) for ensuring proactive management. There are many existing solutions for internet traffic prediction with higher accuracy using deep learning.…

Machine Learning · Computer Science 2022-05-10 Sajal Saha , Anwar Haque , Greg Sidebottom

Tree perception is an essential building block toward autonomous forestry operations. Current developments generally consider input data from lidar sensors to solve forest navigation, tree detection and diameter estimation problems. Whereas…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Vincent Grondin , Jean-Michel Fortin , François Pomerleau , Philippe Giguère

Numerical modeling of different structural materials that have highly nonlinear behaviors has always been a challenging problem in engineering disciplines. Experimental data is commonly used to characterize this behavior. This study aims to…

Machine Learning · Computer Science 2020-07-28 Elif Ecem Bas , Denis Aslangil , Mohamed A. Moustafa

In Natural Language Processing (NLP), we often need to extract information from tree topology. Sentence structure can be represented via a dependency tree or a constituency tree structure. For this reason, a variant of LSTMs, named…

Computation and Language · Computer Science 2019-01-03 Mahtab Ahmed , Muhammad Rifayat Samee , Robert E. Mercer

Neural networks (NNs) and decision trees (DTs) are both popular models of machine learning, yet coming with mutually exclusive advantages and limitations. To bring the best of the two worlds, a variety of approaches are proposed to…

Machine Learning · Computer Science 2022-09-09 Haoling Li , Jie Song , Mengqi Xue , Haofei Zhang , Jingwen Ye , Lechao Cheng , Mingli Song

Sequential LSTM has been extended to model tree structures, giving competitive results for a number of tasks. Existing methods model constituent trees by bottom-up combinations of constituent nodes, making direct use of input word…

Computation and Language · Computer Science 2016-11-22 Zhiyang Teng , Yue Zhang

Theory of tree transducers provides a foundation for understanding expressiveness and complexity of analysis problems for specification languages for transforming hierarchically structured data such as XML documents. We introduce streaming…

Formal Languages and Automata Theory · Computer Science 2012-02-23 Rajeev Alur , Loris D'Antoni

Long Short-Term Memory (LSTM) is a prominent recurrent neural network for extracting dependencies from sequential data such as time-series and multi-view data, having achieved impressive results for different visual recognition tasks. A…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Alireza Sepas-Moghaddam , Ali Etemad , Fernando Pereira , Paulo Lobato Correia

Large language models are increasingly deployed across diverse applications. This often includes tasks LLMs have not encountered during training. This implies that enumerating and obtaining the high-quality training data for all tasks is…

Computation and Language · Computer Science 2025-11-11 Shambhavi Krishna , Atharva Naik , Chaitali Agarwal , Sudharshan Govindan , Taesung Lee , Haw-Shiuan Chang

We propose a transition-based dependency parser using Recurrent Neural Networks with Long Short-Term Memory (LSTM) units. This extends the feedforward neural network parser of Chen and Manning (2014) and enables modelling of entire…

Computation and Language · Computer Science 2016-07-01 Adhiguna Kuncoro , Yuichiro Sawai , Kevin Duh , Yuji Matsumoto

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on…

Computation and Language · Computer Science 2015-05-12 Xiangang Li , Xihong Wu

Decision tree induction systems are being used for knowledge acquisition in noisy domains. This paper develops a subjective Bayesian interpretation of the task tackled by these systems and the heuristic methods they use. It is argued that…

Artificial Intelligence · Computer Science 2013-04-11 Wray L. Buntine

Large language models (LLMs) provide powerful means to leverage prior knowledge for predictive modeling when data is limited. In this work, we demonstrate how LLMs can use their compressed world knowledge to generate intrinsically…

Deep Learning models enjoy considerable success in Natural Language Processing. While deep architectures produce useful representations that lead to improvements in various tasks, they are often difficult to interpret. This makes the…

Computation and Language · Computer Science 2013-04-29 Christian Scheible , Hinrich Schuetze

For years, recursive neural networks (RvNNs) have been shown to be suitable for representing text into fixed-length vectors and achieved good performance on several natural language processing tasks. However, the main drawback of RvNNs is…

Computation and Language · Computer Science 2017-11-22 Jihun Choi , Kang Min Yoo , Sang-goo Lee

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

Computation and Language · Computer Science 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

Various methods using machine and deep learning have been proposed to tackle different tasks in predictive process monitoring, forecasting for an ongoing case e.g. the most likely next event or suffix, its remaining time, or an…

Machine Learning · Computer Science 2022-12-14 Jari Peeperkorn , Seppe vanden Broucke , Jochen De Weerdt