English
Related papers

Related papers: Sum-Product Networks for Sequence Labeling

200 papers

Sum-product networks (SPNs) represent an emerging class of neural networks with clear probabilistic semantics and superior inference speed over graphical models. This work reveals a strikingly intimate connection between SPNs and tensor…

Machine Learning · Computer Science 2018-11-12 Ching-Yun Ko , Cong Chen , Yuke Zhang , Kim Batselier , Ngai Wong

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant. While most semi-supervised approaches enforce restrictive assumptions on the data distribution, recent work has managed to…

Machine Learning · Statistics 2017-10-11 Martin Trapp , Tamas Madl , Robert Peharz , Franz Pernkopf , Robert Trappl

Sum-product networks (SPNs) have recently emerged as a novel deep learning architecture enabling highly efficient probabilistic inference. Since their introduction, SPNs have been applied to a wide range of data modalities and extended to…

Machine Learning · Computer Science 2022-11-15 Adam Dejl , Harsh Deep , Jonathan Fei , Ardavan Saeedi , Li-wei H. Lehman

Superpixel-based Higher-order Conditional random fields (SP-HO-CRFs) are known for their effectiveness in enforcing both short and long spatial contiguity for pixelwise labelling in computer vision. However, their higher-order potentials…

Computer Vision and Pattern Recognition · Computer Science 2018-04-09 Li Sulimowicz , Ishfaq Ahmad , Alexander Aved

CRF has been used as a powerful model for statistical sequence labeling. For neural sequence labeling, however, BiLSTM-CRF does not always lead to better results compared with BiLSTM-softmax local classification. This can be because the…

Computation and Language · Computer Science 2019-11-11 Leyang Cui , Yue Zhang

Probabilistic graphical models are a central tool in AI; however, they are generally not as expressive as deep neural models, and inference is notoriously hard and slow. In contrast, deep probabilistic models such as sum-product networks…

Machine Learning · Computer Science 2019-10-01 Xiaoting Shao , Alejandro Molina , Antonio Vergari , Karl Stelzner , Robert Peharz , Thomas Liebig , Kristian Kersting

Sum-Product Networks (SPNs) are recently introduced deep tractable probabilistic models by which several kinds of inference queries can be answered exactly and in a tractable time. Up to now, they have been largely used as black box density…

Machine Learning · Computer Science 2018-08-27 Antonio Vergari , Nicola Di Mauro , Floriana Esposito

The need for consistent treatment of uncertainty has recently triggered increased interest in probabilistic deep learning methods. However, most current approaches have severe limitations when it comes to inference, since many of these…

Sum-Product Networks (SPNs) are hierarchical, graphical models that combine benefits of deep learning and probabilistic modeling. SPNs offer unique advantages to applications demanding exact probabilistic inference over high-dimensional,…

Machine Learning · Computer Science 2020-09-24 Jos van de Wolfshaar , Andrzej Pronobis

We introduce sum-product networks (SPNs) for robust speech processing through a simple robust automatic speaker identification (ASI) task. SPNs are deep probabilistic graphical models capable of answering multiple probabilistic queries. We…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Aaron Nicolson , Kuldip K. Paliwal

A sum-product network (SPN) is a graphical model that allows several types of inferences to be drawn efficiently. There are two types of learning for SPNs: Learning the architecture of the model, and learning the parameters. In this paper,…

Machine Learning · Computer Science 2021-10-18 Ernst Althaus , Mohammad Sadeq Dousti , Stefan Kramer , Nick Johannes Peter Rassau

Neural approaches to sequence labeling often use a Conditional Random Field (CRF) to model their output dependencies, while Recurrent Neural Networks (RNN) are used for the same purpose in other tasks. We set out to establish RNNs as an…

Machine Learning · Computer Science 2018-10-02 Saeed Najafi , Colin Cherry , Grzegorz Kondrak

The proliferation of sensor devices monitoring human activity generates voluminous amount of temporal sequences needing to be interpreted and categorized. Moreover, complex behavior detection requires the personalization of multi-sensor…

Machine Learning · Computer Science 2016-02-08 Myriam Abramson

This paper proposes hybrid semi-Markov conditional random fields (SCRFs) for neural sequence labeling in natural language processing. Based on conventional conditional random fields (CRFs), SCRFs have been designed for the tasks of…

Computation and Language · Computer Science 2018-05-11 Zhi-Xiu Ye , Zhen-Hua Ling

The key limiting factor in graphical model inference and learning is the complexity of the partition function. We thus ask the question: what are general conditions under which the partition function is tractable? The answer leads to a new…

Machine Learning · Computer Science 2012-02-20 Hoifung Poon , Pedro Domingos

We address the problem of semantic segmentation using deep learning. Most segmentation systems include a Conditional Random Field (CRF) to produce a structured output that is consistent with the image's visual features. Recent deep learning…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Anurag Arnab , Sadeep Jayasumana , Shuai Zheng , Philip Torr

Higher-order features bring significant accuracy gains in semantic dependency parsing. However, modeling higher-order features with exact inference is NP-hard. Graph neural networks (GNNs) have been demonstrated to be an effective tool for…

Computation and Language · Computer Science 2022-01-28 Bin Li , Yunlong Fan , Yikemaiti Sataer , Zhiqiang Gao

Sequence labeling is a widely used method for named entity recognition and information extraction from unstructured natural language data. In clinical domain one major application of sequence labeling involves extraction of medical entities…

Computation and Language · Computer Science 2016-08-03 Abhyuday Jagannatha , Hong Yu

This paper studies node classification in the inductive setting, i.e., aiming to learn a model on labeled training graphs and generalize it to infer node labels on unlabeled test graphs. This problem has been extensively studied with graph…

Machine Learning · Computer Science 2022-04-18 Meng Qu , Huiyu Cai , Jian Tang

Deep generative models have recently made a remarkable progress in capturing complex probability distributions over graphs. However, they are intractable and thus unable to answer even the most basic probabilistic inference queries without…

Machine Learning · Computer Science 2024-08-20 Milan Papež , Martin Rektoris , Václav Šmídl , Tomáš Pevný
‹ Prev 1 2 3 10 Next ›