English
Related papers

Related papers: AIN: Fast and Accurate Sequence Labeling with Appr…

200 papers

There are two major approaches for sequence labeling. One is the probabilistic gradient-based methods such as conditional random fields (CRF) and neural networks (e.g., RNN), which have high accuracy but drawbacks: slow training, and no…

Machine Learning · Computer Science 2018-11-20 Xu Sun , Shuming Ma , Yi Zhang , Xuancheng Ren

We propose a neuralized undirected graphical model called Neural-Hidden-CRF to solve the weakly-supervised sequence labeling problem. Under the umbrella of probabilistic undirected graph theory, the proposed Neural-Hidden-CRF embedded with…

Computation and Language · Computer Science 2023-10-02 Zhijun Chen , Hailong Sun , Wanhao Zhang , Chunyi Xu , Qianren Mao , Pengpeng Chen

Modern computer vision (CV) is often based on convolutional neural networks (CNNs) that excel at hierarchical feature extraction. The previous generation of CV approaches was often based on conditional random fields (CRFs) that excel at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Shaofei Wang , Vishnu Lokhande , Maneesh Singh , Konrad Kording , Julian Yarkony

The fully connected conditional random field (CRF) with Gaussian pairwise potentials has proven popular and effective for multi-class semantic segmentation. While the energy of a dense CRF can be minimized accurately using a linear…

Computer Vision and Pattern Recognition · Computer Science 2017-02-15 Thalaiyasingam Ajanthan , Alban Desmaison , Rudy Bunel , Mathieu Salzmann , Philip H. S. Torr , M. Pawan Kumar

Autoregressive sequence models achieve state-of-the-art performance in domains like machine translation. However, due to the autoregressive factorization nature, these models suffer from heavy latency during inference. Recently,…

Machine Learning · Computer Science 2020-01-10 Zhiqing Sun , Zhuohan Li , Haoqing Wang , Zi Lin , Di He , Zhi-Hong Deng

Designed as extremely deep architectures, deep residual networks which provide a rich visual representation and offer robust convergence behaviors have recently achieved exceptional performance in numerous computer vision problems. Being…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 T. Hoang Ngan Le , Chi Nhan Duong , Ligong Han , Khoa Luu , Marios Savvides , Dipan Pal

This paper presents a method of designing specific high-order dependency factor on the linear chain conditional random fields (CRFs) for named entity recognition (NER). Named entities tend to be separated from each other by multiple outside…

Computation and Language · Computer Science 2018-05-29 Wangjin Lee , Jinwook Choi

Estimating probability distribution is one of the core issues in the NLP field. However, in both deep learning (DL) and pre-DL eras, unlike the vast applications of linear-chain CRF in sequence labeling tasks, very few works have applied…

Computation and Language · Computer Science 2020-08-11 Yu Zhang , Houquan Zhou , Zhenghua Li

Most state-of-the-art techniques for multi-class image segmentation and labeling use conditional random fields defined over pixels or image regions. While region-level models often feature dense pairwise connectivity, pixel-level models are…

Computer Vision and Pattern Recognition · Computer Science 2012-10-23 Philipp Krähenbühl , Vladlen Koltun

This paper presents an empirical study of two widely-used sequence prediction models, Conditional Random Fields (CRFs) and Long Short-Term Memory Networks (LSTMs), on two fundamental tasks for Vietnamese text processing, including…

Computation and Language · Computer Science 2017-08-31 Phuong Le-Hong , Minh Pham Quang Nhat , Thai-Hoang Pham , Tuan-Anh Tran , Dang-Minh Nguyen

For the challenging semantic image segmentation task the most efficient models have traditionally combined the structured modelling capabilities of Conditional Random Fields (CRFs) with the feature extraction power of CNNs. In more recent…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Marvin T. T. Teichmann , Roberto Cipolla

Sequence labeling is a widely used method for named entity recognition and information extraction from unstructured natural language data. In clinical domain one major application of sequence labeling involves extraction of medical entities…

Computation and Language · Computer Science 2016-08-03 Abhyuday Jagannatha , Hong Yu

Pixel-level labelling tasks, such as semantic segmentation, play a central role in image understanding. Recent approaches have attempted to harness the capabilities of deep learning techniques for image recognition to tackle pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2016-04-15 Shuai Zheng , Sadeep Jayasumana , Bernardino Romera-Paredes , Vibhav Vineet , Zhizhong Su , Dalong Du , Chang Huang , Philip H. S. Torr

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

Computation and Language · Computer Science 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

Semi-Markov Conditional Random Fields (semi-CRFs) assign labels to segments of a sequence rather than to individual positions, enabling exact inference over segment-level features and principled uncertainty estimates at their boundaries.…

Machine Learning · Computer Science 2026-04-22 Benjamin K. Johnson , Thomas Goralski , Ayush Semwal , Hui Shen , H. Josh Jang

We address the problem of semantic segmentation using deep learning. Most segmentation systems include a Conditional Random Field (CRF) to produce a structured output that is consistent with the image's visual features. Recent deep learning…

Computer Vision and Pattern Recognition · Computer Science 2016-08-01 Anurag Arnab , Sadeep Jayasumana , Shuai Zheng , Philip Torr

This paper proposes hybrid semi-Markov conditional random fields (SCRFs) for neural sequence labeling in natural language processing. Based on conventional conditional random fields (CRFs), SCRFs have been designed for the tasks of…

Computation and Language · Computer Science 2018-05-11 Zhi-Xiu Ye , Zhen-Hua Ling

Conditional Random Field (CRF) based neural models are among the most performant methods for solving sequence labeling problems. Despite its great success, CRF has the shortcoming of occasionally generating illegal sequences of tags, e.g.…

Machine Learning · Computer Science 2021-03-22 Tianwen Wei , Jianwei Qi , Shenghuan He , Songtao Sun

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

Dense conditional random fields (CRFs) have become a popular framework for modelling several problems in computer vision such as stereo correspondence and multi-class semantic segmentation. By modelling long-range interactions, dense CRFs…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Thomas Joy , Alban Desmaison , Thalaiyasingam Ajanthan , Rudy Bunel , Mathieu Salzmann , Pushmeet Kohli , Philip H. S. Torr , M. Pawan Kumar