中文
相关论文

相关论文: Capturing Long-range Contextual Dependencies with …

200 篇论文

We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs,…

机器学习 · 统计学 2015-03-19 Maksims N. Volkovs , Hugo Larochelle , Richard S. Zemel

Conditional Random Rields (CRF) have been widely applied in image segmentations. While most studies rely on hand-crafted features, we here propose to exploit a pre-trained large convolutional neural network (CNN) to generate deep features…

计算机视觉与模式识别 · 计算机科学 2015-03-31 Fayao Liu , Guosheng Lin , Chunhua Shen

The linear-chain Conditional Random Field (CRF) model is one of the most widely-used neural sequence labeling approaches. Exact probabilistic inference algorithms such as the forward-backward and Viterbi algorithms are typically applied in…

计算与语言 · 计算机科学 2020-10-13 Xinyu Wang , Yong Jiang , Nguyen Bach , Tao Wang , Zhongqiang Huang , Fei Huang , Kewei Tu

This paper proposes hybrid semi-Markov conditional random fields (SCRFs) for neural sequence labeling in natural language processing. Based on conventional conditional random fields (CRFs), SCRFs have been designed for the tasks of…

计算与语言 · 计算机科学 2018-05-11 Zhi-Xiu Ye , Zhen-Hua Ling

We propose a novel discriminative model for sequence labeling called Bregman conditional random fields (BCRF). Contrary to standard linear-chain conditional random fields, BCRF allows fast parallelizable inference algorithms based on…

机器学习 · 计算机科学 2025-06-03 Caio Corro , Mathieu Lacroix , Joseph Le Roux

The key challenge of sequence representation learning is to capture the long-range temporal dependencies. Typical methods for supervised sequence representation learning are built upon recurrent neural networks to capture temporal…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Wenjie Pei , Xin Feng , Canmiao Fu , Qiong Cao , Guangming Lu , Yu-Wing Tai

We present LS-CRF, a new method for very efficient large-scale training of Conditional Random Fields (CRFs). It is inspired by existing closed-form expressions for the maximum likelihood parameters of a generative graphical model with tree…

机器学习 · 计算机科学 2014-03-28 Alexander Kolesnikov , Matthieu Guillaumin , Vittorio Ferrari , Christoph H. Lampert

Low-resource named entity recognition is still an open problem in NLP. Most state-of-the-art systems require tens of thousands of annotated sentences in order to obtain high performance. However, for most of the world's languages, it is…

计算与语言 · 计算机科学 2024-04-16 Ryan Cotterell , Kevin Duh

Typical methods for supervised sequence modeling are built upon the recurrent neural networks to capture temporal dependencies. One potential limitation of these methods is that they only model explicitly information interactions between…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Canmiao Fu , Wenjie Pei , Qiong Cao , Chaopeng Zhang , Yong Zhao , Xiaoyong Shen , Yu-Wing Tai

Conditional Random Field (CRF) and recurrent neural models have achieved success in structured prediction. More recently, there is a marriage of CRF and recurrent neural models, so that we can gain from both non-linear dense features and…

计算与语言 · 计算机科学 2016-11-15 Shuming Ma , Xu Sun

We begin by introducing the Computer Science branch of Natural Language Processing, then narrowing the attention on its subbranch of Information Extraction and particularly on Named Entity Recognition, discussing briefly its main…

计算与语言 · 计算机科学 2013-10-09 Flavio Massimiliano Cecchini , Elisabetta Fersini

In this paper we proposed an ordered patch based method using Conditional Random Field (CRF) in order to encode local properties and their spatial relationship in images to address texture classification, face recognition, and scene…

计算机视觉与模式识别 · 计算机科学 2016-10-06 Fariborz Taherkhani

Recurrent neural networks (RNNs) are a widely used deep architecture for sequence modeling, generation, and prediction. Despite success in applications such as machine translation and voice recognition, these stateful models have several…

计算与语言 · 计算机科学 2020-04-23 Ankur Mali , Alexander Ororbia , Daniel Kifer , Clyde Lee Giles

Conditional Random Fields (CRF) have been widely used in a variety of computer vision tasks. Conventional CRFs typically define edges on neighboring image pixels, resulting in a sparse graph such that efficient inference can be performed.…

计算机视觉与模式识别 · 计算机科学 2016-11-17 Peng Wang , Chunhua Shen , Anton van den Hengel

The advantage of recurrent neural networks (RNNs) in learning dependencies between time-series data has distinguished RNNs from other deep learning models. Recently, many advances are proposed in this emerging field. However, there is a…

神经与进化计算 · 计算机科学 2016-02-16 Hojjat Salehinejad

Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their…

机器学习 · 计算机科学 2021-10-20 Yuqiao Chen , Sriraam Natarajan , Nicholas Ruozzi

Trans-dimensional random field language models (TRF LMs) have recently been introduced, where sentences are modeled as a collection of random fields. The TRF approach has been shown to have the advantages of being computationally more…

计算与语言 · 计算机科学 2017-09-20 Bin Wang , Zhijian Ou

We develop a representation suitable for the unconstrained recognition of words in natural images: the general case of no fixed lexicon and unknown length. To this end we propose a convolutional neural network (CNN) based architecture which…

计算机视觉与模式识别 · 计算机科学 2015-04-13 Max Jaderberg , Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

机器学习 · 计算机科学 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

We compare different models for low resource multi-task sequence tagging that leverage dependencies between label sequences for different tasks. Our analysis is aimed at datasets where each example has labels for multiple tasks. Current…

计算与语言 · 计算机科学 2020-05-04 Jonas Pfeiffer , Edwin Simpson , Iryna Gurevych