English
Related papers

Related papers: Hierarchically-Refined Label Attention Network for…

200 papers

State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing. In this paper, we introduce a novel neutral network architecture that…

Machine Learning · Computer Science 2016-05-31 Xuezhe Ma , Eduard Hovy

In textual information extraction and other sequence labeling tasks it is now common to use recurrent neural networks (such as LSTM) to form rich embedded representations of long-term input co-occurrence patterns. Representation of output…

Computation and Language · Computer Science 2017-08-03 Dung Thai , Shikhar Murty , Trapit Bansal , Luke Vilnis , David Belanger , Andrew McCallum

Hierarchical multi-label text classification (HMTC) has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely focus on the design of classifiers,…

Computation and Language · Computer Science 2021-04-13 Xinyi Zhang , Jiahao Xu , Charlie Soh , Lihui Chen

Sequence labeling architectures use word embeddings for capturing similarity, but suffer when handling previously unseen or rare words. We investigate character-level extensions to such models and propose a novel architecture for combining…

Computation and Language · Computer Science 2016-11-15 Marek Rei , Gamal K. O. Crichton , Sampo Pyysalo

A major challenge in structured prediction is to represent the interdependencies within output structures. When outputs are structured as sequences, linear-chain conditional random fields (CRFs) are a widely used model class which can learn…

Machine Learning · Computer Science 2023-08-14 Sean Papay , Roman Klinger , Sebastian Padó

Existing neural models usually predict the tag of the current token independent of the neighboring tags. The popular LSTM-CRF model considers the tag dependencies between every two consecutive tags. However, it is hard for existing neural…

Computation and Language · Computer Science 2018-06-14 Yi Zhang , Xu Sun , Shuming Ma , Yang Yang , Xuancheng Ren

CNNs, RNNs, GCNs, and CapsNets have shown significant insights in representation learning and are widely used in various text mining tasks such as large-scale multi-label text classification. However, most existing deep models for…

Information Retrieval · Computer Science 2019-06-13 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Lifang He , Bo Li , Lihong Wang , Philip S. Yu

Deep learning has attracted great attention recently and yielded the state of the art performance in dimension reduction and classification problems. However, it cannot effectively handle the structured output prediction, e.g. sequential…

Machine Learning · Computer Science 2015-05-05 Gang Chen , Ran Xu , Sargur Srihari

BiLSTM has been prevalently used as a core module for NER in a sequence-labeling setup. State-of-the-art approaches use BiLSTM with additional resources such as gazetteers, language-modeling, or multi-task supervision to further improve…

Computation and Language · Computer Science 2020-07-06 Peng-Hsuan Li , Tsu-Jui Fu , Wei-Yun Ma

While existing hierarchical text classification (HTC) methods attempt to capture label hierarchies for model training, they either make local decisions regarding each label or completely ignore the hierarchy information during inference. To…

Information Retrieval · Computer Science 2020-06-19 Yuning Mao , Jingjing Tian , Jiawei Han , Xiang Ren

Label-efficient time series representation learning, which aims to learn effective representations with limited labeled data, is crucial for deploying deep learning models in real-world applications. To address the scarcity of labeled time…

Machine Learning · Computer Science 2024-07-25 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Dialogue Act recognition associate dialogue acts (i.e., semantic labels) to utterances in a conversation. The problem of associating semantic labels to utterances can be treated as a sequence labeling problem. In this work, we build a…

Computation and Language · Computer Science 2017-09-15 Harshit Kumar , Arvind Agarwal , Riddhiman Dasgupta , Sachindra Joshi , Arun Kumar

We present a reproducibility study of the state-of-the-art neural architecture for sequence labeling proposed by Ma and Hovy (2016)\cite{ma2016end}. The original BiLSTM-CNN-CRF model combines character-level representations via…

Computation and Language · Computer Science 2025-10-14 Anirudh Ganesh , Jayavardhan Reddy

We propose a novel model for multi-label text classification, which is based on sequence-to-sequence learning. The model generates higher-level semantic unit representations with multi-level dilated convolution as well as a corresponding…

Computation and Language · Computer Science 2018-11-13 Junyang Lin , Qi Su , Pengcheng Yang , Shuming Ma , Xu Sun

This paper presents an empirical study of two widely-used sequence prediction models, Conditional Random Fields (CRFs) and Long Short-Term Memory Networks (LSTMs), on two fundamental tasks for Vietnamese text processing, including…

Computation and Language · Computer Science 2017-08-31 Phuong Le-Hong , Minh Pham Quang Nhat , Thai-Hoang Pham , Tuan-Anh Tran , Dang-Minh Nguyen

Recent works on deep conditional random fields (CRF) have set new records on many vision tasks involving structured predictions. Here we propose a fully-connected deep continuous CRF model for both discrete and continuous labelling…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Fayao Liu , Guosheng Lin , Chunhua Shen

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

Hierarchical multi-label classification (HMLC) is essential for modeling complex label dependencies in remote sensing. Existing methods, however, struggle with multi-path hierarchies where instances belong to multiple branches, and they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Marjan Stoimchev , Boshko Koloski , Jurica Levatić , Dragi Kocev , Sašo Džeroski

In the last few years, Recurrent Neural Networks (RNNs) have proved effective on several NLP tasks. Despite such great success, their ability to model \emph{sequence labeling} is still limited. This lead research toward solutions where RNNs…

Computation and Language · Computer Science 2017-06-07 Yoann Dupont , Marco Dinarelli , Isabelle Tellier

Segmental conditional random fields (SCRFs) and connectionist temporal classification (CTC) are two sequence labeling methods used for end-to-end training of speech recognition models. Both models define a transcription probability by…

Computation and Language · Computer Science 2017-06-07 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith