English
Related papers

Related papers: Deep Sequence Models for Text Classification Tasks

200 papers

We present an approach to automatically classify clinical text at a sentence level. We are using deep convolutional neural networks to represent complex features. We train the network on a dataset providing a broad categorization of health…

Computation and Language · Computer Science 2017-04-25 Mark Hughes , Irene Li , Spyros Kotoulas , Toyotaro Suzumura

The goal of sentence and document modeling is to accurately represent the meaning of sentences and documents for various Natural Language Processing tasks. In this work, we present Dependency Sensitive Convolutional Neural Networks (DSCNN)…

Computation and Language · Computer Science 2016-11-09 Rui Zhang , Honglak Lee , Dragomir Radev

Text classification is the most fundamental and essential task in natural language processing. The last decade has seen a surge of research in this area due to the unprecedented success of deep learning. Numerous methods, datasets, and…

Computation and Language · Computer Science 2021-12-23 Qian Li , Hao Peng , Jianxin Li , Congying Xia , Renyu Yang , Lichao Sun , Philip S. Yu , Lifang He

In the sentence classification task, context formed from sentences adjacent to the sentence being classified can provide important information for classification. This context is, however, often ignored. Where methods do make use of…

Information Retrieval · Computer Science 2018-09-05 Xingyi Song , Johann Petrak , Angus Roberts

Natural language processing (NLP) researchers develop models of grammar, meaning and communication based on written text. Due to task and data differences, what is considered text can vary substantially across studies. A conceptual…

Computation and Language · Computer Science 2023-05-18 Ilia Kuznetsov , Iryna Gurevych

Documents exhibit sequential structure at multiple levels of abstraction (e.g., sentences, paragraphs, sections). These abstractions constitute a natural hierarchy for representing the context in which to infer the meaning of words and…

Computation and Language · Computer Science 2016-06-01 Shalini Ghosh , Oriol Vinyals , Brian Strope , Scott Roy , Tom Dean , Larry Heck

Continual learning has become increasingly important as it enables NLP models to constantly learn and gain knowledge over time. Previous continual learning methods are mainly designed to preserve knowledge from previous tasks, without much…

Computation and Language · Computer Science 2021-06-14 Yufan Huang , Yanzhe Zhang , Jiaao Chen , Xuezhi Wang , Diyi Yang

Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of…

Computation and Language · Computer Science 2021-03-02 Amirsina Torfi , Rouzbeh A. Shirvani , Yaser Keneshloo , Nader Tavaf , Edward A. Fox

With a focus on natural language processing (NLP) and the role of large language models (LLMs), we explore the intersection of machine learning, deep learning, and artificial intelligence. As artificial intelligence continues to…

Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information. However, previous methods based on GNN are mainly…

Computation and Language · Computer Science 2019-10-09 Lianzhe Huang , Dehong Ma , Sujian Li , Xiaodong Zhang , Houfeng WANG

Graph mining is an important area in data mining and machine learning that involves extracting valuable information from graph-structured data. In recent years, significant progress has been made in this field through the development of…

Machine Learning · Computer Science 2024-12-30 Yuxin You , Zhen Liu , Xiangchao Wen , Yongtao Zhang , Wei Ai

Learning algorithms for natural language processing (NLP) tasks traditionally rely on manually defined relevant contextual features. On the other hand, neural network models using an only distributional representation of words have been…

Computation and Language · Computer Science 2017-11-30 Kushal Chawla , Sunil Kumar Sahu , Ashish Anand

The Sentence-State LSTM (S-LSTM) is a powerful and high efficient graph recurrent network, which views words as nodes and performs layer-wise recurrent steps between them simultaneously. Despite its successes on text representations, the…

Computation and Language · Computer Science 2020-03-03 Yijin Liu , Fandong Meng , Yufeng Chen , Jinan Xu , Jie Zhou

Advances in Natural Language Processing (NLP) have revolutionized the way researchers and practitioners address crucial societal problems. Large language models are now the standard to develop state-of-the-art solutions for text detection…

Machine Learning · Computer Science 2022-05-20 Gaurav Verma , Rohit Mujumdar , Zijie J. Wang , Munmun De Choudhury , Srijan Kumar

Language Modeling is a prevalent task in Natural Language Processing. The currently existing most recent and most successful language models often tend to build a massive model with billions of parameters, feed in a tremendous amount of…

Computation and Language · Computer Science 2025-05-16 Abisha Thapa Magar , Anup Shakya

A comprehensive and high-quality lexicon plays a crucial role in traditional text classification approaches. And it improves the utilization of the linguistic knowledge. Although it is helpful for the task, the lexicon has got little…

Computation and Language · Computer Science 2020-02-19 QingBiao LI , Chunhua Wu , Kangfeng Zheng

Despite deep recurrent neural networks (RNNs) demonstrate strong performance in text classification, training RNN models are often expensive and requires an extensive collection of annotated data which may not be available. To overcome the…

Computation and Language · Computer Science 2018-10-02 Wasi Uddin Ahmad , Xueying Bai , Nanyun Peng , Kai-Wei Chang

Given the paramount importance of safety in the aviation industry, even minor operational anomalies can have significant consequences. Comprehensive documentation of incidents and accidents serves to identify root causes and propose safety…

Machine Learning · Computer Science 2025-01-23 Aziida Nanyonga , Hassan Wasswa , Graham Wild

Supervised text classification is a classical and active area of ML research. In large enterprise, solutions to this problem has significant importance. This is specifically true in ticketing systems where prediction of the type and subtype…

Information Retrieval · Computer Science 2020-12-02 Nabarun Mondal , Mrunal Lohia

One of the principal tasks of machine learning with major applications is text classification. This paper focuses on the legal domain and, in particular, on the classification of lengthy legal documents. The main challenge that this study…

Computation and Language · Computer Science 2019-12-17 Lulu Wan , George Papageorgiou , Michael Seddon , Mirko Bernardoni