English
Related papers

Related papers: Revisiting LSTM Networks for Semi-Supervised Text …

200 papers

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Aerial image classification is of great significance in remote sensing community, and many researches have been conducted over the past few years. Among these studies, most of them focus on categorizing an image into one semantic label,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Yuansheng Hua , Lichao Mou , Xiao Xiang Zhu

Fine-tuning large pre-trained language models (LLMs) on particular datasets is a commonly employed strategy in Natural Language Processing (NLP) classification tasks. However, this approach usually results in a loss of models…

Computation and Language · Computer Science 2024-01-31 Stepan Tytarenko , Mohammad Ruhul Amin

Deep neural networks have recently been shown to achieve highly competitive performance in many computer vision tasks due to their abilities of exploring in a much larger hypothesis space. However, since most deep architectures like stacked…

Computation and Language · Computer Science 2018-02-06 Zixiang Ding , Rui Xia , Jianfei Yu , Xiang Li , Jian Yang

In recent years, there has been an exponential growth in the number of complex documents and texts that require a deeper understanding of machine learning methods to be able to accurately classify texts in many applications. Many machine…

Machine Learning · Computer Science 2020-05-21 Kamran Kowsari , Kiana Jafari Meimandi , Mojtaba Heidarysafa , Sanjana Mendu , Laura E. Barnes , Donald E. Brown

Previous text-based depression detection is commonly based on large user-generated data. Sparse scenarios like clinical conversations are less investigated. This work proposes a text-based multi-task BGRU network with pretrained word…

Machine Learning · Computer Science 2020-07-09 Heinrich Dinkel , Mengyue Wu , Kai Yu

Text style transfer is an important task in controllable language generation. Supervised approaches have pushed performance improvement on style-oriented rewriting such as formality conversion. However, challenges remain due to the scarcity…

Computation and Language · Computer Science 2022-05-20 Zhengyuan Liu , Nancy F. Chen

Recent years have seen rapid development in Information Extraction, as well as its subtask, Relation Extraction. Relation Extraction is able to detect semantic relations between entities in sentences. Currently, many efficient approaches…

Computation and Language · Computer Science 2024-03-19 Zhuang Li

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Antonio Montanaro , Diego Valsesia , Giulia Fracastoro , Enrico Magli

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

Most previous scene text spotting methods rely on high-quality manual annotations to achieve promising performance. To reduce their expensive costs, we study semi-supervised text spotting (SSTS) to exploit useful information from unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Dongliang Luo , Hanshen Zhu , Ziyang Zhang , Dingkang Liang , Xudong Xie , Yuliang Liu , Xiang Bai

Deep neural networks (DNNs) have proven successful in a wide variety of applications such as speech recognition and synthesis, computer vision, machine translation, and game playing, to name but a few. However, existing deep neural network…

Machine Learning · Computer Science 2022-08-08 Ramit Pahwa

We present an unsupervised word segmentation model, in which the learning objective is to maximize the generation probability of a sentence given its all possible segmentation. Such generation probability can be factorized into the…

Computation and Language · Computer Science 2021-03-03 Lihao Wang , Zongyi Li , Xiaoqing Zheng

Cross entropy loss has served as the main objective function for classification-based tasks. Widely deployed for learning neural network classifiers, it shows both effectiveness and a probabilistic interpretation. Recently, after the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Rahaf Aljundi , Yash Patel , Milan Sulc , Daniel Olmeda , Nikolay Chumerin

Transductive SVM (TSVM) is a well known semi-supervised large margin learning method for binary text classification. In this paper we extend this method to multi-class and hierarchical classification problems. We point out that the…

Machine Learning · Computer Science 2012-11-02 Sathiya Keerthi Selvaraj , Sundararajan Sellamanickam , Shirish Shevade

Pre-training text representations has recently been shown to significantly improve the state-of-the-art in many natural language processing tasks. The central goal of pre-training is to learn text representations that are useful for…

Computation and Language · Computer Science 2020-04-14 Shangwen Lv , Yuechen Wang , Daya Guo , Duyu Tang , Nan Duan , Fuqing Zhu , Ming Gong , Linjun Shou , Ryan Ma , Daxin Jiang , Guihong Cao , Ming Zhou , Songlin Hu

Relation classification is associated with many potential applications in the artificial intelligence area. Recent approaches usually leverage neural networks based on structure features such as syntactic or dependency features to solve…

Computation and Language · Computer Science 2016-08-30 Fei Li , Meishan Zhang , Guohong Fu , Tao Qian , Donghong Ji

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

Computation and Language · Computer Science 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

The ability of large language models to generate complex texts allows them to be widely integrated into many aspects of life, and their output can quickly fill all network resources. As the impact of LLMs grows, it becomes increasingly…

Computation and Language · Computer Science 2024-11-12 Yongye Su , Yuqing Wu

We consider the supervised training setting in which we learn task-specific word embeddings. We assume that we start with initial embeddings learned from unlabelled data and update them to learn task-specific embeddings for words in the…

Computation and Language · Computer Science 2016-06-24 Pranava Swaroop Madhyastha , Mohit Bansal , Kevin Gimpel , Karen Livescu