English
Related papers

Related papers: Weakly Supervised Text Classification using Superv…

200 papers

Weakly-supervised text classification has received much attention in recent years for it can alleviate the heavy burden of annotating massive data. Among them, keyword-driven methods are the mainstream where user-provided keywords are…

Computation and Language · Computer Science 2021-10-07 Lu Zhang , Jiandong Ding , Yi Xu , Yingyao Liu , Shuigeng Zhou

We study how masking and predicting tokens in an unsupervised fashion can give rise to linguistic structures and downstream performance gains. Recent theories have suggested that pretrained language models acquire useful inductive biases…

Computation and Language · Computer Science 2021-04-13 Tianyi Zhang , Tatsunori Hashimoto

Weakly supervised text classification (WSTC), also called zero-shot or dataless text classification, has attracted increasing attention due to its applicability in classifying a mass of texts within the dynamic and open Web environment,…

Computation and Language · Computer Science 2024-04-26 Miaomiao Li , Jiaqi Zhu , Yang Wang , Yi Yang , Yilin Li , Hongan Wang

This paper presents a novel approach for multi-lingual sentiment classification in short texts. This is a challenging task as the amount of training data in languages other than English is very limited. Previously proposed multi-lingual…

Computation and Language · Computer Science 2017-03-08 Jan Deriu , Aurelien Lucchi , Valeria De Luca , Aliaksei Severyn , Simon Müller , Mark Cieliebak , Thomas Hofmann , Martin Jaggi

Curation of large fully supervised datasets has become one of the major roadblocks for machine learning. Weak supervision provides an alternative to supervised learning by training with cheap, noisy, and possibly correlated labeling…

Machine Learning · Computer Science 2021-06-01 Chidubem Arachie , Bert Huang

We study the problem of generating keyphrases that summarize the key points for a given document. While sequence-to-sequence (seq2seq) models have achieved remarkable performance on this task (Meng et al., 2017), model training often relies…

Computation and Language · Computer Science 2019-09-09 Hai Ye , Lu Wang

Self-supervised learning (SSL) based speech pre-training has attracted much attention for its capability of extracting rich representations learned from massive unlabeled data. On the other hand, the use of weakly-supervised data is less…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-30 Wangyou Zhang , Yanmin Qian

We propose a learning approach for turn-level spoken language understanding, which facilitates a user to speak one or more utterances compositionally in a turn for completing a task (e.g., voice ordering). A typical pipelined approach for…

Computation and Language · Computer Science 2019-06-12 Hao Lang , Wen Wang

Solving math word problems (MWPs) is an important and challenging problem in natural language processing. Existing approaches to solve MWPs require full supervision in the form of intermediate equations. However, labeling every MWP with its…

Computation and Language · Computer Science 2023-06-16 Oishik Chatterjee , Isha Pandey , Aashish Waikar , Vishwajeet Kumar , Ganesh Ramakrishnan

We propose a method to learn unsupervised sentence representations in a non-compositional manner based on Generative Latent Optimization. Our approach does not impose any assumptions on how words are to be combined into a sentence…

Computation and Language · Computer Science 2019-08-14 Sidak Pal Singh , Angela Fan , Michael Auli

Recently, researches related to unsupervised disentanglement learning with deep generative models have gained substantial popularity. However, without introducing supervision, there is no guarantee that the factors of interest can be…

Machine Learning · Computer Science 2020-03-13 Junxiang Chen , Kayhan Batmanghelich

In this paper, we focus on the problem of unsupervised image-sentence matching. Existing research explores to utilize document-level structural information to sample positive and negative instances for model training. Although the approach…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Zejun Li , Zhongyu Wei , Zhihao Fan , Haijun Shan , Xuanjing Huang

Despite the impressive improvements achieved by unsupervised deep neural networks in computer vision and NLP tasks, such improvements have not yet been observed in ranking for information retrieval. The reason may be the complexity of the…

Information Retrieval · Computer Science 2017-05-30 Mostafa Dehghani , Hamed Zamani , Aliaksei Severyn , Jaap Kamps , W. Bruce Croft

One of the key problems in multi-label text classification is how to take advantage of the correlation among labels. However, it is very challenging to directly model the correlations among labels in a complex and unknown label space. In…

Computation and Language · Computer Science 2023-03-16 Rui Song , Xingbing Chen , Zelong Liu , Haining An , Zhiqi Zhang , Xiaoguang Wang , Hao Xu

Modeling persuasive language has the potential to better facilitate our decision-making processes. Despite its importance, computational modeling of persuasion is still in its infancy, largely due to the lack of benchmark datasets that can…

Computation and Language · Computer Science 2021-01-19 Jiaao Chen , Diyi Yang

This paper focuses on a novel and challenging vision task, dense video captioning, which aims to automatically describe a video clip with multiple informative and diverse caption sentences. The proposed method is trained without explicit…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Zhiqiang Shen , Jianguo Li , Zhou Su , Minjun Li , Yurong Chen , Yu-Gang Jiang , Xiangyang Xue

Existing weakly-supervised semantic segmentation methods using image-level annotations typically rely on initial responses to locate object regions. However, such response maps generated by the classification network usually focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yu-Ting Chang , Qiaosong Wang , Wei-Chih Hung , Robinson Piramuthu , Yi-Hsuan Tsai , Ming-Hsuan Yang

Most pretrained language models rely on subword tokenization, which processes text as a sequence of subword tokens. However, different granularities of text, such as characters, subwords, and words, can contain different kinds of…

Computation and Language · Computer Science 2024-04-09 Yilin Wang , Xinyi Hu , Matthew R. Gormley

We propose an unsupervised method for sentence summarization using only language modeling. The approach employs two language models, one that is generic (i.e. pretrained), and the other that is specific to the target domain. We show that by…

Computation and Language · Computer Science 2019-08-01 Jiawei Zhou , Alexander M. Rush

In this paper we introduce domain detection as a new natural language processing task. We argue that the ability to detect textual segments which are domain-heavy, i.e., sentences or phrases which are representative of and provide evidence…

Computation and Language · Computer Science 2019-07-29 Yumo Xu , Mirella Lapata