English
Related papers

Related papers: PseudoReasoner: Leveraging Pseudo Labels for Commo…

200 papers

Despite serving as the foundation models for a wide range of NLP benchmarks, pre-trained language models have shown limited capabilities of acquiring implicit commonsense knowledge from self-supervision alone, compared to learning…

Computation and Language · Computer Science 2023-06-06 Wangchunshu Zhou , Ronan Le Bras , Yejin Choi

Commonsense reasoning is intuitive for humans but has been a long-term challenge for artificial intelligence (AI). Recent advancements in pretrained language models have shown promising results on several commonsense benchmark datasets.…

Computation and Language · Computer Science 2021-06-03 Shikhar Singh , Nuan Wen , Yu Hou , Pegah Alipoormolabashi , Te-Lin Wu , Xuezhe Ma , Nanyun Peng

In this work, we present a dual learning approach for unsupervised text to path and path to text transfers in Commonsense Knowledge Bases (KBs). We investigate the impact of weak supervision by creating a weakly supervised dataset and show…

Computation and Language · Computer Science 2020-10-29 Pierre L. Dognin , Igor Melnyk , Inkit Padhi , Cicero Nogueira dos Santos , Payel Das

Knowledge underpins reasoning. Recent research demonstrates that when relevant knowledge is provided as additional context to commonsense question answering (QA), it can substantially enhance the performance even on top of state-of-the-art.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Liu , Skyler Hallinan , Ximing Lu , Pengfei He , Sean Welleck , Hannaneh Hajishirzi , Yejin Choi

In semi-supervised learning for classification, it is assumed that every ground truth class of data is present in the small labelled dataset. Many real-world sparsely-labelled datasets are plausibly not of this type. It could easily be the…

Machine Learning · Statistics 2021-01-11 Matthew Willetts , Stephen J Roberts , Christopher C Holmes

Programming machines with commonsense reasoning (CSR) abilities is a longstanding challenge in the Artificial Intelligence community. Current CSR benchmarks use multiple-choice (and in relatively fewer cases, generative) question-answering…

Computation and Language · Computer Science 2022-07-18 Henrique Santos , Ke Shen , Alice M. Mulvehill , Yasaman Razeghi , Deborah L. McGuinness , Mayank Kejriwal

Pseudo-label-based semi-supervised learning (SSL) has achieved great success on raw data utilization. However, its training procedure suffers from confirmation bias due to the noise contained in self-generated artificial labels. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Fan Yang , Kai Wu , Shuyi Zhang , Guannan Jiang , Yong Liu , Feng Zheng , Wei Zhang , Chengjie Wang , Long Zeng

Personal knowledge bases (PKBs) are critical to many applications, such as Web-based chatbots and personalized recommendation. Conversations containing rich personal knowledge can be regarded as a main source to populate the PKB. Given a…

Computation and Language · Computer Science 2022-09-21 Yinan Liu , Hu Chen , Wei Shen

Social Commonsense Reasoning requires understanding of text, knowledge about social events and their pragmatic implications, as well as commonsense reasoning skills. In this work we propose a novel multi-head knowledge attention model that…

Computation and Language · Computer Science 2020-10-13 Debjit Paul , Anette Frank

The study of label noise in sound event recognition has recently gained attention with the advent of larger and noisier datasets. This work addresses the problem of missing labels, one of the big weaknesses of large audio datasets, and one…

The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision techniques operate at the word form level, which serves as a…

Computation and Language · Computer Science 2020-05-19 Yoav Levine , Barak Lenz , Or Dagan , Ori Ram , Dan Padnos , Or Sharir , Shai Shalev-Shwartz , Amnon Shashua , Yoav Shoham

We introduce a neural reading comprehension model that integrates external commonsense knowledge, encoded as a key-value memory, in a cloze-style setting. Instead of relying only on document-to-question interaction or discrete features as…

Computation and Language · Computer Science 2018-05-22 Todor Mihaylov , Anette Frank

Commonsense knowledge (CSK) supports a variety of AI applications, from visual understanding to chatbots. Prior works on acquiring CSK, such as ConceptNet, have compiled statements that associate concepts, like everyday objects or…

Computation and Language · Computer Science 2020-05-06 Yohan Chalier , Simon Razniewski , Gerhard Weikum

Semi-Supervised Semantic Segmentation reduces reliance on extensive annotations by using unlabeled data and state-of-the-art models to improve overall performance. Despite the success of deep co-training methods, their underlying mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Thuan Than , Nhat-Anh Nguyen-Dang , Dung Nguyen , Salwa K. Al Khatib , Ahmed Elhagry , Hai Phan , Yihui He , Zhiqiang Shen , Marios Savvides , Dang Huynh

Pseudo-label learning methods have been widely applied in weakly-supervised temporal action localization. Existing works directly utilize weakly-supervised base model to generate instance-level pseudo-labels for training the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Quan Zhang , Yuxin Qi , Xi Tang , Rui Yuan , Xi Lin , Ke Zhang , Chun Yuan

We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models. Constructing a large-scale labeled image captioning dataset is an expensive task in terms of labor, time, and cost. In…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Dong-Jin Kim , Tae-Hyun Oh , Jinsoo Choi , In So Kweon

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

Machine Learning · Computer Science 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferences based on implicit…

Computation and Language · Computer Science 2024-09-16 Yubo Xie , Zonghui Liu , Zongyang Ma , Fanyuan Meng , Yan Xiao , Fahui Miao , Pearl Pu

In self-supervised learning, a system is tasked with achieving a surrogate objective by defining alternative targets on a set of unlabeled data. The aim is to build useful representations that can be used in downstream tasks, without costly…

Machine Learning · Computer Science 2020-11-11 Massimiliano Patacchiola , Amos Storkey