English
Related papers

Related papers: RelationMatch: Matching In-batch Relationships for…

200 papers

We propose a novel paradigm of semi-supervised learning (SSL)--the semi-supervised multiple representation behavior learning (SSMRBL). SSMRBL aims to tackle the difficulty of learning a grammar for natural language parsing where the data…

Computation and Language · Computer Science 2019-10-22 Ruqian Lu , Shengluan Hou

The prevailing methodology in data-driven fault detection leverages synthetic data for training neural networks. However, it grapples with challenges when it comes to generalization in surveys exhibiting complex structures. To enhance the…

Geophysics · Physics 2024-10-28 Yimin Dou , Minghui Dong , Kewen Li , Y uan Xiao

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Given an unlabeled dataset and an annotation budget, we study how to selectively label a fixed number of instances so that semi-supervised learning (SSL) on such a partially labeled dataset is most effective. We focus on selecting the right…

Machine Learning · Computer Science 2023-08-24 Xudong Wang , Long Lian , Stella X. Yu

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

Semi-supervised learning (SSL) has shown great promise in leveraging unlabeled data to improve model performance. While standard SSL assumes uniform data distribution, we consider a more realistic and challenging setting called imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hao Chen , Yue Fan , Yidong Wang , Jindong Wang , Bernt Schiele , Xing Xie , Marios Savvides , Bhiksha Raj

While self-supervised representation learning (SSL) has proved to be effective in the large model, there is still a huge gap between the SSL and supervised method in the lightweight model when following the same solution. We delve into this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Kai Zheng , Yuanjiang Wang , Ye Yuan

Semi-Supervised Learning (SSL) is fundamentally a missing label problem, in which the label Missing Not At Random (MNAR) problem is more realistic and challenging, compared to the widely-adopted yet naive Missing Completely At Random…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Xinting Hu , Yulei Niu , Chunyan Miao , Xian-Sheng Hua , Hanwang Zhang

We extend semi-supervised learning to the problem of domain adaptation to learn significantly higher-accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a…

Machine Learning · Computer Science 2022-03-16 David Berthelot , Rebecca Roelofs , Kihyuk Sohn , Nicholas Carlini , Alex Kurakin

Learning sentence embeddings from dialogues has drawn increasing attention due to its low annotation cost and high domain adaptability. Conventional approaches employ the siamese-network for this task, which obtains the sentence embeddings…

Computation and Language · Computer Science 2021-09-28 Che Liu , Rui Wang , Jinghua Liu , Jian Sun , Fei Huang , Luo Si

We present Relational Sentence Embedding (RSE), a new paradigm to further discover the potential of sentence embeddings. Prior work mainly models the similarity between sentences based on their embedding distance. Because of the complex…

Computation and Language · Computer Science 2023-06-09 Bin Wang , Haizhou Li

Recently, Semi-Supervised Learning (SSL) has shown much promise in leveraging unlabeled data while being provided with very few labels. In this paper, we show that ignoring the labels altogether for whole epochs intermittently during…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Boaz Lerner , Guy Shiran , Daphna Weinshall

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

To respond to disasters such as earthquakes, wildfires, and armed conflicts, humanitarian organizations require accurate and timely data in the form of damage assessments, which indicate what buildings and population centers have been most…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Jihyeon Lee , Joseph Z. Xu , Kihyuk Sohn , Wenhan Lu , David Berthelot , Izzeddin Gur , Pranav Khaitan , Ke-Wei , Huang , Kyriacos Koupparis , Bernhard Kowatsch

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

Machine Learning · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

Machine Learning · Computer Science 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

Machine Learning · Computer Science 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo

We present ReMatch, a framework that leverages the generative strength of MLLMs for multimodal retrieval. Previous approaches treated an MLLM as a simple encoder, ignoring its generative nature, and under-utilising its compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Qianying Liu , Xiao Liang , Zhiqiang Zhang , Zhongfei Qing , Fengfan Zhou , Yibo Chen , Xu Tang , Yao Hu , Paul Henderson

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

In this study, a novel idea, Uncertainty Structure Estimation (USE), a lightweight, algorithm-agnostic procedure that emphasizes the often-overlooked role of unlabeled data quality is introduced for Semi-supervised learning (SSL). SSL has…

Machine Learning · Computer Science 2026-03-03 Tsao-Lun Chen , Chien-Liang Liu , Tzu-Ming Harry Hsu , Tai-Hsien Wu , Chi-Cheng Fu , Han-Yi E. Chou , Shun-Feng Su