English
Related papers

Related papers: Semi-supervised Learning with Explicit Relationshi…

200 papers

Self-paced learning (SPL) mimics the cognitive mechanism of humans and animals that gradually learns from easy to hard samples. One key issue in SPL is to obtain better weighting strategy that is determined by minimizer function. Existing…

Machine Learning · Computer Science 2016-09-20 Yanbo Fan , Ran He , Jian Liang , Bao-Gang Hu

Unsupervised representation learning methods are widely used for gaining insight into high-dimensional, unstructured, or structured data. In some cases, users may have prior topological knowledge about the data, such as a known cluster…

Machine Learning · Computer Science 2023-11-08 Edith Heiter , Robin Vandaele , Tijl De Bie , Yvan Saeys , Jefrey Lijffijt

In recent years, great progress has been made to incorporate unlabeled data to overcome the inefficiently supervised problem via semi-supervised learning (SSL). Most state-of-the-art models are based on the idea of pursuing consistent model…

Machine Learning · Computer Science 2022-09-27 Yangbangyan Jiang , Xiaodan Li , Yuefeng Chen , Yuan He , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Many innovative applications require establishing correspondences among 3D geometric objects. However, the countless possible deformations of smooth surfaces make shape matching a challenging task. Finding an embedding to represent the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Riccardo Marin , Souhaib Attaiki , Simone Melzi , Emanuele Rodolà , Maks Ovsjanikov

Semi-supervised learning (SSL) seeks to enhance task performance by training on both labeled and unlabeled data. Mainstream SSL image classification methods mostly optimize a loss that additively combines a supervised classification…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhe Huang , Xiaowei Yu , Dajiang Zhu , Michael C. Hughes

Semi-supervised learning provides an expressive framework for exploiting unlabeled data when labels are insufficient. Previous semi-supervised learning methods typically match model predictions of different data-augmented views in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Cong Wang , Xiaofeng Cao , Lanzhe Guo2 , Zenglin Shi

Prior knowledge and symbolic rules in machine learning are often expressed in the form of label constraints, especially in structured prediction problems. In this work, we compare two common strategies for encoding label constraints in a…

Machine Learning · Computer Science 2023-07-11 Kaifu Wang , Hangfeng He , Tin D. Nguyen , Piyush Kumar , Dan Roth

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

Machine Learning · Computer Science 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

Discovering whether words are semantically related and identifying the specific semantic relation that holds between them is of crucial importance for NLP as it is essential for tasks like query expansion in IR. Within this context,…

Computation and Language · Computer Science 2018-07-31 Georgios Balikas , Gaël Dias , Rumen Moraliyski , Massih-Reza Amini

Consistency regularization describes a class of approaches that have yielded ground breaking results in semi-supervised classification problems. Prior work has established the cluster assumption - under which the data distribution consists…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Geoff French , Samuli Laine , Timo Aila , Michal Mackiewicz , Graham Finlayson

In many domains, relationships between categories are encoded in the knowledge graph. Recently, promising results have been achieved by incorporating knowledge graph as side information in hard classification tasks with severely limited…

Machine Learning · Computer Science 2021-02-16 Ethan Shen , Maria Brbic , Nicholas Monath , Jiaqi Zhai , Manzil Zaheer , Jure Leskovec

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

Machine Learning · Computer Science 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

The generalization and learning speed of a multi-class neural network can often be significantly improved by using soft targets that are a weighted average of the hard targets and the uniform distribution over labels. Smoothing the labels…

Machine Learning · Computer Science 2020-06-12 Rafael Müller , Simon Kornblith , Geoffrey Hinton

Knowledge distillation introduced in the deep learning context is a method to transfer knowledge from one architecture to another. In particular, when the architectures are identical, this is called self-distillation. The idea is to feed in…

Machine Learning · Computer Science 2020-10-27 Hossein Mobahi , Mehrdad Farajtabar , Peter L. Bartlett

Recently, over-parameterized deep networks, with increasingly more network parameters than training samples, have dominated the performances of modern machine learning. However, when the training data is corrupted, it has been well-known…

Machine Learning · Computer Science 2022-08-04 Sheng Liu , Zhihui Zhu , Qing Qu , Chong You

In an attempt to better understand generalization in deep learning, we study several possible explanations. We show that implicit regularization induced by the optimization method is playing a key role in generalization and success of deep…

Machine Learning · Computer Science 2017-09-11 Behnam Neyshabur

Deep neural networks have become a standard building block for designing models that can perform multiple dense computer vision tasks such as depth estimation and semantic segmentation thanks to their ability to capture complex correlations…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Wei-Hong Li , Steven McDonagh , Ales Leonardis , Hakan Bilen

Federated Learning (FL) has emerged to allow multiple clients to collaboratively train machine learning models on their private data at the network edge. However, training and deploying large-scale models on resource-constrained devices is…

Machine Learning · Computer Science 2024-08-05 Yang Xu , Yunming Liao , Hongli Xu , Zhipeng Sun , Liusheng Huang , Chunming Qiao

This paper frames causal structure estimation as a machine learning task. The idea is to treat indicators of causal relationships between variables as `labels' and to exploit available data on the variables of interest to provide features…

Machine Learning · Statistics 2019-10-17 Steven M. Hill , Chris. J. Oates , Duncan A. Blythe , Sach Mukherjee

In order to train robust deep learning models, large amounts of labelled data is required. However, in the absence of such large repositories of labelled data, unlabeled data can be exploited for the same. Semi-Supervised learning aims to…

Machine Learning · Computer Science 2021-07-20 Soumyadeep Ghosh , Sanjay Kumar , Janu Verma , Awanish Kumar