English
Related papers

Related papers: Analyzing the Benefits of Prototypes for Semi-Supe…

200 papers

From the beginning of zero-shot learning research, visual attributes have been shown to play an important role. In order to better transfer attribute-based knowledge from known to unknown classes, we argue that an image representation with…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Wenjia Xu , Yongqin Xian , Jiuniu Wang , Bernt Schiele , Zeynep Akata

We present a semi-supervised learning framework based on graph embeddings. Given a graph between instances, we train an embedding for each instance to jointly predict the class label and the neighborhood context in the graph. We develop…

Machine Learning · Computer Science 2016-05-30 Zhilin Yang , William W. Cohen , Ruslan Salakhutdinov

Anomaly detection is a crucial task in various domains. Most of the existing methods assume the normal sample data clusters around a single central prototype while the real data may consist of multiple categories or subgroups. In addition,…

Machine Learning · Statistics 2024-12-03 Zhijin Dong , Hongzhi Liu , Boyuan Ren , Weimin Xiong , Zhonghai Wu

Classification is an important task in many fields including biomedical research and machine learning. Traditionally, a classification rule is constructed based a bunch of labeled data. Recently, due to technological innovation and…

Methodology · Statistics 2014-06-19 Jing Wang , Eunsik Park , Yuan-chin Ivan Chang

Existing popular unsupervised embedding learning methods focus on enhancing the instance-level local discrimination of the given unlabeled images by exploring various negative data. However, the existed sample outliers which exhibit large…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Jiahuan Zhou , Yansong Tang , Bing Su , Ying Wu

Recognizing relations between entities is a pivotal task of relational learning. Learning relation representations from distantly-labeled datasets is difficult because of the abundant label noise and complicated expressions in human…

Computation and Language · Computer Science 2021-03-23 Ning Ding , Xiaobin Wang , Yao Fu , Guangwei Xu , Rui Wang , Pengjun Xie , Ying Shen , Fei Huang , Hai-Tao Zheng , Rui Zhang

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Unsupervised models can provide supplementary soft constraints to help classify new, "target" data since similar instances in the target set are more likely to share the same class label. Such models can also help detect possible…

Machine Learning · Computer Science 2012-06-06 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Sreangsu Acharyya

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

Machine Learning · Computer Science 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Diffusion models are generative models that have shown significant advantages compared to other generative models in terms of higher generation quality and more stable training. However, the computational need for training diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Gulcin Baykal , Halil Faruk Karagoz , Taha Binhuraib , Gozde Unal

We present a neural semi-supervised learning model termed Self-Pretraining. Our model is inspired by the classic self-training algorithm. However, as opposed to self-training, Self-Pretraining is threshold-free, it can potentially update…

Computation and Language · Computer Science 2021-10-01 Payam Karisani , Negin Karisani

Few-shot learning aims to recognize novel classes with few examples. Pre-training based methods effectively tackle the problem by pre-training a feature extractor and then fine-tuning it through the nearest centroid based meta-learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Baoquan Zhang , Xutao Li , Yunming Ye , Shanshan Feng

Deep generative models trained with large amounts of unlabelled data have proven to be powerful within the domain of unsupervised learning. Many real life data sets contain a small amount of labelled data points, that are typically…

Machine Learning · Statistics 2017-04-04 Lars Maaløe , Marco Fraccaro , Ole Winther

Semi-supervised learning, which has emerged from the beginning of this century, is a new type of learning method between traditional supervised learning and unsupervised learning. The main idea of semi-supervised learning is to introduce…

Machine Learning · Computer Science 2019-05-29 Enmei Tu , Jie Yang

Semi-supervised learning improves the performance of supervised machine learning by leveraging methods from unsupervised learning to extract information not explicitly available in the labels. Through the design of a system that enables a…

Robotics · Computer Science 2020-07-27 Simón C. Smith , Subramanian Ramamoorthy

As machine learning (ML) models and datasets increase in complexity, the demand for methods that enhance explainability and interpretability becomes paramount. Prototypes, by encapsulating essential characteristics within data, offer…

Machine Learning · Computer Science 2024-08-20 Orfeas Menis-Mastromichalakis , Giorgos Filandrianos , Jason Liartis , Edmund Dervakos , Giorgos Stamou

In this work, we provide a broad comparative analysis of strategies for pre-training audio understanding models for several tasks in the music domain, including labelling of genre, era, origin, mood, instrumentation, key, pitch, vocal…

Contrastive visual pretraining based on the instance discrimination pretext task has made significant progress. Notably, recent work on unsupervised pretraining has shown to surpass the supervised counterpart for finetuning downstream…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

Zero shot learning in Image Classification refers to the setting where images from some novel classes are absent in the training data but other information such as natural language descriptions or attribute vectors of the classes are…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Ashish Mishra , M Shiva Krishna Reddy , Anurag Mittal , Hema A Murthy

This work considers semi-supervised segmentation as a dense prediction problem based on prototype vector correlation and proposes a simple way to represent each segmentation class with multiple prototypes. To avoid degenerate solutions, two…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Jizong Peng , Christian Desrosiers , Marco Pedersoli