English
Related papers

Related papers: Spectral Self-supervised Feature Selection

200 papers

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

Learning a new task from a handful of examples remains an open challenge in machine learning. Despite the recent progress in few-shot learning, most methods rely on supervised pretraining or meta-learning on labeled meta-training data and…

Machine Learning · Computer Science 2022-10-10 Kuilin Chen , Chi-Guhn Lee

Unsupervised feature selection (UFS) is an important task in data engineering. However, most UFS methods construct models from a single perspective and often fail to simultaneously evaluate feature importance and preserve their inherent…

Machine Learning · Computer Science 2025-05-28 Jingjing Liu , Xiansen Ju , Xianchao Xiu , Wanquan Liu

Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to…

Machine Learning · Computer Science 2020-06-16 Xiaoyi Mai , Romain Couillet

In this study, a spectral graph-theoretic grouping strategy for weakly supervised classification is introduced, where a limited number of labelled samples and a larger set of unlabelled samples are used to construct a larger annotated…

Machine Learning · Computer Science 2015-08-04 Tameem Adel , Alexander Wong , Daniel Stashuk

Through solving pretext tasks, self-supervised learning (SSL) leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. A common pretext task consists in pretraining a SSL…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-14 Salah Zaiem , Titouan Parcollet , Slim Essid

Anomaly detection in time-series has a wide range of practical applications. While numerous anomaly detection methods have been proposed in the literature, a recent survey concluded that no single method is the most accurate across various…

Machine Learning · Computer Science 2023-03-14 Mononito Goswami , Cristian Challu , Laurent Callot , Lenon Minorics , Andrey Kan

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Mrinal Anand , Aditya Garg

Unsupervised feature selection has been always attracting research attention in the communities of machine learning and data mining for decades. In this paper, we propose an unsupervised feature selection method seeking a feature…

Machine Learning · Computer Science 2015-06-04 Sen Wang , Feiping Nie , Xiaojun Chang , Lina Yao , Xue Li , Quan Z. Sheng

This paper looks at semi-supervised learning (SSL) for image-based text recognition. One of the most popular SSL approaches is pseudo-labeling (PL). PL approaches assign labels to unlabeled data before re-training the model with a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Gaurav Patel , Jan Allebach , Qiang Qiu

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

Machine Learning · Computer Science 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

We consider a family of problems that are concerned about making predictions for the majority of unlabeled, graph-structured data samples based on a small proportion of labeled samples. Relational information among the data samples, often…

Machine Learning · Computer Science 2019-11-05 Jiaqi Ma , Weijing Tang , Ji Zhu , Qiaozhu Mei

Self-supervision provides effective representations for downstream tasks without requiring labels. However, existing approaches lag behind fully supervised training and are often not thought beneficial beyond obviating or reducing the need…

Machine Learning · Computer Science 2019-10-30 Dan Hendrycks , Mantas Mazeika , Saurav Kadavath , Dawn Song

In this paper we show how to efficiently produce unbiased estimates of subgraph frequencies from a probability sample of egocentric networks (i.e., focal nodes, their neighbors, and the induced subgraphs of ties among their neighbors). A…

Social and Information Networks · Computer Science 2015-10-29 Minas Gjoka , Emily Smith , Carter T. Butts

Motivated by the need to address the degeneracy of canonical Laplace learning algorithms in low label rates, we propose to reformulate graph-based semi-supervised learning as a nonconvex generalization of a \emph{Trust-Region Subproblem}…

Machine Learning · Computer Science 2024-08-15 Chester Holtz , Pengwen Chen , Alexander Cloninger , Chung-Kuan Cheng , Gal Mishne

The complexity of high-dimensional datasets presents significant challenges for machine learning models, including overfitting, computational complexity, and difficulties in interpreting results. To address these challenges, it is essential…

Machine Learning · Computer Science 2023-08-01 Gaurav Srivastava , Mahesh Jangid

Learning semantic segmentation models under image-level supervision is far more challenging than under fully supervised setting. Without knowing the exact pixel-label correspondence, most weakly-supervised methods rely on external models to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zi-Yi Ke , Chiou-Ting Hsu

Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selection algorithms,…

Machine Learning · Computer Science 2022-07-20 Zhifeng Qiu , Wanxin Zeng , Dahua Liao , Ning Gui

Image classification is a challenging problem for computer in reality. Large numbers of methods can achieve satisfying performances with sufficient labeled images. However, labeled images are still highly limited for certain image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Hongfeng Li

Traditional supervised medical image segmentation models require large amounts of labeled data for training; however, obtaining such large-scale labeled datasets in the real world is extremely challenging. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yunyao Lu , Yihang Wu , Reem Kateb , Ahmad Chaddad