English
Related papers

Related papers: Self-Supervised Features Improve Open-World Learni…

200 papers

The perception of transparent objects is one of the well-known challenges in computer vision. Conventional depth sensors have difficulty in sensing the depth of transparent objects due to refraction and reflection of light. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xianghui Fan , Zhaoyu Chen , Mengyang Pan , Anping Deng , Hang Yang

In this work, we observe that many existing self-supervised learning algorithms can be both unified and generalized when seen through the lens of equivariant representations. Specifically, we introduce a general framework we call…

Machine Learning · Computer Science 2022-11-16 T. Anderson Keller , Xavier Suau , Luca Zappella

Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large…

Machine Learning · Computer Science 2018-10-31 Shin Ando

Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-29 Philipp Liznerski , Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

In many real-world settings, machine learning models need to identify user inputs that are out-of-domain (OOD) so as to avoid performing wrong actions. This work focuses on a challenging case of OOD detection, where no labels for in-domain…

Computation and Language · Computer Science 2022-03-23 Di Jin , Shuyang Gao , Seokhwan Kim , Yang Liu , Dilek Hakkani-Tur

We study the problem of lifelong graph learning in an open-world scenario, where a model needs to deal with new tasks and potentially unknown classes. We utilize Out-of-Distribution (OOD) detection methods to recognize new classes and adapt…

Machine Learning · Computer Science 2023-10-20 Marcel Hoffmann , Lukas Galke , Ansgar Scherp

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

Machine Learning · Computer Science 2024-04-09 Zhen Fang , Yixuan Li , Feng Liu , Bo Han , Jie Lu

Estimating building footprint maps from geospatial data is of paramount importance in urban planning, development, disaster management, and various other applications. Deep learning methodologies have gained prominence in building…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Anuja Vats , David Völgyes , Martijn Vermeer , Marius Pedersen , Kiran Raja , Daniele S. M. Fantin , Jacob Alexander Hay

Universal supervised learning is considered from an information theoretic point of view following the universal prediction approach, see Merhav and Feder (1998). We consider the standard supervised "batch" learning where prediction is done…

Information Theory · Computer Science 2018-12-27 Yaniv Fogel , Meir Feder

The effectiveness of learning in massive open online courses (MOOCs) can be significantly enhanced by introducing personalized intervention schemes which rely on building predictive models of student learning behaviors such as some…

Machine Learning · Computer Science 2018-12-20 Mucong Ding , Kai Yang , Dit-Yan Yeung , Ting-Chuen Pong

Recent progress in self-supervised learning has resulted in models that are capable of extracting rich representations from image collections without requiring any explicit label supervision. However, to date the vast majority of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Grant Van Horn , Elijah Cole , Sara Beery , Kimberly Wilber , Serge Belongie , Oisin Mac Aodha

Medical image analysis using supervised deep learning methods remains problematic because of the reliance of deep learning methods on large amounts of labelled training data. Although medical imaging data repositories continue to expand…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Traditional machine learning mainly supervised learning, follows the assumptions of closed-world learning, i.e., for each testing class, a training class is available. However, such machine learning models fail to identify the classes which…

Machine Learning · Computer Science 2022-02-22 Jitendra Parmar , Satyendra Singh Chouhan , Vaskar Raychoudhury , Santosh Singh Rathore

One-class classification has been a prevailing method in building deep anomaly detection models under the assumption that a dataset consisting of normal samples is available. In practice, however, abnormal samples are often mixed in a…

Machine Learning · Computer Science 2023-02-14 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

Although deep learning based methods have achieved great success in many computer vision tasks, their performance relies on a large number of densely annotated samples that are typically difficult to obtain. In this paper, we focus on the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Zhengeng Yang , Hongshan Yu , Yong He , Zhi-Hong Mao , Ajmal Mian

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella

Self-supervised learning has enabled significant improvements on natural image benchmarks. However, there is less work in the medical imaging domain in this area. The optimal models have not yet been determined among the various options.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Alex Fedorov , Eloy Geenjaar , Lei Wu , Thomas P. DeRamus , Vince D. Calhoun , Sergey M. Plis

Federated learning (FL) is an effective paradigm for distributed environments such as the Internet of Things (IoT), where data from diverse devices with varying functionalities remains localized while contributing to a shared global model.…

Machine Learning · Computer Science 2026-03-02 Mohsen Tajgardan , Atena Shiranzaei , Mahdi Rabbani , Reza Khoshkangini , Mahtab Jamali

In this work, we study different approaches to self-supervised pretraining of object detection models. We first design a general framework to learn a spatially consistent dense representation from an image, by randomly sampling and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Trung Dang , Simon Kornblith , Huy Thong Nguyen , Peter Chin , Maryam Khademi

The primary assumption of conventional supervised learning or classification is that the test samples are drawn from the same distribution as the training samples, which is called closed set learning or classification. In many practical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Sepideh Esmaeilpour , Lei Shu , Bing Liu