English
Related papers

Related papers: EnAET: A Self-Trained framework for Semi-Supervise…

200 papers

Recently, self-supervised learning (SSL) has achieved tremendous success in learning image representation. Despite the empirical success, most self-supervised learning methods are rather "inefficient" learners, typically taking hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shengbang Tong , Yubei Chen , Yi Ma , Yann Lecun

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Event cameras asynchronously capture brightness changes with low latency, high temporal resolution, and high dynamic range. However, annotation of event data is a costly and laborious process, which limits the use of deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Simon Klenk , David Bonello , Lukas Koestler , Nikita Araslanov , Daniel Cremers

Neural operators aim to learn mappings between infinite-dimensional function spaces, but their performance often degrades on complex or irregular geometries due to the lack of geometry-aware representations. We propose the Finite Element…

Numerical Analysis · Mathematics 2026-02-03 Shiyuan Li , Hossein Salahshoor

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Machine Learning · Computer Science 2023-04-11 Yangjun Ruan , Saurabh Singh , Warren Morningstar , Alexander A. Alemi , Sergey Ioffe , Ian Fischer , Joshua V. Dillon

Deep learning has significantly advanced automatic medical diagnostics and released the occupation of human resources to reduce clinical pressure, yet the persistent challenge of data scarcity in this area hampers its further improvements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Zehui Zhao , Laith Alzubaidi , Jinglan Zhang , Ye Duan , Usman Naseem , Yuantong Gu

Semi-supervised learning provides an expressive framework for exploiting unlabeled data when labels are insufficient. Previous semi-supervised learning methods typically match model predictions of different data-augmented views in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Cong Wang , Xiaofeng Cao , Lanzhe Guo2 , Zenglin Shi

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

Semi-supervised learning has made remarkable strides by effectively utilizing a limited amount of labeled data while capitalizing on the abundant information present in unlabeled data. However, current algorithms often prioritize aligning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Zhiquan Tan , Kaipeng Zheng , Weiran Huang

We present a novel self-taught framework for unsupervised metric learning, which alternates between predicting class-equivalence relations between data through a moving average of an embedding model and learning the model with the predicted…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

While machine learning and artificial intelligence have long been applied in networking research, the bulk of such works has focused on supervised learning. Recently there has been a rising trend of employing unsupervised machine learning…

Networking and Internet Architecture · Computer Science 2017-09-21 Muhammad Usama , Junaid Qadir , Aunn Raza , Hunain Arif , Kok-Lim Alvin Yau , Yehia Elkhatib , Amir Hussain , Ala Al-Fuqaha

Most of the achievements in artificial intelligence so far were accomplished by supervised learning which requires numerous annotated training data and thus costs innumerable manpower for labeling. Unsupervised learning is one of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Mingxiang Chen , Zhanguo Chang , Haonan Lu , Bitao Yang , Zhuang Li , Liufang Guo , Zhecheng Wang

Deep neural networks have achieved state-of-art performance in many domains including computer vision, natural language processing and self-driving cars. However, they are very computationally expensive and memory intensive which raises…

Machine Learning · Computer Science 2020-04-13 Besher Alhalabi , Mohamed Medhat Gaber , Shadi Basurra

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

A key challenge in machine learning is to generalize from training data to an application domain of interest. This work generalizes the recently-proposed mixture invariant training (MixIT) algorithm to perform unsupervised learning in the…

Sound · Computer Science 2024-03-25 Cong Han , Kevin Wilson , Scott Wisdom , John R. Hershey

Self-supervised learning methods are gaining increasing traction in computer vision due to their recent success in reducing the gap with supervised learning. In natural language processing (NLP) self-supervised learning and transformers are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Sara Atito , Muhammad Awais , Josef Kittler

Supervised Learning is a way of developing Artificial Intelligence systems in which a computer algorithm is trained on labeled data inputs. Effectiveness of a Supervised Learning algorithm is determined by its performance on a given dataset…

Computers and Society · Computer Science 2024-10-29 Shubhi Bansal , Atharva Tendulkar , Nagendra Kumar

Entity alignment is to find identical entities in different knowledge graphs. Although embedding-based entity alignment has recently achieved remarkable progress, training data insufficiency remains a critical challenge. Conventional…

Artificial Intelligence · Computer Science 2022-03-15 Kexuan Xin , Zequn Sun , Wen Hua , Bing Liu , Wei Hu , Jianfeng Qu , Xiaofang Zhou

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin