中文
相关论文

相关论文: Position: An Empirically Grounded Identifiability …

200 篇论文

We address the problem of evaluating the quality of self-supervised learning (SSL) models without access to supervised labels, while being agnostic to the architecture, learning algorithm or data manipulation used during training. We argue…

机器学习 · 计算机科学 2023-11-16 Yuchen Lu , Zhen Liu , Aristide Baratin , Romain Laroche , Aaron Courville , Alessandro Sordoni

Semi-supervised learning (SSL) can improve model performance by leveraging unlabeled images, which can be collected from public image sources with low costs. In recent years, synthetic images have become increasingly common in public image…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Zerun Wang , Jiafeng Mao , Liuyu Xiang , Toshihiko Yamasaki

Self-supervised learning (SSL) is now a serious competitor for supervised learning, even though it does not require data annotation. Several baselines have attempted to make SSL models exploit information about data distribution, and less…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

The cross-pollination between causal discovery and deep learning has led to increasingly extensive interactions. It results in a large number of deep learning data types (such as images, text, etc.) extending into the field of causal…

机器学习 · 计算机科学 2025-01-03 Hang Chen , Xinyu Yang , Keqing Du , Wenya Wang

Recently, self-supervised learning (SSL) has achieved tremendous success in learning image representation. Despite the empirical success, most self-supervised learning methods are rather "inefficient" learners, typically taking hundreds of…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Shengbang Tong , Yubei Chen , Yi Ma , Yann Lecun

Self-supervised learning (SSL) has been investigated to generate task-agnostic representations across various domains. However, such investigation has not been conducted for detecting multiple mental disorders. The rationale behind the…

机器学习 · 计算机科学 2024-03-25 Rohan Kumar Gupta , Rohit Sinha

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

机器学习 · 计算机科学 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Recently proposed consistency-based Semi-Supervised Learning (SSL) methods such as the $\Pi$-model, temporal ensembling, the mean teacher, or the virtual adversarial training, have advanced the state of the art in several SSL tasks. These…

机器学习 · 统计学 2021-01-19 Atin Ghosh , Alexandre H. Thiery

Self-supervised learning (SSL), which can automatically generate ground-truth samples from raw data, holds vast potential to improve recommender systems. Most existing SSL-based methods perturb the raw data graph with uniform node/edge…

信息检索 · 计算机科学 2021-08-27 Junliang Yu , Hongzhi Yin , Min Gao , Xin Xia , Xiangliang Zhang , Nguyen Quoc Viet Hung

Semi-supervised learning (SSL) has demonstrated its potential to improve the model accuracy for a variety of learning tasks when the high-quality supervised data is severely limited. Although it is often established that the average…

机器学习 · 计算机科学 2023-09-04 Zhaowei Zhu , Tianyi Luo , Yang Liu

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

计算机视觉与模式识别 · 计算机科学 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-supervised learning (SSL) has achieved remarkable performance in various medical imaging tasks by dint of priors from massive unlabelled data. However, regarding a specific downstream task, there is still a lack of an instruction book…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Chuyan Zhang , Yun Gu

We present the SUPERB challenge at SLT 2022, which aims at learning self-supervised speech representation for better performance, generalization, and efficiency. The challenge builds upon the SUPERB benchmark and implements metrics to…

The appearance of singularities in the function of interest constitutes a fundamental challenge in scientific computing. It can significantly undermine the effectiveness of numerical schemes for function approximation, numerical…

数值分析 · 数学 2025-07-01 Difeng Cai , Paulina Sepúlveda

With the rapid proliferation of mobile devices and data, next-generation wireless communication systems face stringent requirements for ultra-low latency, ultra-high reliability, and massive connectivity. Traditional AI-driven wireless…

信号处理 · 电气工程与系统科学 2024-06-12 Zhixiang Yang , Hongyang Du , Dusit Niyato , Xudong Wang , Yu Zhou , Lei Feng , Fanqin Zhou , Wenjing Li , Xuesong Qiu

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

Self-Supervised Learning (SSL) is an increasingly popular ML paradigm that trains models to transform complex inputs into representations without relying on explicit labels. These representations encode similarity structures that enable…

机器学习 · 计算机科学 2022-06-30 Adam Dziedzic , Nikita Dhawan , Muhammad Ahmad Kaleem , Jonas Guan , Nicolas Papernot

Semi-supervised learning (SSL) commonly exhibits confirmation bias, where models disproportionately favor certain classes, leading to errors in predicted pseudo labels that accumulate under a self-training paradigm. Unlike supervised…

机器学习 · 计算机科学 2024-09-30 Yu Wang , Yuxuan Yin , Peng Li

A major limitation in applying deep learning to artificial intelligence (AI) systems is the scarcity of high-quality curated datasets. We investigate strong augmentation based self-supervised learning (SSL) techniques to address this…

图像与视频处理 · 电气工程与系统科学 2022-03-18 John D. Miller , Vignesh A. Arasu , Albert X. Pu , Laurie R. Margolies , Weiva Sieh , Li Shen

Semi-supervised learning (SSL) provides an effective means of leveraging unlabelled data to improve a model performance. Even though the domain has received a considerable amount of attention in the past years, most methods present the…

机器学习 · 统计学 2023-03-06 Hugo Schmutz , Olivier Humbert , Pierre-Alexandre Mattei