中文
相关论文

相关论文: Robustness of Unsupervised Representation Learning…

200 篇论文

The challenges faced by text classification with large tag systems in natural language processing tasks include multiple tag systems, uneven data distribution, and high noise. To address these problems, the ESimCSE unsupervised comparative…

机器学习 · 计算机科学 2023-04-27 Ruan Lu , Zhou HangCheng , Ran Meng , Zhao Jin , Qin JiaoYu , Wei Feng , Wang ChenZi

Despite their promising performance across various natural language processing (NLP) tasks, current NLP systems are vulnerable to textual adversarial attacks. To defend against these attacks, most existing methods apply adversarial training…

计算与语言 · 计算机科学 2023-07-06 Junjie Wu , Dit-Yan Yeung

Federated learning is an emerging data-private distributed learning framework, which, however, is vulnerable to adversarial attacks. Although several heuristic defenses are proposed to enhance the robustness of federated learning, they do…

机器学习 · 计算机科学 2024-03-05 Cheng Chen , Bhavya Kailkhura , Ryan Goldhahn , Yi Zhou

Efforts to address declining accuracy as a result of data shifts often involve various data-augmentation strategies. Adversarial training is one such method, designed to improve robustness to worst-case distribution shifts caused by…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Fatemeh Amerehi , Patrick Healy

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

机器学习 · 计算机科学 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Recently, Semi-Supervised Learning (SSL) has shown much promise in leveraging unlabeled data while being provided with very few labels. In this paper, we show that ignoring the labels altogether for whole epochs intermittently during…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Boaz Lerner , Guy Shiran , Daphna Weinshall

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

机器学习 · 计算机科学 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Learning from positive and unlabeled data is known as positive-unlabeled (PU) learning in literature and has attracted much attention in recent years. One common approach in PU learning is to sample a set of pseudo-negatives from the…

机器学习 · 计算机科学 2023-08-02 Zhangchi Zhu , Lu Wang , Pu Zhao , Chao Du , Wei Zhang , Hang Dong , Bo Qiao , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Semi-supervised learning (SSL) aims to improve performance by exploiting unlabeled data when labels are scarce. Conventional SSL studies typically assume close environments where important factors (e.g., label, feature, distribution)…

机器学习 · 计算机科学 2024-12-25 Lan-Zhe Guo , Lin-Han Jia , Jie-Jing Shao , Yu-Feng Li

Deep neural networks remain vulnerable to adversarial examples despite advances in architectures and training paradigms. We investigate how training data characteristics affect adversarial robustness across 36 state-of-the-art vision models…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Marco Zimmerli , Andreas Plesner , Till Aczel , Roger Wattenhofer

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Unsupervised pre-training was a critical technique for training deep neural networks years ago. With sufficient labeled data and modern training techniques, it is possible to train very deep neural networks from scratch in a purely…

计算机视觉与模式识别 · 计算机科学 2017-03-29 Jianfeng Dong , Xiao-Jiao Mao , Chunhua Shen , Yu-Bin Yang

Robust learning from noisy demonstrations is a practical but highly challenging problem in imitation learning. In this paper, we first theoretically show that robust imitation learning can be achieved by optimizing a classification risk…

机器学习 · 统计学 2021-02-22 Voot Tangkaratt , Nontawat Charoenphakdee , Masashi Sugiyama

Representation learning from unlabeled data has been extensively studied in statistics, data science and signal processing with a rich literature on techniques for dimension reduction, compression, multi-dimensional scaling among others.…

机器学习 · 计算机科学 2025-10-03 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

Unsupervised learning is the most challenging problem in machine learning and especially in deep learning. Among many scenarios, we study an unsupervised learning problem of high economic value --- learning to predict without costly pairing…

机器学习 · 计算机科学 2016-06-16 Jianshu Chen , Po-Sen Huang , Xiaodong He , Jianfeng Gao , Li Deng

We demonstrate that the choice of optimizer, neural network architecture, and regularizer significantly affect the adversarial robustness of linear neural networks, providing guarantees without the need for adversarial training. To this…

机器学习 · 计算机科学 2021-06-08 Fartash Faghri , Sven Gowal , Cristina Vasconcelos , David J. Fleet , Fabian Pedregosa , Nicolas Le Roux

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

机器学习 · 计算机科学 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

Adversarial training is one of the strongest defenses against adversarial attacks, but it requires adversarial examples to be generated for every mini-batch during optimization. The expense of producing these examples during training often…

机器学习 · 计算机科学 2019-10-28 Ali Shafahi , Amin Ghiasi , Furong Huang , Tom Goldstein

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

机器学习 · 计算机科学 2023-06-14 Omar Montasser