中文
相关论文

相关论文: Pre-trained Encoders in Self-Supervised Learning I…

200 篇论文

Recommender systems play a crucial role in tackling the challenge of information overload by delivering personalized recommendations based on individual user preferences. Deep learning techniques, such as RNNs, GNNs, and Transformer…

信息检索 · 计算机科学 2025-12-16 Xubin Ren , Wei Wei , Lianghao Xia , Chao Huang

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

It is known that deep neural networks, trained for the classification of non-sensitive target attributes, can reveal sensitive attributes of their input data through internal representations extracted by the classifier. We take a step…

机器学习 · 计算机科学 2021-09-15 Mohammad Malekzadeh , Anastasia Borovykh , Deniz Gündüz

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained…

密码学与安全 · 计算机科学 2024-04-02 Shanglun Feng , Florian Tramèr

To promote secure and private artificial intelligence (SPAI), we review studies on the model security and data privacy of DNNs. Model security allows system to behave as intended without being affected by malicious external influences that…

密码学与安全 · 计算机科学 2021-03-11 Ho Bae , Jaehee Jang , Dahuin Jung , Hyemi Jang , Heonseok Ha , Hyungyu Lee , Sungroh Yoon

Learning good representations without supervision is still an open issue in machine learning, and is particularly challenging for speech signals, which are often characterized by long sequences with a complex hierarchical structure. Some…

机器学习 · 计算机科学 2019-04-09 Santiago Pascual , Mirco Ravanelli , Joan Serrà , Antonio Bonafonte , Yoshua Bengio

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

机器学习 · 计算机科学 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

We present a neural semi-supervised learning model termed Self-Pretraining. Our model is inspired by the classic self-training algorithm. However, as opposed to self-training, Self-Pretraining is threshold-free, it can potentially update…

计算与语言 · 计算机科学 2021-10-01 Payam Karisani , Negin Karisani

We have gained access to vast amounts of multi-omics data thanks to Next Generation Sequencing. However, it is challenging to analyse this data due to its high dimensionality and much of it not being annotated. Lack of annotated data is a…

机器学习 · 计算机科学 2022-10-04 Sayed Hashim , Karthik Nandakumar , Mohammad Yaqub

Training deep networks with noisy labels leads to poor generalization and degraded accuracy due to overfitting to label noise. Existing approaches for learning with noisy labels often rely on the availability of a clean subset of data. By…

机器学习 · 计算机科学 2025-11-27 David Szczecina , Nicholas Pellegrino , Paul Fieguth

In Semi-Supervised Semi-Private (SP) learning, the learner has access to both public unlabelled and private labelled data. We propose a computationally efficient algorithm that, under mild assumptions on the data, provably achieves…

机器学习 · 计算机科学 2023-06-08 Francesco Pinto , Yaxi Hu , Fanny Yang , Amartya Sanyal

Semi-supervised algorithms aim to learn prediction functions from a small set of labeled observations and a large set of unlabeled observations. Because this framework is relevant in many applications, they have received a lot of interest…

机器学习 · 计算机科学 2025-02-17 Massih-Reza Amini , Vasilii Feofanov , Loic Pauletto , Lies Hadjadj , Emilie Devijver , Yury Maximov

Classifiers learnt from data are increasingly being used as components in systems where safety is a critical concern. In this work, we present a formal notion of safety for classifiers via constraints called safe-ordering constraints. These…

机器学习 · 计算机科学 2022-06-13 Klas Leino , Aymeric Fromherz , Ravi Mangal , Matt Fredrikson , Bryan Parno , Corina Păsăreanu

With the extensive applications of machine learning, the issue of private or sensitive data in the training examples becomes more and more serious: during the training process, personal information or habits may be disclosed to unexpected…

量子物理 · 物理学 2017-08-01 Shenggang Ying , Mingsheng Ying , Yuan Feng

The last decade has seen a rise of Deep Learning with its applications ranging across diverse domains. But usually, the datasets used to drive these systems contain data which is highly confidential and sensitive. Though, Deep Learning…

密码学与安全 · 计算机科学 2022-12-09 Vishal Jignesh Gandhi , Sanchit Shokeen , Saloni Koshti

Semi-supervised learning (SSL) algorithm is a setup built upon a realistic assumption that access to a large amount of labeled data is tough. In this study, we present a generalized framework, named SCAR, standing for Selecting Clean…

机器学习 · 计算机科学 2023-08-09 Dongyoon Yang , Kunwoong Kim , Yongdai Kim

Security, privacy, and fairness have become critical in the era of data science and machine learning. More and more we see that achieving universally secure, private, and fair systems is practically impossible. We have seen for example how…

机器学习 · 统计学 2017-05-24 Jure Sokolic , Qiang Qiu , Miguel R. D. Rodrigues , Guillermo Sapiro

Commercial companies that collect user data on a large scale have been the main beneficiaries of this trend since the success of deep learning techniques is directly proportional to the amount of data available for training. Massive data…

密码学与安全 · 计算机科学 2020-06-30 Saichethan Miriyala Reddy , Saisree Miriyala