English
Related papers

Related papers: Inducing Uncertainty on Open-Weight Models for Tes…

200 papers

Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research environments (TREs) provide safe and secure environments in which researchers can…

Cryptography and Security · Computer Science 2022-08-23 Esma Mansouri-Benssassi , Simon Rogers , Jim Smith , Felix Ritchie , Emily Jefferson

In safety-critical applications, language models should be able to characterize their uncertainty with meaningful probabilities. Many uncertainty quantification approaches require supervised data; however, finding suitable unseen…

Computation and Language · Computer Science 2026-05-14 Sophia Hager , Simon Zeng , Nicholas Andrews

As the privacy risks posed by camera surveillance and facial recognition have grown, so has the research into privacy preservation algorithms. Among these, visual privacy preservation algorithms attempt to impart bodily privacy to subjects…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Sophie Noiret , Siddharth Ravi , Martin Kampel , Francisco Florez-Revuelta

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Over the past few years, a tremendous growth of machine learning was brought about by a significant increase in adoption of cloud-based services. As a result, various solutions have been proposed in which the machine learning models run on…

Cryptography and Security · Computer Science 2021-08-02 Tanveer Khan , Alexandros Bakas , Antonis Michalas

Machine learning (ML) models used in medical imaging diagnostics can be vulnerable to a variety of privacy attacks, including membership inference attacks, that lead to violations of regulations governing the use of medical data and…

Cryptography and Security · Computer Science 2021-08-23 William Paul , Yinzhi Cao , Miaomiao Zhang , Phil Burlina

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Training with differential privacy (DP) provides a guarantee to members in a dataset that they cannot be identified by users of the released model. However, those data providers, and, in general, the public, lack methods to efficiently…

Machine Learning · Computer Science 2025-12-04 Zoë Ruha Bell , Anvith Thudi , Olive Franzese-McLaughlin , Nicolas Papernot , Shafi Goldwasser

This paper examines the evolving landscape of machine learning (ML) and its profound impact across various sectors, with a special focus on the emerging field of Privacy-preserving Machine Learning (PPML). As ML applications become…

Cryptography and Security · Computer Science 2025-01-30 Chaoyu Zhang , Shaoyu Li

The performance of machine learning algorithms can be considerably improved when trained over larger datasets. In many domains, such as medicine and finance, larger datasets can be obtained if several parties, each having access to limited…

Machine Learning · Computer Science 2021-09-30 Dana Pessach , Tamir Tassa , Erez Shmueli

Accurately estimating uncertainties in neural network predictions is of great importance in building trusted DNNs-based models, and there is an increasing interest in providing accurate uncertainty estimation on many tasks, such as security…

Machine Learning · Computer Science 2020-07-14 Yukun Ding , Jinglan Liu , Jinjun Xiong , Yiyu Shi

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases,…

Artificial Intelligence · Computer Science 2023-04-28 Ioannis Papantonis , Vaishak Belle

Machine learning (ML) is vulnerable to inference (e.g., membership inference, property inference, and data reconstruction) attacks that aim to infer the private information of training data or dataset. Existing defenses are only designed…

Machine Learning · Computer Science 2024-03-05 Sayedeh Leila Noorbakhsh , Binghui Zhang , Yuan Hong , Binghui Wang

We propose a simple yet effective solution to tackle the often-competing goals of fairness and utility in classification tasks. While fairness ensures that the model's predictions are unbiased and do not discriminate against any particular…

Machine Learning · Computer Science 2023-08-16 Anique Tahir , Lu Cheng , Huan Liu

Over-parameterized models are typically vulnerable to membership inference attacks, which aim to determine whether a specific sample is included in the training of a given model. Previous Weight regularizations (e.g., L1 regularization)…

Machine Learning · Computer Science 2024-10-10 Qiang Hu , Hengxiang Zhang , Hongxin Wei

We study privacy-utility trade-offs where users share privacy-correlated useful information with a service provider to obtain some utility. The service provider is adversarial in the sense that it can infer the users' private information…

Information Theory · Computer Science 2021-06-29 Xiaoming Duan , Zhe Xu , Rui Yan , Ufuk Topcu

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Continual data collection and widespread deployment of machine learning algorithms, particularly the distributed variants, have raised new privacy challenges. In a distributed machine learning scenario, the dataset is stored among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Shripad Gade , Nitin H. Vaidya

The use of Machine Learning (ML) for data-driven decision-making often relies on access to sensitive datasets, which introduces privacy challenges. Traditional encryption methods protect data at rest or in transit but fail to secure it…

Cryptography and Security · Computer Science 2026-04-28 Alexandre Marques , Beatriz Sá , Rui Botelho , Pedro Pinto