English
Related papers

Related papers: Provable Training Data Identification for Large La…

200 papers

Detecting pre-training data in Large Language Models (LLMs) is crucial for auditing data privacy and copyright compliance, yet it remains challenging in black-box, zero-shot settings where computational resources and training data are…

Computation and Language · Computer Science 2026-01-13 Jinhan Liu , Yibo Yang , Ruiying Lu , Piotr Piekos , Yimeng Chen , Peng Wang , Dandan Guo

Person re-identification (Re-ID) has achieved great improvement with deep learning and a large amount of labelled training data. However, it remains a challenging task for adapting a model trained in a source domain of labelled data to a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Xinyu Zhang , Jiewei Cao , Chunhua Shen , Mingyu You

This paper presents a new approach to identifying and eliminating mislabeled training instances for supervised learning. The goal of this approach is to improve classification accuracies produced by learning algorithms by improving the…

Artificial Intelligence · Computer Science 2011-06-02 C. E. Brodley , M. A. Friedl

In this research we propose a new method for training predictive machine learning models for prescriptive applications. This approach, which we refer to as coupled validation, is based on tweaking the validation step in the standard…

Machine Learning · Computer Science 2021-10-25 Ebrahim Mortaz , Alexander Vinel

Differential privacy provides a rigorous framework for privacy-preserving data analysis. This paper proposes the first differentially private procedure for controlling the false discovery rate (FDR) in multiple hypothesis testing. Inspired…

Statistics Theory · Mathematics 2021-07-06 Cynthia Dwork , Weijie J. Su , Li Zhang

In this evolving era of machine learning security, membership inference attacks have emerged as a potent threat to the confidentiality of sensitive data. In this attack, adversaries aim to determine whether a particular point was used…

Machine Learning · Computer Science 2024-06-21 Abhishek Sinha , Himanshi Tibrewal , Mansi Gupta , Nikhar Waghela , Shivank Garg

Obtaining high-quality data for collaborative training of machine learning models can be a challenging task due to A) regulatory concerns and B) a lack of data owner incentives to participate. The first issue can be addressed through the…

Machine Learning · Computer Science 2024-04-17 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

Artificial intelligence models trained from data can only be as good as the underlying data is. Biases in training data propagating through to the output of a machine learning model are a well-documented and well-understood phenomenon, but…

Machine Learning · Computer Science 2025-04-02 Stefan Rass , Martin Dallinger

Real-world data is often ambiguous; for example, human annotation produces instances with multiple conflicting class labels. Partial-label learning (PLL) aims at training a classifier in this challenging setting, where each instance is…

Machine Learning · Computer Science 2025-05-26 Tobias Fuchs , Florian Kalinke

Pre-training data detection for LLMs is essential for addressing copyright concerns and mitigating benchmark contamination. Existing methods mainly focus on the likelihood-based statistical features or heuristic signals before and after…

Computation and Language · Computer Science 2026-03-06 Ruiqi Zhang , Lingxiang Wang , Hainan Zhang , Zhiming Zheng , Yanyan Lan

Generalised Bayesian Inference (GBI) attempts to address model misspecification in a standard Bayesian setup by tempering the likelihood. The likelihood is raised to a fractional power, called the learning rate, which reduces its importance…

Methodology · Statistics 2025-01-22 Schyan Zafar , Geoff K. Nicholls

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

Benchmark data contamination has become a central challenge in LLM evaluation: when evaluation examples appear in the training data of one or more audited models, reported performance can be inflated and cross-model comparisons become…

Machine Learning · Computer Science 2026-05-22 Zhenlong Liu , Hao Zeng , Hongxin Wei

Personalized Intelligence (PI) is the problem of providing customized AI experiences tailored to each individual user. In many applications, PI is preferred or even required. Existing personalization approaches involve fine-tuning…

Computation and Language · Computer Science 2022-03-15 Yiping Kang , Ashish Mahendra , Christopher Clarke , Lingjia Tang , Jason Mars

Deep learning models achieve high predictive accuracy across a broad spectrum of tasks, but rigorously quantifying their predictive uncertainty remains challenging. Usable estimates of predictive uncertainty should (1) cover the true…

Machine Learning · Computer Science 2020-07-28 Ahmed M. Alaa , Mihaela van der Schaar

Non-destructive 3D imaging of large multi-particulate samples is essential for quantifying particle-level properties, such as size, shape, and spatial distribution, across applications in mining, materials science, and geology. However,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Philipp D. Lösel , Aleese Barron , Yulai Zhang , Matthias Fabian , Benjamin Young , Nicolas Francois , Andrew M. Kingston

In the field of machine learning, domain-specific annotated data is an invaluable resource for training effective models. However, in the medical domain, this data often includes Personal Health Information (PHI), raising significant…

Computation and Language · Computer Science 2024-09-13 Tal Baumel , Andre Manoel , Daniel Jones , Shize Su , Huseyin Inan , Aaron , Bornstein , Robert Sim

This paper presents a framework for privacy-preserving verification of machine learning models, focusing on models trained on sensitive data. Integrating Local Differential Privacy (LDP) with model explanations from LIME and SHAP, our…

Machine Learning · Computer Science 2025-01-15 Wenbiao Li , Anisa Halimi , Xiaoqian Jiang , Jaideep Vaidya , Erman Ayday

Pretrained large language models (LLMs) are able to solve a wide variety of tasks through transfer learning. Various explainability methods have been developed to investigate their decision making process. TracIn (Pruthi et al., 2020) is…

Computation and Language · Computer Science 2023-02-14 Maximilian Mozes , Tolga Bolukbasi , Ann Yuan , Frederick Liu , Nithum Thain , Lucas Dixon

Controlling the false discovery rate (FDR) is a critical challenge in large-scale data analysis, particularly in the presence of outliers. A common practice involves imposing a Student-$t$ distribution to eliminate the influence of…

Methodology · Statistics 2026-04-01 Yoshiko Hayashi