中文
相关论文

相关论文: Statistical Unlearning of Distributions: A Hypothe…

200 篇论文

The sample compression theory provides generalization guarantees for predictors that can be fully defined using a subset of the training dataset and a (short) message string, generally defined as a binary sequence. Previous works provided…

机器学习 · 计算机科学 2025-03-12 Mathieu Bazinet , Valentina Zantedeschi , Pascal Germain

Machine unlearning aims to efficiently eliminate the memory about deleted data from trained models and address the right to be forgotten. Despite the success of existing unlearning algorithms, unlearning in sparse models has not yet been…

机器学习 · 计算机科学 2025-12-04 Yang Xiao , Gen Li , Jie Ji , Ruimeng Ye , Xiaolong Ma , Bo Hui

Machine unlearning considers the removal of the contribution of a set of data points from a trained model. In a distributed setting, where a server orchestrates training using data available at a set of remote users, unlearning is essential…

信号处理 · 电气工程与系统科学 2025-05-07 Natalie Lang , Alon Helvitz , Nir Shlezinger

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

机器学习 · 计算机科学 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Evaluating machine unlearning remains challenging, as existing methods typically require retraining reference models or performing membership inference attacks, both of which rely on prior access to training configuration or supervision…

机器学习 · 计算机科学 2026-03-03 Chenhao Zhang , Muxing Li , Feng Liu , Weitong Chen , Miao Xu

We study the general problem of testing whether an unknown distribution belongs to a specified family of distributions. More specifically, given a distribution family $\mathcal{P}$ and sample access to an unknown discrete distribution…

数据结构与算法 · 计算机科学 2017-08-09 Clément L. Canonne , Ilias Diakonikolas , Alistair Stewart

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

For a responsible and safe deployment of diffusion models in various domains, regulating the generated outputs from these models is desirable because such models could generate undesired, violent, and obscene outputs. To tackle this…

机器学习 · 计算机科学 2026-03-24 Subhodip Panda , Varun M S , Shreyans Jain , Sarthak Kumar Maharana , Prathosh A. P

A key element in transfer learning is representation learning; if representations can be developed that expose the relevant factors underlying the data, then new tasks and domains can be learned readily based on mappings of these salient…

机器学习 · 计算机科学 2014-12-18 Yujia Li , Kevin Swersky , Richard Zemel

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

机器学习 · 计算机科学 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

We consider nonparametric sequential hypothesis testing problem when the distribution under the null hypothesis is fully known but the alternate hypothesis corresponds to some other unknown distribution with some loose constraints. We…

信息论 · 计算机科学 2013-11-15 Shouvik Ganguly , K Sahasranand , Vinod Sharma

We introduce machine unlearning for speech tasks, a novel and underexplored research problem that aims to efficiently and effectively remove the influence of specific data from trained speech models without full retraining. This has…

机器学习 · 计算机科学 2025-06-03 Jiali Cheng , Hadi Amiri

We define a novel, basic, unsupervised learning problem - learning the lowest density homogeneous hyperplane separator of an unknown probability distribution. This task is relevant to several problems in machine learning, such as…

机器学习 · 计算机科学 2009-01-22 Shai Ben-David , Tyler Lu , David Pal , Miroslava Sotakova

Many problems in computational science and engineering become one-to-many after coarse graining, partial observation, or inverse reconstruction: a resolved state may not determine a unique subgrid forcing, a structural descriptor may not…

机器学习 · 统计学 2026-05-28 Junfeng Chen

This paper studies hypothesis testing and parameter estimation in the context of the divide and conquer algorithm. In a unified likelihood based framework, we propose new test statistics and point estimators obtained by aggregating various…

统计理论 · 数学 2015-09-21 Heather Battey , Jianqing Fan , Han Liu , Junwei Lu , Ziwei Zhu

Pretrained language models memorize vast amounts of information, including private and copyrighted data, raising significant safety concerns. Retraining these models after excluding sensitive data is prohibitively expensive, making machine…

计算与语言 · 计算机科学 2024-10-04 Minseok Choi , Kyunghyun Min , Jaegul Choo

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

机器学习 · 计算机科学 2019-01-15 Wouter M. Kouw , Marco Loog

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

机器学习 · 计算机科学 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

机器学习 · 统计学 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo