English
Related papers

Related papers: EMA: Auditing Data Removal from Trained Models

200 papers

Machine unlearning is studied for a multitude of tasks, but specialization of unlearning methods to particular tasks has made their systematic comparison challenging. To address this issue, we propose a conceptual space to characterize…

We systematically study various network Expectation-Maximization (EM) algorithms for the Gaussian mixture model within the framework of decentralized federated learning. Our theoretical investigation reveals that directly extending the…

Machine Learning · Statistics 2024-11-11 Shuyuan Wu , Bin Du , Xuetong Li , Hansheng Wang

The removal of carefully-selected examples from training data has recently emerged as an effective way of improving the robustness of machine learning models. However, the best way to select these examples remains an open question. In this…

Machine Learning · Computer Science 2024-09-19 Andrea Napoli , Paul White

Training with mixed data distributions is a common and important part of creating multi-task and instruction-following models. The diversity of the data distributions and cost of joint training makes the optimization procedure extremely…

Computation and Language · Computer Science 2024-11-06 Dhananjay Ram , Aditya Rawal , Momchil Hardalov , Nikolaos Pappas , Sheng Zha

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Konstantinos Kamnitsas , Wenjia Bai , Enzo Ferrante , Steven McDonagh , Matthew Sinclair , Nick Pawlowski , Martin Rajchl , Matthew Lee , Bernhard Kainz , Daniel Rueckert , Ben Glocker

Planning quality assurance (QA) activities in a systematic way and controlling their execution are challenging tasks for companies that develop software or software-intensive systems. Both require estimation capabilities regarding the…

Software Engineering · Computer Science 2014-01-14 Michael Kläs , Haruka Nakao , Frank Elberzhager , Jürgen Münch

(abridged) We develop an algorithm for estimating parameters of a distribution sampled with contamination, employing a statistical technique known as ``expectation maximization'' (EM). Given models for both member and contaminant…

Medical entity extraction (EE) is a standard procedure used as a first stage in medical texts processing. Usually Medical EE is a two-step process: named entity recognition (NER) and named entity normalization (NEN). We propose a novel…

Computation and Language · Computer Science 2022-01-26 Alexander Nesterov , Dmitry Umerenkov

We examine two different techniques for parameter averaging in GAN training. Moving Average (MA) computes the time-average of parameters, whereas Exponential Moving Average (EMA) computes an exponentially discounted sum. Whilst MA is known…

Machine unlearning is an emerging field that selectively removes specific data samples from a trained model. This capability is crucial for addressing privacy concerns, complying with data protection regulations, and correcting errors or…

Machine Learning · Computer Science 2025-01-29 Zitong Li , Qingqing Ye , Haibo Hu

Lookahead-based acceleration methods, such as Nesterov's momentum, are widely used in optimization, but they often become unreliable in deep learning training mainly due to stochastic gradient noise and non-convex loss landscapes. In…

Machine Learning · Computer Science 2026-05-26 Chung-Yiu Yau , Dawei Li , Athanasios Glentis , Valentyn Boreiko , Hoi-To Wai , Mingyi Hong

Shared embedding spaces are widely used for multimodal search and data curation. In practice, two problems often limit how well this works. First, embeddings can reflect modality more than meaning, so examples cluster by input type even…

Information Retrieval · Computer Science 2026-05-05 Pratyush Muthukumar , Harshil Kotamreddy , Sarah Amiraslani , Tomo Kanazawa , Ramani Akkati , Shaan Jain , Andrew Mathau

Patient similarity assessment, which identifies patients similar to a given patient, can help improve medical care. The assessment can be performed using Electronic Medical Records (EMRs). Patient similarity measurement requires converting…

Information Retrieval · Computer Science 2022-09-20 Hoda Memarzadeh , Nasser Ghadiri , Matthias Samwald , Maryam Lotfi Shahreza

Large Language Models (LLMs) power numerous AI applications, yet updating their knowledge remains costly. Model editing provides a lightweight alternative through targeted parameter modifications, with meta-learning-based model editing…

Computation and Language · Computer Science 2026-01-30 Xiaopeng Li , Shasha Li , Xi Wang , Shezheng Song , Bin Ji , Shangwen Wang , Jun Ma , Xiaodong Liu , Mina Liu , Jie Yu

Personal digital data is a critical asset, and governments worldwide have enforced laws and regulations to protect data privacy. Data users have been endowed with the right to be forgotten of their data. In the course of machine learning…

Machine Learning · Computer Science 2024-03-14 Na Li , Chunyi Zhou , Yansong Gao , Hui Chen , Anmin Fu , Zhi Zhang , Yu Shui

As large language models (LLMs) are trained on increasingly vast and opaque text corpora, determining which data contributed to training has become essential for copyright enforcement, compliance auditing, and user trust. While prior work…

Computation and Language · Computer Science 2026-03-30 Pranav Shetty , Mirazul Haque , Zhiqiang Ma , Xiaomo Liu

Fitts' law is often employed as a predictive model for human movement, especially in the field of human-computer interaction. Models with an assumed Gaussian error structure are usually adequate when applied to data collected from…

Applications · Statistics 2022-10-03 Yanxi Li , Derek S. Young , Julien Gori , Olivier Rioul

A folded type model is developed for analyzing compositional data. The proposed model involves an extension of the $\alpha$-transformation for compositional data and provides a new and flexible class of distributions for modeling data…

Machine Learning · Statistics 2019-02-27 Michail Tsagris , Connie Stewart

Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning metrics typically measure success by monitoring the model's…

Cryptography and Security · Computer Science 2025-12-24 Hengrui Jia , Taoran Li , Jonas Guan , Varun Chandrasekaran