English
Related papers

Related papers: Machine Learning Models that Remember Too Much

200 papers

While recent research increasingly showcases the remarkable capabilities of Large Language Models (LLMs), it is equally crucial to examine their associated risks. Among these, privacy and security vulnerabilities are particularly…

Computation and Language · Computer Science 2026-01-21 Ali Satvaty , Suzan Verberne , Fatih Turkmen

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

Computation and Language · Computer Science 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove specific content…

Computation and Language · Computer Science 2025-08-12 Xiaojian Yuan , Tianyu Pang , Chao Du , Kejiang Chen , Weiming Zhang , Min Lin

The emergence of machine learning (ML) has led to a transformative shift in software techniques and guidelines for building software applications that support data analysis process activities such as data ingestion, modeling, and…

Software Engineering · Computer Science 2025-01-03 Cristina Tavares , Nathalia Nascimento , Paulo Alencar , Donald Cowan

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

Recently, advances in deep learning have been observed in various fields, including computer vision, natural language processing, and cybersecurity. Machine learning (ML) has demonstrated its ability as a potential tool for anomaly…

Cryptography and Security · Computer Science 2023-10-31 D'Jeff Kanda Nkashama , Arian Soltani , Jean-Charles Verdier , Marc Frappier , Pierre-Martin Tardif , Froduald Kabanza

Production machine learning (ML) systems fail silently -- not with crashes, but through wrong decisions. While observability is recognized as critical for ML operations, there is a lack empirical evidence of what practitioners actually…

Software Engineering · Computer Science 2025-10-29 Joran Leest , Ilias Gerostathopoulos , Patricia Lago , Claudia Raibulet

When we read, we make predictions about upcoming words; these predictions influence our reading behavior. The success of large language models (LLMs), which, like humans, make predictions about upcoming words, has motivated their use as…

Computation and Language · Computer Science 2026-05-27 Byung-Doh Oh , Tal Linzen

Modern machine learning (ML) models are expensive IP and business competitiveness often depends on keeping this IP confidential. This in turn restricts how these models are deployed; for example, it is unclear how to deploy a model…

Cryptography and Security · Computer Science 2025-03-11 Eleanor Clifford , Adhithya Saravanan , Harry Langford , Cheng Zhang , Yiren Zhao , Robert Mullins , Ilia Shumailov , Jamie Hayes

Machine learning (ML) algorithms are increasingly deployed to make critical decisions in socioeconomic applications such as finance, criminal justice, and autonomous driving. However, due to their data-driven and pattern-seeking nature, ML…

Software Engineering · Computer Science 2026-01-08 Verya Monjezi , Ashish Kumar , Ashutosh Trivedi , Gang Tan , Saeid Tizpaz-Niari

Recent applications of machine learning (ML) reveal a noticeable shift from its use for predictive modeling in the sense of a data-driven construction of models mainly used for the purpose of prediction (of ground-truth facts) to its use…

Machine Learning · Computer Science 2021-12-16 Eyke Hüllermeier

It is fair to say that many of the prominent examples of bias in Machine Learning (ML) arise from bias that is there in the training data. In fact, some would argue that supervised ML algorithms cannot be biased, they reflect the data on…

Machine Learning · Computer Science 2021-04-30 William Blanzeisky , Pádraig Cunningham

Motivated by the progress made by large language models (LLMs), we introduce the framework of verbalized machine learning (VML). In contrast to conventional machine learning (ML) models that are typically optimized over a continuous…

Machine Learning · Computer Science 2025-02-17 Tim Z. Xiao , Robert Bamler , Bernhard Schölkopf , Weiyang Liu

Trained ML models are commonly embedded in optimization problems. In many cases, this leads to large-scale NLPs that are difficult to solve to global optimality. While ML models frequently lead to large problems, they also exhibit…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Alexander Mitsos

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

Computation and Language · Computer Science 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Machine Learning algorithms have had a profound impact on the field of computer science over the past few decades. These algorithms performance is greatly influenced by the representations that are derived from the data in the learning…

It has been observed \citep{zhang2016understanding} that deep neural networks can memorize: they achieve 100\% accuracy on training data. Recent theoretical results explained such behavior in highly overparametrized regimes, where the…

Machine Learning · Computer Science 2019-09-27 Rong Ge , Runzhe Wang , Haoyu Zhao

In the last years machine learning (ML) has moved from a academic endeavor to a pervasive technology adopted in almost every aspect of computing. ML-powered products are now embedded in our digital lives: from recommendations of what to…

Machine Learning · Computer Science 2021-07-20 Piero Molino , Christopher Ré

Machine Learning (ML) has recently shown tremendous success in modeling various healthcare prediction tasks, ranging from disease diagnosis and prognosis to patient treatment. Due to the sensitive nature of medical data, privacy must be…

Machine Learning · Computer Science 2024-10-01 Alejandro Guerra-Manzanares , L. Julian Lechuga Lopez , Michail Maniatakos , Farah E. Shamout