English
Related papers

Related papers: 10 Security and Privacy Problems in Large Foundati…

200 papers

Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal,…

Cryptography and Security · Computer Science 2020-02-24 Olivia Choudhury , Aris Gkoulalas-Divanis , Theodoros Salonidis , Issa Sylla , Yoonyoung Park , Grace Hsu , Amar Das

Data is essential to train and fine-tune today's frontier artificial intelligence (AI) models and to develop future ones. To date, academic, legal, and regulatory work has primarily addressed how data can directly harm consumers and…

Artificial Intelligence · Computer Science 2025-06-03 Jason Hausenloy , Duncan McClements , Madhavendra Thakur

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Educators and learners worldwide are embracing the rise of Generative Artificial Intelligence (GenAI) as it reshapes higher education. However, GenAI also raises significant privacy and security concerns, as models and privacy-sensitive…

Human-Computer Interaction · Computer Science 2025-06-26 Bei Yi Ng , Jiarui Li , Xinyuan Tong , Kevin Ye , Gauthami Yenne , Varun Chandrasekaran , Jingjie Li

We identify a novel phenomenon in language models: benign fine-tuning of frontier models can lead to privacy collapse. We find that diverse, subtle patterns in training data can degrade contextual privacy, including optimisation for…

Computation and Language · Computer Science 2026-04-21 Anmol Goel , Cornelius Emde , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Ultrasound imaging is widely used in clinical diagnosis due to its non-invasive nature and real-time capabilities. However, traditional ultrasound diagnostics relies heavily on physician expertise and is often hampered by suboptimal image…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Yuncheng Jiang , Chun-Mei Feng , Jinke Ren , Jun Wei , Zixun Zhang , Yiwen Hu , Yunbi Liu , Rui Sun , Xuemei Tang , Juan Du , Xiang Wan , Yong Xu , Bo Du , Xin Gao , Guangyu Wang , Shaohua Zhou , Shuguang Cui , Zhen Li

Foundation models represent the most prominent and recent paradigm shift in artificial intelligence. Foundation models are large models, trained on broad data that deliver high accuracy in many downstream tasks, often without fine-tuning.…

Cryptography and Security · Computer Science 2025-09-15 Hondamunige Prasanna Silva , Federico Becattini , Lorenzo Seidenari

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool…

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and…

Cryptography and Security · Computer Science 2024-02-28 Le Yang , Miao Tian , Duan Xin , Qishuo Cheng , Jiajian Zheng

Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning and code generation abilities on a broad range of open-domain…

Artificial Intelligence · Computer Science 2023-03-30 Yaobo Liang , Chenfei Wu , Ting Song , Wenshan Wu , Yan Xia , Yu Liu , Yang Ou , Shuai Lu , Lei Ji , Shaoguang Mao , Yun Wang , Linjun Shou , Ming Gong , Nan Duan

The recent release of large language model (LLM) based chatbots, such as ChatGPT, has attracted huge interest in foundation models. It is widely believed that foundation models will serve as the fundamental building blocks for future AI…

Software Engineering · Computer Science 2024-01-23 Qinghua Lu , Liming Zhu , Xiwei Xu , Yue Liu , Zhenchang Xing , Jon Whittle

Transfer learning has become an increasingly popular technique in machine learning as a way to leverage a pretrained model trained for one task to assist with building a finetuned model for a related task. This paradigm has been especially…

Machine Learning · Computer Science 2024-10-18 John Abascal , Stanley Wu , Alina Oprea , Jonathan Ullman

We study the problem of differentially private (DP) fine-tuning of large pre-trained models -- a recent privacy-preserving approach suitable for solving downstream tasks with sensitive data. Existing work has demonstrated that high accuracy…

Machine Learning · Computer Science 2024-06-21 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

As machine learning becomes a more mainstream technology, the objective for governments and public sectors is to harness the power of machine learning to advance their mission by revolutionizing public services. Motivational government use…

Cryptography and Security · Computer Science 2020-10-13 Nader Sehatbakhsh , Ellie Daw , Onur Savas , Amin Hassanzadeh , Ian McCulloh

End-to-end encryption (E2EE) has become the gold standard for securing communications, bringing strong confidentiality and privacy guarantees to billions of users worldwide. However, the current push towards widespread integration of…

Cryptography and Security · Computer Science 2025-03-25 Mallory Knodel , Andrés Fábrega , Daniella Ferrari , Jacob Leiken , Betty Li Hou , Derek Yen , Sam de Alfaro , Kyunghyun Cho , Sunoo Park

Ensuring the privacy of training data is a growing concern since many machine learning models are trained on confidential and potentially sensitive data. Much attention has been devoted to methods for protecting individual privacy during…

Cryptography and Security · Computer Science 2021-05-13 Wanrong Zhang , Olga Ohrimenko , Rachel Cummings

With the rapid adoption of Federated Learning (FL) as the training and tuning protocol for applications utilizing Large Language Models (LLMs), recent research highlights the need for significant modifications to FL to accommodate the…

Cryptography and Security · Computer Science 2024-03-11 Minh N. Vu , Truc Nguyen , Tre' R. Jeter , My T. Thai

The use of machine learning (ML) has become increasingly prevalent in various domains, highlighting the importance of understanding and ensuring its safety. One pressing concern is the vulnerability of ML applications to model stealing…

Machine Learning · Computer Science 2026-04-07 Ganghua Wang , Yuhong Yang , Jie Ding

As AI-driven dataspaces become integral to data sharing and collaborative analytics, ensuring privacy, performance, and policy compliance presents significant challenges. This paper provides a comprehensive review of privacy-preserving and…

Cryptography and Security · Computer Science 2025-07-31 Joydeep Chandra , Satyam Kumar Navneet