English
Related papers

Related papers: Differentially Private Steering for Large Language…

200 papers

Fine-tuning large vision models (LVMs) and large language models (LLMs) under differentially private federated learning (DPFL) is hindered by a fundamental privacy-utility trade-off. Low-Rank Adaptation (LoRA), a promising…

Machine Learning · Computer Science 2026-04-21 Jin Liu , Yinbin Miao , Ning Xi , Junkang Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing mitigation…

Machine Learning · Computer Science 2025-03-17 Ahmed Frikha , Muhammad Reza Ar Razi , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

Today's advanced driver assistance systems (ADAS), like adaptive cruise control or rear collision warning, are finding broader adoption across vehicle classes. Integrating such advanced, multimodal Large Language Models (LLMs) on board a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Malsha Ashani Mahawatta Dona , Beatriz Cabrero-Daniel , Yinan Yu , Christian Berger

Nowadays, large language models (LLMs) have been integrated with conventional recommendation models to improve recommendation performance. However, while most of the existing works have focused on improving the model performance, the…

Computation and Language · Computer Science 2024-06-04 Sichun Luo , Wei Shao , Yuxuan Yao , Jian Xu , Mingyang Liu , Qintong Li , Bowei He , Maolin Wang , Guanzhi Deng , Hanxu Hou , Xinyi Zhang , Linqi Song

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

We are witnessing a bloom of AI-powered software driven by Large Language Models (LLMs). Although the applications of these LLMs are impressive and seemingly countless, their unreliability hinders adoption. In fact, the tendency of LLMs to…

Software Engineering · Computer Science 2025-10-30 Vincenzo Scotti , Jan Keim , Tobias Hey , Andreas Metzger , Anne Koziolek , Raffaela Mirandola

Ensuring user privacy by synthesizing data from large language models (LLMs) tuned under differential privacy (DP) has become popular recently. However, the impact of DP fine-tuned LLMs on the quality of the language and the utility of the…

Computation and Language · Computer Science 2025-09-16 Erion Çano , Ivan Habernal

Fine-tuning Large Language Models (LLMs) on sensitive datasets carries a substantial risk of unintended memorization and leakage of Personally Identifiable Information (PII), which can violate privacy regulations and compromise individual…

Large language models (LLM) excel at a variety of natural language processing tasks, yet they struggle to generate personalized content for individuals, particularly in real-world scenarios like scientific writing. Addressing this…

Computation and Language · Computer Science 2024-07-12 Xiangru Tang , Xingyao Zhang , Yanjun Shao , Jie Wu , Yilun Zhao , Arman Cohan , Ming Gong , Dongmei Zhang , Mark Gerstein

The interactive nature of Large Language Models (LLMs), which closely track user data and context, has prompted users to share personal and private information in unprecedented ways. Even when users opt out of allowing their data to be used…

Cryptography and Security · Computer Science 2025-08-26 GodsGift Uzor , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

Large Language Models (LLMs) have showcased remarkable capabilities across various domains. Accompanying the evolving capabilities and expanding deployment scenarios of LLMs, their deployment challenges escalate due to their sheer scale and…

Cryptography and Security · Computer Science 2025-06-11 Jiawen Zhang , Kejia Chen , Lipeng He , Jian Lou , Dan Li , Zunlei Feng , Mingli Song , Jian Liu , Kui Ren , Xiaohu Yang

Optimizing large language models (LLMs) for downstream use cases often involves the customization of pre-trained LLMs through further fine-tuning. Meta's open release of Llama models and OpenAI's APIs for fine-tuning GPT-3.5 Turbo on custom…

Computation and Language · Computer Science 2023-10-06 Xiangyu Qi , Yi Zeng , Tinghao Xie , Pin-Yu Chen , Ruoxi Jia , Prateek Mittal , Peter Henderson

Stock price prediction is important for value investments in the stock market. In particular, short-term prediction that exploits financial news articles is promising in recent years. In this paper, we propose a novel deep neural network…

Statistical Finance · Quantitative Finance 2019-12-24 Xinyi Li , Yinchuan Li , Hongyang Yang , Liuqing Yang , Xiao-Yang Liu

As Large Language Models (LLMs) proliferate, developing privacy safeguards for these models is crucial. One popular safeguard involves training LLMs in a differentially private manner. However, such solutions are shown to be computationally…

Machine Learning · Computer Science 2024-10-04 James Flemings , Meisam Razaviyayn , Murali Annavaram

To ensure AI safety, instruction-tuned Large Language Models (LLMs) are specifically trained to ensure alignment, which refers to making models behave in accordance with human intentions. While these models have demonstrated commendable…

Cryptography and Security · Computer Science 2024-08-19 Haoran Wang , Kai Shu

Text-based Person Retrieval (TPR) aims to retrieve person images that match the description given a text query. The performance improvement of the TPR model relies on high-quality data for supervised training. However, it is difficult to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Zheng Li , Lijia Si , Caili Guo , Yang Yang , Qiushi Cao

Activation Editing, which involves directly editting the internal representations of large language models (LLMs) to alter their behaviors and achieve desired properties, has emerged as a promising area of research. Existing works primarily…

Computation and Language · Computer Science 2024-12-10 Van-Cuong Pham , Thien Huu Nguyen

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

Computation and Language · Computer Science 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

With the rapid advancement of Large Language Models (LLMs), LLM-based agents exhibit exceptional abilities in understanding and generating natural language, enabling human-like collaboration and information transmission in LLM-based…

Artificial Intelligence · Computer Science 2025-10-07 Hailong Yang , Renhuo Zhao , Guanjin Wang , Zhaohong Deng