English
Related papers

Related papers: Entropy-Guided Attention for Private LLMs

200 papers

LayerNorm is a critical component in modern large language models (LLMs) for stabilizing training and ensuring smooth optimization. However, it introduces significant challenges in mechanistic interpretability, outlier feature suppression,…

Machine Learning · Computer Science 2024-11-19 Nandan Kumar Jha , Brandon Reagen

Large Language Models are typically trained on datasets collected from the web, which may inadvertently contain harmful or sensitive personal information. To address growing privacy concerns, unlearning methods have been proposed to remove…

Machine Learning · Computer Science 2025-10-23 Xiaoyu Wu , Yifei Pang , Terrance Liu , Zhiwei Steven Wu

Privacy is an individual choice to determine which personal details can be collected, used and shared. Individual consent and transparency are the core tenets for earning customers trust and this motivates the organizations to adopt privacy…

Cryptography and Security · Computer Science 2021-09-14 Abhinav Palia , Rajat Tandon , Carl Mathis

With LLMs increasingly deployed in corporate data management, it is crucial to ensure that these models do not leak sensitive information. In the context of corporate data management, the concept of sensitivity awareness has been…

Cryptography and Security · Computer Science 2026-01-30 Dren Fazlija , Iyiola E. Olatunji , Daniel Kudenko , Sandipan Sikdar

The high cost of ownership of AI compute infrastructure and challenges of robust serving of large language models (LLMs) has led to a surge in managed Model-as-a-service deployments. Even when enterprises choose on-premises deployments, the…

Machine Learning · Computer Science 2025-06-12 Jay Roberts , Kyle Mylonakis , Sidhartha Roy , Kaan Kale

Large language models (LLMs) serve as giant information stores, often including personal or copyrighted data, and retraining them from scratch is not a viable option. This has led to the development of various fast, approximate unlearning…

Computation and Language · Computer Science 2024-10-18 Minseok Choi , ChaeHun Park , Dohyun Lee , Jaegul Choo

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

Large Language Models (LLMs) have demonstrated impressive capabilities on a broad array of NLP tasks, but their tendency to produce hallucinations$\unicode{x2013}$plausible-sounding but factually incorrect content$\unicode{x2013}$poses…

Computation and Language · Computer Science 2025-06-17 Aneesh Vathul , Daniel Lee , Sheryl Chen , Arthi Tasmia

Since the advent of ChatGPT, Large Language Models (LLMs) have excelled in various tasks but remain as black-box systems. Understanding the reasoning bottlenecks of LLMs has become a critical challenge, as these limitations are deeply tied…

Computation and Language · Computer Science 2024-12-24 Zifan Zheng , Yezhaohui Wang , Yuxin Huang , Shichao Song , Mingchuan Yang , Bo Tang , Feiyu Xiong , Zhiyu Li

Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual…

Machine Learning · Computer Science 2025-07-08 Sathesh P. Sivashanmugam

Large language models are increasingly deployed in settings where reliability matters, yet output-level uncertainty signals such as token probabilities, entropy, and self-consistency can become brittle under calibration--deployment…

Computation and Language · Computer Science 2026-04-20 Yanli Wang , Peng Kuang , Xiaoyu Han , Kaidi Xu , Haohan Wang

In recent years, local differential privacy (LDP) has emerged as a technique of choice for privacy-preserving data collection in several scenarios when the aggregator is not trustworthy. LDP provides client-side privacy by adding noise at…

Machine Learning · Statistics 2021-10-28 Tejas Kulkarni , Joonas Jälkö , Samuel Kaski , Antti Honkela

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing mitigation…

Machine Learning · Computer Science 2025-03-17 Ahmed Frikha , Muhammad Reza Ar Razi , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

While explainable artificial intelligence (XAI) for large language models (LLMs) remains an evolving field with many unresolved questions, increasing regulatory pressures have spurred interest in its role in ensuring transparency,…

Machine Learning · Computer Science 2026-01-29 Viet Hung Dinh , Ming Ding , Youyang Qu , Kanchana Thilakarathna

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Artificial Intelligence · Computer Science 2025-04-08 Zahra Atf , Seyed Amir Ahmad Safavi-Naini , Peter R. Lewis , Aref Mahjoubfar , Nariman Naderi , Thomas R. Savage , Ali Soroush

The self-attention mechanism prevails in modern machine learning. It has an interesting functionality of adaptively selecting tokens from an input sequence by modulating the degree of attention localization, which many researchers speculate…

Machine Learning · Statistics 2024-02-06 Han Bao , Ryuichiro Hataya , Ryo Karakida

The advances in natural language processing (NLP) pose both opportunities and challenges. While recent progress enables the development of high-performing models for a variety of tasks, it also poses the risk of models learning harmful…

Computation and Language · Computer Science 2024-08-06 Abdelrahman Zayed , Goncalo Mordido , Samira Shabanian , Sarath Chandar

Large language models (LLMs) are increasingly used to help security analysts manage the surge of cyber threats, automating tasks from vulnerability assessment to incident response. Yet in operational CTI workflows, reliability gaps remain…

Cryptography and Security · Computer Science 2026-05-29 Yuqiao Meng , Luoxi Tang , Feiyang Yu , Jinyuan Jia , Guanhua Yan , Ping Yang , Zhaohan Xi

Masking-based post-hoc explanation methods, such as KernelSHAP and LIME, estimate local feature importance by querying a black-box model under randomized perturbations. This paper formulates this procedure as communication over a query…

Artificial Intelligence · Computer Science 2026-04-21 Erciyes Karakaya , Ozgur Ercetin

Despite remarkable advances, large language models often fail at compositional reasoning tasks, a phenomenon exemplified by the ``curse of two-hop reasoning''. This paper introduces the Identity Bridge, a simple yet powerful mechanism that…

Machine Learning · Computer Science 2025-09-30 Pengxiao Lin , Zheng-An Chen , Zhi-Qin John Xu