English
Related papers

Related papers: AERO: Entropy-Guided Framework for Private LLM Inf…

200 papers

As large language models (LLMs) continue to grow in size, fewer users are able to host and run models locally. This has led to increased use of third-party hosting services. However, in this setting, there is a lack of guarantees on the…

Cryptography and Security · Computer Science 2026-02-20 Arka Pal , Louai Zahran , William Gvozdjak , Akilesh Potti , Micah Goldblum

For protecting users' private data, local differential privacy (LDP) has been leveraged to provide the privacy-preserving range query, thus supporting further statistical analysis. However, existing LDP-based range query approaches are…

Cryptography and Security · Computer Science 2021-10-15 Linkang Du , Zhikun Zhang , Shaojie Bai , Changchang Liu , Shouling Ji , Peng Cheng , Jiming Chen

Large Reasoning Models (LRMs) often suffer from overthinking, generating unnecessarily long reasoning chains even for simple tasks. This leads to substantial computational overhead with limited performance gain, primarily due to redundant…

Artificial Intelligence · Computer Science 2026-01-13 Ruichu Cai , Haopeng Du , Qingwen Lin , Yutong Chen , Zijian Li , Boyan Xu

Recent papers have shown that large pre-trained language models (LLMs) such as BERT, GPT-2 can be fine-tuned on private data to achieve performance comparable to non-private models for many downstream Natural Language Processing (NLP) tasks…

Machine Learning · Computer Science 2022-06-07 Fatemehsadat Mireshghallah , Arturs Backurs , Huseyin A Inan , Lukas Wutschitz , Janardhan Kulkarni

This work addresses the computational challenge of enforcing privacy for agentic Large Language Models (LLMs), where privacy is governed by the contextual integrity framework. Indeed, existing defenses rely on LLM-mediated checking stages…

Cryptography and Security · Computer Science 2026-01-22 Saswat Das , Ferdinando Fioretto

Training LLM agents in multi-turn environments with sparse rewards, where completing a single task requires 30+ turns of interaction within an episode, presents a fundamental challenge for reinforcement learning. We identify a critical…

Machine Learning · Computer Science 2026-02-11 Wujiang Xu , Wentian Zhao , Zhenting Wang , Yu-Jhe Li , Can Jin , Mingyu Jin , Kai Mei , Kun Wan , Dimitris N. Metaxas

Large Language Model (LLM) agents are increasingly deployed in practice across a wide range of autonomous applications. Yet current safety mechanisms for LLM agents focus almost exclusively on preventing failures in advance, providing…

Artificial Intelligence · Computer Science 2026-02-13 Zibo Xiao , Jun Sun , Junjie Chen

Deploying large language models (LLMs) in real-time systems remains challenging due to their substantial computational demands and privacy concerns. We propose Floe, a hybrid federated learning framework designed for latency-sensitive,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Chunlin Tian , Kahou Tam , Yebo Wu , Shuaihang Zhong , Li Li , Nicholas D. Lane , Chengzhong Xu

A significant hurdle for current LLMs is the execution of complex, multi-stage tasks. Group Relative Policy Optimization (GRPO) has been emerging as a leading choice, but its reliance on sparse outcome rewards severely limits credit…

Artificial Intelligence · Computer Science 2026-05-19 Wonjoong Kim , Yeonjun In , Sangwu Park , Dongha Lee , Chanyoung Park

Reinforcement learning (RL) has enabled complex reasoning abilities in large language models (LLMs). However, most RL algorithms suffer from performance saturation, preventing continued gains as RL training scales. This problem can be…

Machine Learning · Computer Science 2026-05-12 Bolian Li , Yifan Wang , Yi Ding , Anamika Lochab , Ananth Grama , Ruqi Zhang

Can large language model agents discover hidden safety objectives through experience alone? We introduce EPO-Safe (Experiential Prompt Optimization for Safe Agents), a framework where an LLM iteratively generates action plans, receives…

Artificial Intelligence · Computer Science 2026-04-28 Víctor Gallego

Recent advances in multimodal large reasoning models (MLRMs) have substantially improved their ability to solve complex textual and visual tasks. However, these models tend to overthink on simple problems, producing unnecessarily lengthy…

Computation and Language · Computer Science 2025-10-10 Shuang Chen , Yue Guo , Yimeng Ye , Shijue Huang , Wenbo Hu , Haoxi Li , Manyuan Zhang , Jiayu Chen , Song Guo , Nanyun Peng

Edge intelligence delivers low-latency inference, yet most edge analytics remain hard-coded and must be redeployed as conditions change. When data patterns shift or new questions arise, engineers often need to write new scripts and push…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Chinmaya Kumar Dehury , Siddharth Singh Kushwaha , Qiyang Zhang , Alaa Saleh , Praveen Kumar Donta

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise,…

Computation and Language · Computer Science 2026-03-19 Federico Albanese , Pablo Ronco , Nicolás D'Ippolito

The privacy vulnerabilities of the federated learning (FL) paradigm, primarily caused by gradient leakage, have prompted the development of various defensive measures. Nonetheless, these solutions have predominantly been crafted for and…

Cryptography and Security · Computer Science 2025-02-10 Abhinav Kumar , George Torres , Noah Guzinski , Gaurav Panwar , Reza Tourani , Satyajayant Misra , Marcin Spoczynski , Mona Vij , Nageen Himayat

Federated Learning (FL) enables decentralized model training without sharing raw data, but model weight distortion remains a major challenge in resource constrained IoT networks. In multi tier Federated IoT (Fed-IoT) systems, unstable…

Machine Learning · Computer Science 2025-12-17 Chethana Prasad Kabgere , Shylaja S S

The Efficient Adaptive Transformer (EAT) framework unifies three adaptive efficiency techniques - progressive token pruning, sparse attention, and dynamic early exiting - into a single, reproducible architecture for input-adaptive…

Computation and Language · Computer Science 2025-10-16 Jan Miller

ALAMO is a computational methodology for leaning algebraic functions from data. Given a data set, the approach begins by building a low-complexity, linear model composed of explicit non-linear transformations of the independent variables.…

Machine Learning · Computer Science 2017-06-01 Zachary T. Wilson , Nikolaos V. Sahinidis

Large language models (LLMs) enhanced with retrieval-augmented generation (RAG) have introduced a new paradigm for web search. However, the limited context awareness of LLMs degrades their performance on RAG tasks. Existing methods to…

Computation and Language · Computer Science 2024-10-08 Tao Tan , Yining Qian , Ang Lv , Hongzhan Lin , Songhao Wu , Yongbo Wang , Feng Wang , Jingtong Wu , Xin Lu , Rui Yan

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling