English
Related papers

Related papers: Leaky Thoughts: Large Reasoning Models Are Not Pri…

200 papers

Leaking information about the execution behavior of critical real-time tasks may lead to serious consequences, including violations of temporal constraints and even severe failures. We study information leakage for a special class of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-05 Mohammad Fakhruddin Babar , Zain A. H. Hammadeh , Mohammad Hamad , Monowar Hasan

We study the role of information complexity in privacy leakage about an attribute of an adversary's interest, which is not known a priori to the system designer. Considering the supervised representation learning setup and using neural…

Machine Learning · Computer Science 2021-06-09 Amir Ahooye Atashin , Behrooz Razeghi , Deniz Gündüz , Slava Voloshynovskiy

Information leakage can have dramatic consequences on systems security. Among harmful information leaks, the timing information leakage is the ability for an attacker to deduce internal information depending on the system execution time. We…

Cryptography and Security · Computer Science 2020-10-20 Étienne André , Jun Sun

Large language models (LLMs) are sophisticated artificial intelligence systems that enable machines to generate human-like text with remarkable precision. While LLMs offer significant technological progress, their development using vast…

Cryptography and Security · Computer Science 2025-06-23 Yashothara Shanmugarasa , Ming Ding , M. A. P Chamikara , Thierry Rakotoarivelo

Recent generations of language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their…

Artificial Intelligence · Computer Science 2025-11-21 Parshin Shojaee , Iman Mirzadeh , Keivan Alizadeh , Maxwell Horton , Samy Bengio , Mehrdad Farajtabar

Recent advances in natural language processing highlight two key factors for improving reasoning in large language models (LLMs): (i) allocating more test-time compute tends to help on harder problems but often introduces redundancy in the…

Computation and Language · Computer Science 2025-11-04 Riccardo Alberghi , Elizaveta Demyanenko , Luca Biggio , Luca Saglietti

As language models (LMs) are widely utilized in personalized communication scenarios (e.g., sending emails, writing social media posts) and endowed with a certain level of agency, ensuring they act in accordance with the contextual privacy…

Computation and Language · Computer Science 2025-03-17 Yijia Shao , Tianshi Li , Weiyan Shi , Yanchen Liu , Diyi Yang

Logic locking secures hardware designs in untrusted foundries by incorporating key-driven gates to obscure the original blueprint. While this method safeguards the integrated circuit from malicious alterations during fabrication, its…

Cryptography and Security · Computer Science 2025-02-13 Lennart M. Reimann , Evgenii Rezunov , Dominik Germek , Luca Collini , Christian Pilato , Ramesh Karri , Rainer Leupers

Large Reasoning Models (LRMs) are designed to solve complex tasks by generating explicit reasoning traces before producing final answers. However, we reveal a critical vulnerability in LRMs -- termed Unthinking Vulnerability -- wherein the…

Computation and Language · Computer Science 2025-05-20 Zihao Zhu , Hongbao Zhang , Ruotong Wang , Ke Xu , Siwei Lyu , Baoyuan Wu

Large language models (LLMs) struggle with complex, long-horizon reasoning due to instability caused by their frozen policy assumption. Current test-time scaling methods treat execution feedback merely as an external signal for filtering or…

Artificial Intelligence · Computer Science 2026-01-29 Zhengbo Jiao , Hongyu Xian , Qinglong Wang , Yunpu Ma , Zhebo Wang , Zifan Zhang , Dezhang Kong , Meng Han

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

Neural networks trained on real-world data often exhibit biases while simultaneously being vulnerable to privacy attacks aimed at extracting sensitive information. Despite extensive research on each problem individually, their intersection…

Machine Learning · Computer Science 2025-10-07 Chenxiang Zhang , Jun Pang , Sjouke Mauw

This research explores how human-defined goals influence the behavior of Large Language Models (LLMs) through purpose-conditioned cognition. Using financial prediction tasks, we show that revealing the downstream use (e.g., predicting stock…

General Finance · Quantitative Finance 2026-05-07 Sean Cao , Wei Jiang , Hui Xu

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

Fine-tuning large language models on private data for downstream applications poses significant privacy risks in potentially exposing sensitive information. Several popular community platforms now offer convenient distribution of a large…

Machine Learning · Computer Science 2024-09-02 Md Rafi Ur Rashid , Jing Liu , Toshiaki Koike-Akino , Shagufta Mehnaz , Ye Wang

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Recent work has shown that distilling reasoning traces from a larger teacher model via supervised finetuning outperforms reinforcement learning with the smaller student model alone (Guo et al. 2025). However, there has not been a systematic…

Computation and Language · Computer Science 2025-07-03 Yang Li , Youssef Emad , Karthik Padthe , Jack Lanchantin , Weizhe Yuan , Thao Nguyen , Jason Weston , Shang-Wen Li , Dong Wang , Ilia Kulikov , Xian Li

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

A large body of work shows that machine learning (ML) models can leak sensitive or confidential information about their training data. Recently, leakage due to distribution inference (or property inference) attacks is gaining attention. In…

Cryptography and Security · Computer Science 2022-09-20 Valentin Hartmann , Léo Meynent , Maxime Peyrard , Dimitrios Dimitriadis , Shruti Tople , Robert West

Chain-of-Thought (CoT) reasoning enhances large language models (LLMs) by decomposing complex problems into step-by-step solutions, improving performance on reasoning tasks. However, current CoT disclosure policies vary widely across…

Computers and Society · Computer Science 2025-03-20 Yihang Chen , Haikang Deng , Kaiqiao Han , Qingyue Zhao