English
Related papers

Related papers: Output Length Effect on DeepSeek-R1's Safety in Fo…

200 papers

When encountering increasingly frequent performance improvements or cost reductions from a new large language model (LLM), developers of applications leveraging LLMs must decide whether to take advantage of these improvements or stay with…

Computation and Language · Computer Science 2025-02-20 Rubing Li , João Sedoc , Arun Sundararajan

Human reasoning involves different strategies, each suited to specific problems. Prior work shows that large language model (LLMs) tend to favor a single reasoning strategy, potentially limiting their effectiveness in diverse reasoning…

Computation and Language · Computer Science 2025-07-17 Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Thierry Charnois

Existing approaches typically rely on fixed length penalties, but such penalties are hard to tune and fail to adapt to the evolving reasoning abilities of LLMs, leading to suboptimal trade-offs between accuracy and conciseness. To address…

Artificial Intelligence · Computer Science 2025-12-29 Yanhao Li , Lu Ma , Jiaran Zhang , Lexiang Tang , Wentao Zhang , Guibo Luo

The advent of Large Language Models (LLMs) has revolutionized various applications by providing advanced natural language processing capabilities. However, this innovation introduces new cybersecurity challenges. This paper explores the…

Cryptography and Security · Computer Science 2024-06-18 Stephen Burabari Tete

Enhancing the reasoning capabilities of large language models (LLMs) typically relies on massive computational resources and extensive datasets, limiting accessibility for resource-constrained settings. Our study investigates the potential…

Machine Learning · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo

Existing efforts to improve logical reasoning ability of language models have predominantly relied on supervised fine-tuning, hindering generalization to new domains and/or tasks. The development of Large Langauge Models (LLMs) has…

Computation and Language · Computer Science 2024-06-18 Fangkai Jiao , Zhiyang Teng , Bosheng Ding , Zhengyuan Liu , Nancy F. Chen , Shafiq Joty

Scaling test-time compute through extended chains of thought has become a dominant paradigm for improving large language model reasoning. However, existing research implicitly assumes that longer thinking always yields better results. This…

Artificial Intelligence · Computer Science 2026-04-14 Shu Zhou , Rui Ling , Junan Chen , Xin Wang , Tao Fan , Hao Wang

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

Computation and Language · Computer Science 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Modern large reasoning models (LRMs) exhibit impressive multi-step problem-solving via chain-of-thought (CoT) reasoning. However, this iterative thinking mechanism introduces a new vulnerability surface. We present the Deadlock Attack, a…

Machine Learning · Computer Science 2025-10-21 Mohan Zhang , Yihua Zhang , Jinghan Jia , Zhangyang Wang , Sijia Liu , Tianlong Chen

Recent studies have shown that making a model spend more time thinking through longer Chain of Thoughts (CoTs) enables it to gain significant improvements in complex reasoning tasks. While current researches continue to explore the benefits…

Computation and Language · Computer Science 2025-10-14 Wenkai Yang , Shuming Ma , Yankai Lin , Furu Wei

Large Language Models (LLMs) have become vital tools in software development tasks such as code generation, completion, and analysis. As their integration into workflows deepens, ensuring robustness against vulnerabilities especially those…

Software Engineering · Computer Science 2025-07-21 Yang Liu , Armstrong Foundjem , Foutse Khomh , Heng Li

In recent years, the development of Large Language Models (LLMs) has made significant breakthroughs in the field of natural language processing and has gradually been applied to the field of humanities and social sciences research. LLMs…

Computers and Society · Computer Science 2025-04-16 Peiran Gu , Fuhao Duan , Wenhao Li , Bochen Xu , Ying Cai , Teng Yao , Chenxun Zhuo , Tianming Liu , Bao Ge

Test-time training (TTT) has recently emerged as a promising method to improve the reasoning abilities of large language models (LLMs), in which the model directly learns from test data without access to labels. However, this reliance on…

Machine Learning · Computer Science 2026-03-17 Vanshaj Khattar , Md Rafi ur Rashid , Moumita Choudhury , Jing Liu , Toshiaki Koike-Akino , Ming Jin , Ye Wang

Test-time scaling via explicit reasoning trajectories significantly boosts large language model (LLM) performance but often triggers overthinking. To explore this, we analyze reasoning through two lenses: Reasoning Length Dynamics, which…

Computation and Language · Computer Science 2026-01-14 Zihao Wei , Liang Pang , Jiahao Liu , Wenjie Shi , Jingcheng Deng , Shicheng Xu , Zenghao Duan , Fei Sun , Huawei Shen , Xueqi Cheng

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

Artificial Intelligence · Computer Science 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang

In recent years, training methods centered on Reinforcement Learning (RL) have markedly enhanced the reasoning and alignment performance of Large Language Models (LLMs), particularly in understanding human intents, following user…

Computation and Language · Computer Science 2025-09-23 Keliang Liu , Dingkang Yang , Ziyun Qian , Weijie Yin , Yuchi Wang , Hongsheng Li , Jun Liu , Peng Zhai , Yang Liu , Lihua Zhang

The recent development of reasoning language models (RLMs) represents a novel evolution in large language models. In particular, the recent release of DeepSeek-R1 has generated widespread social impact and sparked enthusiasm in the research…

Computation and Language · Computer Science 2025-05-16 Chong Zhang , Yue Deng , Xiang Lin , Bin Wang , Dianwen Ng , Hai Ye , Xingxuan Li , Yao Xiao , Zhanfeng Mo , Qi Zhang , Lidong Bing

Large Reasoning Models (LRMs) generate explicit reasoning traces alongside final answers, yet the extent to which these traces influence answer generation remains unclear. In this work, we conduct a three-stage investigation into the…

Artificial Intelligence · Computer Science 2025-09-30 Jue Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to…

Artificial Intelligence · Computer Science 2026-01-27 Xin Gao , Shaohan Yu , Zerui Chen , Yueming Lyu , Weichen Yu , Guanghao Li , Jiyao Liu , Jianxiong Gao , Jian Liang , Ziwei Liu , Chenyang Si

While the widespread deployment of Large Language Models (LLMs) holds great potential for society, their vulnerabilities to adversarial manipulation and exploitation can pose serious safety, security, and ethical risks. As new threats…

Cryptography and Security · Computer Science 2025-09-29 Charankumar Akiri , Harrison Simpson , Kshitiz Aryal , Aarav Khanna , Maanak Gupta