English
Related papers

Related papers: RealSafe-R1: Safety-Aligned DeepSeek-R1 without Co…

200 papers

While Large Language Models (LLMs) exhibit remarkable capabilities, they also introduce significant safety and privacy risks. Current mitigation strategies often fail to preserve contextual reasoning capabilities in risky scenarios.…

Computation and Language · Computer Science 2025-09-05 Wenbin Hu , Haoran Li , Huihao Jing , Qi Hu , Ziqian Zeng , Sirui Han , Heli Xu , Tianshu Chu , Peizhao Hu , Yangqiu Song

State-of-the-art reasoning LLMs are powerful problem solvers, but they still occasionally make mistakes. However, adopting AI models in risk-sensitive domains often requires error rates near 0%. To address this gap, we propose collaboration…

Artificial Intelligence · Computer Science 2025-07-22 Michael J. Zellinger , Matt Thomson

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

AI systems empowered by reinforcement learning (RL) algorithms harbor the immense potential to catalyze societal advancement, yet their deployment is often impeded by significant safety concerns. Particularly in safety-critical…

Machine Learning · Computer Science 2023-05-17 Jiaming Ji , Jiayi Zhou , Borong Zhang , Juntao Dai , Xuehai Pan , Ruiyang Sun , Weidong Huang , Yiran Geng , Mickel Liu , Yaodong Yang

Recent advances such as OpenAI-o1 and DeepSeek R1 have demonstrated the potential of Reinforcement Learning (RL) to enhance reasoning abilities in Large Language Models (LLMs). While open-source replication efforts have primarily focused on…

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo

This paper introduces Light-R1, an open-source suite for training long reasoning models using reproducible and cost-effective methodology. Given the proprietary nature of data used in the DeepSeek-R1 series, we develop an alternative…

Computation and Language · Computer Science 2025-05-29 Liang Wen , Yunke Cai , Fenrui Xiao , Xin He , Qi An , Zhenyu Duan , Yimin Du , Junchen Liu , Lifu Tang , Xiaowei Lv , Haosheng Zou , Yongchao Deng , Shousheng Jia , Xiangzheng Zhang

The clinical adoption of artificial intelligence (AI) in medical diagnostics is critically hampered by its black-box nature, which prevents clinicians from verifying the rationale behind automated decisions. To overcome this fundamental…

Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear. We conduct an empirical study to systematically evaluate…

Software Engineering · Computer Science 2025-12-30 Mootez Saad , Boqi Chen , José Antonio Hernández López , Dániel Varró , Tushar Sharma

Large language models increasingly rely on explicit chain-of-thought reasoning to solve complex tasks, yet the safety of the reasoning process itself remains largely unaddressed. Existing work focuses predominantly on content safety (i.e.,…

Artificial Intelligence · Computer Science 2026-05-07 Xunguang Wang , Yuguang Zhou , Qingyue Wang , Zongjie Li , Ruixuan Huang , Zhenlan Ji , Pingchuan Ma , Shuai Wang

In this report, we present the third technical report on the development of slow-thinking models as part of the STILL project. As the technical pathway becomes clearer, scaling RL training has become a central technique for implementing…

Computation and Language · Computer Science 2025-03-07 Zhipeng Chen , Yingqian Min , Beichen Zhang , Jie Chen , Jinhao Jiang , Daixuan Cheng , Wayne Xin Zhao , Zheng Liu , Xu Miao , Yang Lu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

When users submit queries to Large Language Models (LLMs), their prompts can often contain sensitive data, forcing a difficult choice: Send the query to a powerful proprietary LLM providers to achieving state-of-the-art performance and risk…

Cryptography and Security · Computer Science 2026-04-21 Zheng Hui , Yijiang River Dong , Sanhanat Sivapiromrat , Ehsan Shareghi , Nigel Collier

Reinforcement learning (RL) based post-training for explicit chain-of-thought (e.g., GRPO) improves the reasoning ability of multimodal large-scale reasoning models (MLRMs). But recent evidence shows that it can simultaneously degrade…

Computation and Language · Computer Science 2026-02-12 Soumya Suvra Ghosal , Souradip Chakraborty , Vaibhav Singh , Furong Huang , Dinesh Manocha , Amrit Singh Bedi

The reasoning capabilities of large language models (LLMs) have advanced rapidly, particularly following the release of DeepSeek R1, which has inspired a surge of research into data quality and reinforcement learning (RL) algorithms.…

Machine Learning · Computer Science 2025-11-04 Jian Yao , Ran Cheng , Xingyu Wu , Jibin Wu , Kay Chen Tan

AI-generated content has evolved from monolithic models to modular workflows, particularly on platforms like ComfyUI, enabling customization in creative pipelines. However, crafting effective workflows requires great expertise to…

Computation and Language · Computer Science 2025-06-12 Zhenran Xu , Yiyu Wang , Xue Yang , Longyue Wang , Weihua Luo , Kaifu Zhang , Baotian Hu , Min Zhang

In recent years, training methods centered on Reinforcement Learning (RL) have markedly enhanced the reasoning and alignment performance of Large Language Models (LLMs), particularly in understanding human intents, following user…

Computation and Language · Computer Science 2025-09-23 Keliang Liu , Dingkang Yang , Ziyun Qian , Weijie Yin , Yuchi Wang , Hongsheng Li , Jun Liu , Peng Zhai , Yang Liu , Lihua Zhang

Large Language Models (LLMs) fine-tuned via Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with Verifiable Rewards (RLVR) significantly improve the alignment of human-AI values, further raising the upper bound…

Artificial Intelligence · Computer Science 2025-10-10 Jian Hu , Xibin Wu , Wei Shen , Jason Klein Liu , Zilin Zhu , Weixun Wang , Songlin Jiang , Haoran Wang , Hao Chen , Bin Chen , Weikai Fang , Xianyu , Yu Cao , Haotian Xu , Yiming Liu

Recent large language models (LLMs) have demonstrated strong reasoning capabilities that benefits from online reinforcement learning (RL). These capabilities have primarily been demonstrated within the left-to-right autoregressive (AR)…

Computation and Language · Computer Science 2025-06-04 Siyan Zhao , Devaansh Gupta , Qinqing Zheng , Aditya Grover

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou
‹ Prev 1 8 9 10 Next ›