English
Related papers

Related papers: LC-ERD: Mining Latent Logic for Self-Evolving Reas…

200 papers

Equation discovery is aimed at directly extracting physical laws from data and has emerged as a pivotal research domain. Previous methods based on symbolic mathematics have achieved substantial advancements, but often require the design of…

Machine Learning · Computer Science 2024-07-23 Mengge Du , Yuntian Chen , Zhongzheng Wang , Longfeng Nie , Dongxiao Zhang

Reinforcement Learning with Verifiable Rewards~(RLVR) has emerged as a powerful learn-to-reason paradigm for large reasoning models to tackle complex tasks. However, the current RLVR paradigm is still not efficient enough, as it works in a…

Computation and Language · Computer Science 2026-03-10 Junjie Zhang , Guozheng Ma , Shunyu Liu , Haoyu Wang , Jiaxing Huang , Ting-En Lin , Fei Huang , Yongbin Li , Dacheng Tao

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in vision-language answering tasks. Despite their strengths, these models often encounter challenges in achieving complex reasoning tasks such as…

Artificial Intelligence · Computer Science 2025-11-11 Jinhao Chen , Zhen Yang , Jianxin Shi , Tianyu Wo , Jie Tang

Recent reinforcement learning approaches, such as outcome-supervised GRPO, have advanced Chain-of-Thought reasoning in large language models (LLMs), yet their adaptation to multimodal LLMs (MLLMs) is unexplored. To address the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yi Chen , Yuying Ge , Rui Wang , Yixiao Ge , Junhao Cheng , Ying Shan , Xihui Liu

Recommender systems have become increasingly ubiquitous in daily life. While traditional recommendation approaches primarily rely on ID-based representations or item-side content features, they often fall short in capturing the underlying…

Information Retrieval · Computer Science 2025-08-12 Yunze Luo , Yinjie Jiang , Gaode Chen , Xinghua Zhang , Jun Zhang , Jian Liang , Kaigui Bian

Logical reasoning is a pivotal component in the field of artificial intelligence. Proof planning, particularly in contexts requiring the validation of explanation accuracy, continues to present challenges. The recent advancement of large…

Computation and Language · Computer Science 2025-10-31 Ying Su , Mingwen Liu , Zhijiang Guo

While Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities across diverse domains, their application to specialized anomaly detection (AD) remains constrained by domain adaptation challenges. Existing Group Relative…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Jingyi Liao , Yongyi Su , Rong-Cheng Tu , Zhao Jin , Wenhao Sun , Yiting Li , Dacheng Tao , Xun Xu , Xulei Yang

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning tasks, yet their reliance on static prompt structures and limited adaptability to complex scenarios remains a significant challenge. In this paper, we…

Artificial Intelligence · Computer Science 2025-07-09 Chengkun Cai , Xu Zhao , Haoliang Liu , Zhongyu Jiang , Tianfang Zhang , Zongkai Wu , Jenq-Neng Hwang , Lei Li

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Large Language Models have demonstrated outstanding performance across various downstream tasks and have been widely applied in multiple scenarios. Human-annotated preference data is used for training to further improve LLMs' performance,…

Computation and Language · Computer Science 2025-03-06 Shimao Zhang , Xiao Liu , Xin Zhang , Junxiao Liu , Zheheng Luo , Shujian Huang , Yeyun Gong

The emergence of Large Reasoning Models (LRMs) introduces a new paradigm of explicit reasoning, enabling remarkable advances yet posing unique risks such as reasoning manipulation and information leakage. To mitigate these risks, current…

Artificial Intelligence · Computer Science 2026-02-03 Jingnan Zheng , Jingjun Xu , Yanzhen Luo , Chenhang Cui , Gelei Deng , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

Aligning Large Language Models (LLMs) is crucial for enhancing their safety and utility. However, existing methods, primarily based on preference datasets, face challenges such as noisy labels, high annotation costs, and privacy concerns.…

Machine Learning · Computer Science 2025-01-28 Hao Sun , Mihaela van der Schaar

Self-training approach for large language models (LLMs) improves reasoning abilities by training the models on their self-generated rationales. Previous approaches have labeled rationales that produce correct answers for a given question as…

Machine Learning · Computer Science 2025-02-07 Jaehyeok Lee , Keisuke Sakaguchi , JinYeong Bak

Interleaved reasoning paradigms enhance Multimodal Large Language Models (MLLMs) with visual feedback but are hindered by the prohibitive computational cost of re-encoding pixel-dense images. A promising alternative, latent visual…

Computation and Language · Computer Science 2026-01-22 Shuai Dong , Siyuan Wang , Xingyu Liu , Chenglin Li , Haowen Hou , Zhongyu Wei

Large reasoning models (LRMs) have recently shown promise in solving complex math problems when optimized with Reinforcement Learning (RL). But conventional approaches rely on outcome-only rewards that provide sparse feedback, resulting in…

Machine Learning · Computer Science 2025-08-01 Tao He , Rongchuan Mu , Lizi Liao , Yixin Cao , Ming Liu , Bing Qin

Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Honghua Chen , Zitong Xu , Huiyu Duan , Xinyun Zhang , Xiongkuo Min , Guangtao Zhai

Chain-of-thought (CoT) reasoning is critical for improving the interpretability and reliability of Large Vision-Language Models (LVLMs). However, existing training algorithms such as SFT, PPO, and GRPO may not generalize well across unseen…

Artificial Intelligence · Computer Science 2025-10-31 Guohao Sun , Hang Hua , Jian Wang , Jiebo Luo , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

Large language models face challenges in long-context question answering, where key evidence of a query may be dispersed across millions of tokens. Existing works equip large language models with a memory buffer that is dynamically updated…

Computation and Language · Computer Science 2026-03-03 Yaorui Shi , Yuxin Chen , Siyuan Wang , Sihang Li , Hengxing Cai , Qi Gu , Xiang Wang , An Zhang

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Large reasoning models (LRMs) excel on complex problems but face a critical barrier to efficiency: reinforcement learning (RL) training requires long rollouts for outcome-based rewards, where autoregressive decoding dominates time and…

Machine Learning · Computer Science 2026-02-20 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Hao Sun , Chenliang Xu , Jianfeng Gao