English
Related papers

Related papers: Adaptive Social Learning via Mode Policy Optimizat…

200 papers

Effective information seeking in multi-turn medical dialogues is critical for accurate diagnosis, especially when dealing with incomplete information. Aligning Large Language Models (LLMs) for these interactive scenarios is challenging due…

Machine Learning · Computer Science 2026-03-04 Ruike Cao , Shaojie Bai , Fugen Yao , Liang Dong , Jian Xu , Li Xiao

Proximal Policy Optimization (PPO) is central to aligning Large Language Models (LLMs) in reasoning tasks with verifiable rewards. However, standard token-level PPO struggles in this setting due to the instability of temporal credit…

Artificial Intelligence · Computer Science 2026-04-13 Tianyi Wang , Yixia Li , Long Li , Yibiao Chen , Shaohan Huang , Yun Chen , Peng Li , Yang Liu , Guanhua Chen

Supervised fine-tuning (SFT) has emerged as one of the most effective ways to improve the performance of large language models (LLMs) in downstream tasks. However, SFT can have difficulty generalizing when the underlying data distribution…

Computation and Language · Computer Science 2025-12-15 Mrinal Rawat , Arkajyoti Chakraborty , Neha Gupta , Roberto Pieraccini

Inference-time computation is a critical yet challenging paradigm for enhancing the reasoning performance of large language models (LLMs). While existing strategies improve reasoning stability and consistency, they suffer from notable…

Multiagent Systems · Computer Science 2025-10-23 Rui Jerry Huang , Wendy Liu , Anastasia Miin , Lei Ding

Large Language Models (LLMs) have been used to make decisions in complex scenarios, where they need models to think deeply, reason logically, and decide wisely. Many existing studies focus solely on multi-round conversations in social tasks…

Artificial Intelligence · Computer Science 2025-09-26 Yiwen Zhang , Ziang Chen , Fanqi Kong , Yizhe Huang , Xue Feng

In this paper, we introduce a Group Relative Policy Optimization (GRPO)-based method for training Speech-Aware Large Language Models (SALLMs) on open-format speech understanding tasks, such as Spoken Question Answering and Automatic Speech…

Computation and Language · Computer Science 2025-09-23 Avishai Elmakies , Hagai Aronowitz , Nimrod Shabtay , Eli Schwartz , Ron Hoory , Avihu Dekel

Neuro-symbolic NLP methods aim to leverage the complementary strengths of large language models and formal logical solvers. However, current approaches are mostly static in nature, i.e., the integration of a target solver is predetermined…

Computation and Language · Computer Science 2025-10-09 Lei Xu , Pierre Beckmann , Marco Valentino , André Freitas

General agents have given rise to phenomenal applications such as OpenClaw and Claude Code. As these agent systems (a.k.a. Harnesses) strive for bolder goals, they demand increasingly stronger agentic capabilities from foundation Large…

Computation and Language · Computer Science 2026-04-21 Daoyu Wang , Qingchuan Li , Mingyue Cheng , Jie Ouyang , Shuo Yu , Qi Liu , Enhong Chen

Diffusion large language models (dLLMs), which offer a promising alternative to traditional autoregressive LLMs, have recently shown strong results in pretraining. However, due to their lack of tractable sequence-level likelihoods, they…

Machine Learning · Computer Science 2026-02-03 Anthony Zhan

Diffusion large language models (dLLMs) are promising alternatives to autoregressive large language models (AR-LLMs), as they potentially allow higher inference throughput. Reinforcement learning (RL) is a crucial component for dLLMs to…

Machine Learning · Computer Science 2026-02-24 Yuchen Zhu , Wei Guo , Jaemoo Choi , Petr Molodyk , Bo Yuan , Molei Tao , Yongxin Chen

While multimodal large language models excel at tasks that integrate visual perception with symbolic reasoning, their performance is often undermined by a critical vulnerability: perception-induced errors that propagate through the…

Multimedia · Computer Science 2025-09-29 Songjun Tu , Qichao Zhang , Jingbo Sun , Yuqian Fu , Linjing Li , Xiangyuan Lan , Dongmei Jiang , Yaowei Wang , Dongbin Zhao

Reinforcement learning (RL) is effective in enhancing the accuracy of large language models in complex reasoning tasks. Existing RL policy optimization frameworks rely on final-answer correctness as feedback signals and rarely capture the…

Artificial Intelligence · Computer Science 2026-04-13 Jinghan Zhang , Fengran Mo , Tharindu Cyril Weerasooriya , Ruimin Dai , Xiaoyan Han , Yanjie Fu , Dakuo Wang , Kunpeng Liu

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

Linguistic expressions of emotions such as depression, anxiety, and trauma-related states are pervasive in clinical notes, counseling dialogues, and online mental health communities, and accurate recognition of these emotions is essential…

Artificial Intelligence · Computer Science 2026-01-21 Jian Zhang , Zhangqi Wang , Zhiyuan Wang , Weiping Fu , Yu He , Haiping Zhu , Qika Lin , Jun Liu

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

Artificial Intelligence · Computer Science 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

Recent advances in Large Language Model (LLM) agents have demonstrated their promising general capabilities. However, their performance in specialized real-world domains often degrades due to challenges in effectively integrating external…

Computation and Language · Computer Science 2025-10-10 Yuzheng Cai , Siqi Cai , Yuchen Shi , Zihan Xu , Lichao Chen , Yulei Qin , Xiaoyu Tan , Gang Li , Zongyi Li , Haojia Lin , Yong Mao , Ke Li , Xing Sun

Large Language Models (LLMs) demonstrate strong performance but often lack interpretable reasoning. This paper introduces the Multi-Agent Collaboration Framework for Diverse Thinking Modes (DiMo), which enhances both performance and…

Computation and Language · Computer Science 2025-10-21 Zhixuan He , Yue Feng

Large language models have demonstrated strong reasoning capabilities in general knowledge question answering. However, their ability to handle temporal information remains limited. To address this limitation, existing approaches often…

Computation and Language · Computer Science 2026-04-28 Yimin Deng , Yejing Wang , Zhenxi Lin , Zichuan Fu , Guoshuai Zhao , Derong Xu , Yefeng Zheng , Xiangyu Zhao , Xian Wu , Li Zhu , Xueming Qian

Recently, latent reasoning has been introduced into large language models (LLMs) to leverage rich information within a continuous space. However, without stochastic sampling, these methods inevitably collapse to deterministic inference,…

Machine Learning · Computer Science 2026-05-12 Yuyan Zhou , Jiarui Yu , Hande Dong , Zhezheng Hao , Hong Wang , Jianqing Zhang , Qiang Lin

Though reasoning abilities are considered language-agnostic, existing LLMs exhibit inconsistent reasoning abilities across different languages, e.g., reasoning in the dominant language like English is superior to other languages due to the…

Computation and Language · Computer Science 2024-04-16 Shuaijie She , Wei Zou , Shujian Huang , Wenhao Zhu , Xiang Liu , Xiang Geng , Jiajun Chen