English
Related papers

Related papers: SEAL: Self-Evolving Agentic Learning for Conversat…

200 papers

Reinforcement learning (RL) has been pivotal in enhancing the reasoning capabilities of large language models (LLMs), but it often suffers from limited exploration and entropy collapse, where models exploit a narrow set of solutions,…

Machine Learning · Computer Science 2025-10-20 Shijia Kang , Muhan Zhang

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

Document Visual Question Answering (VQA) requires models to not only extract accurate textual answers but also precisely localize them within document images, a capability critical for interpretability in high-stakes applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Ahmad Mohammadshirazi , Pinaki Prasad Guha Neogi , Dheeraj Kulshrestha , Rajiv Ramnath

Widely used language-model benchmarks are increasingly saturated, with frontier systems often receiving near-tied scores that standard metrics cannot resolve. Rather than constructing harder alternatives, we ask whether existing tasks can…

Computation and Language · Computer Science 2026-05-29 Jiamin Chen , Yidi Wu , Qiexiang Wang , Qianben Chen , Yuchen Li , Yansen Zhang , Xiaokun Zhang , Wangchunshu Zhou , Chen Ma

Answering complex, long-context questions remains a major challenge for large language models (LLMs) as it requires effective question clarifications and context retrieval. We propose Agentic Long-Context Understanding (AgenticLU), a…

Computation and Language · Computer Science 2025-05-29 Yufan Zhuang , Xiaodong Yu , Jialian Wu , Ximeng Sun , Ze Wang , Jiang Liu , Yusheng Su , Jingbo Shang , Zicheng Liu , Emad Barsoum

Temporal Knowledge Graph Question Answering (TKGQA) is challenging because it requires multi-hop reasoning under complex temporal constraints. Recent LLM-based approaches have improved semantic modeling for this task, but many still rely on…

Computation and Language · Computer Science 2026-03-26 Xufei Lv , Jiahui Yang , Haoyuan Sun , Xialin Su , Zhiliang Tian , Yifu Gao , Linbo Qiao , Houde Liu

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

While many advanced LLMs are designed to handle long sequence data, we can still observe notable quality degradation even within the sequence limit. In this work, we introduce a novel approach called Scaling to Emphasize Attention for…

Computation and Language · Computer Science 2025-06-24 Changhun Lee , Minsang Seok , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

Table understanding requires structured, multi-step reasoning. Large Language Models (LLMs) struggle with it due to the structural complexity of tabular data. Recently, multi-agent frameworks for SQL generation have shown promise in…

Computation and Language · Computer Science 2025-12-02 Songyuan Sui , Hongyi Liu , Serena Liu , Li Li , Soo-Hyun Choi , Rui Chen , Xia Hu

We introduce SealQA, a new challenge benchmark for evaluating SEarch-Augmented Language models on fact-seeking questions where web search yields conflicting, noisy, or unhelpful results. SealQA comes in three flavors: (1) Seal-0 (main) and…

Computation and Language · Computer Science 2026-04-10 Thinh Pham , Nguyen Nguyen , Pratibha Zunjare , Weiyuan Chen , Yu-Min Tseng , Tu Vu

Large Language Models (LLMs), despite their success in question answering, exhibit limitations in complex multi-hop question answering (MQA) tasks that necessitate non-linear, structured reasoning. This limitation stems from their inability…

Computation and Language · Computer Science 2025-09-25 Haonan Bian , Yutao Qi , Rui Yang , Yuanxi Che , Jiaqian Wang , Heming Xia , Ranran Zhen

Large language models (LLMs) have been widely integrated into information retrieval to advance traditional techniques. However, effectively enabling LLMs to seek accurate knowledge in complex tasks remains a challenge due to the complexity…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Lingyong Yan , Dawei Yin , Suzan Verberne , Maarten de Rijke , Zhaochun Ren

Large Language Model (LLM)-based agents exhibit systemic failures in compositional generalization, limiting their robustness in interactive environments. This work introduces AGEL-Comp, a neuro-symbolic AI agent architecture designed to…

Artificial Intelligence · Computer Science 2026-04-30 Mahnoor Shahid , Hannes Rothe

The rapid advancement of chat-based language models has led to remarkable progress in complex task-solving. However, their success heavily relies on human input to guide the conversation, which can be challenging and time-consuming. This…

Artificial Intelligence · Computer Science 2023-11-03 Guohao Li , Hasan Abed Al Kader Hammoud , Hani Itani , Dmitrii Khizbullin , Bernard Ghanem

With the recent advancements in reasoning capabilities, tool calling using MCP servers and Audio Language Models (ALMs), development and integration of multi-modal agents (with voice and text support) has come to the industry forefront.…

Sound · Computer Science 2026-03-03 Anupam Purwar , Aditya Choudhary

Large language models have been shown to suffer from reasoning inconsistency issues. That is, they fail more in situations unfamiliar to the training data, even though exact or very similar reasoning paths exist in more common cases that…

Computation and Language · Computer Science 2025-02-04 Ben Zhou , Sarthak Jain , Yi Zhang , Qiang Ning , Shuai Wang , Yassine Benajiba , Dan Roth

The evolution of Large Language Models (LLMs) from passive text generators to autonomous, goal-driven systems represents a fundamental shift in artificial intelligence. This chapter examines the emergence of agentic AI systems that…

Artificial Intelligence · Computer Science 2026-01-07 Nadia Sibai , Yara Ahmed , Serry Sibaee , Sawsan AlHalawani , Adel Ammar , Wadii Boulila

Progress in long-context reasoning for large language models (LLMs) has lagged behind other recent advances. This gap arises not only from the intrinsic difficulty of processing long texts, but also from the scarcity of reliable human…

Computation and Language · Computer Science 2026-03-16 Ziyi Yang , Weizhou Shen , Chenliang Li , Ruijun Chen , Fanqi Wan , Ming Yan , Xiaojun Quan , Fei Huang

Making the content generated by Large Language Model (LLM), accurate, credible and traceable is crucial, especially in complex knowledge-intensive tasks that require multi-step reasoning and each step needs knowledge to solve.…

Computation and Language · Computer Science 2024-02-27 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng , Tat-Seng Chua