English
Related papers

Related papers: ProRAC: A Neuro-symbolic Method for Reasoning abou…

200 papers

Large language models (LLMs) are increasingly used as autonomous agents, tackling tasks from robotics to web navigation. Their performance depends on the underlying base agent. Existing methods, however, struggle with long-context reasoning…

Artificial Intelligence · Computer Science 2025-04-09 Nikolai Rozanov , Marek Rei

Answering complex natural language questions often necessitates multi-step reasoning and integrating external information. Several systems have combined knowledge retrieval with a large language model (LLM) to answer such questions. These…

Many challenging reasoning tasks require not just rapid, intuitive responses, but a more deliberate, multi-step approach. Recent progress in large language models (LLMs) highlights an important shift from the "System 1" way of quick…

Computation and Language · Computer Science 2025-06-03 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Chaoqun Liu , Lidong Bing , Deli Zhao , Anh Tuan Luu , Yu Rong

Large reasoning models (LRMs) achieve strong reasoning performance by emitting long chains of thought. Yet, these verbose traces slow down inference and often drift into unnecessary detail, known as the overthinking phenomenon. To better…

Computation and Language · Computer Science 2025-06-10 Ming Li , Zhengyuan Yang , Xiyao Wang , Dianqi Li , Kevin Lin , Tianyi Zhou , Lijuan Wang

Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However,…

Computation and Language · Computer Science 2023-11-08 Eric Melz

Automated theorem proving is essential for the formal verification of safety-critical systems. As the corpus of formal proofs grows, a natural paradigm is to learn from existing proofs. However, current learning-based approaches…

Software Engineering · Computer Science 2026-05-12 Jian Fang , Yixun Yao , Yingfei Xiong

Large language models (LLMs) gained immense popularity due to their impressive capabilities in unstructured conversations. Empowering LLMs with advanced prompting strategies such as reasoning and acting (ReAct) (Yao et al., 2022) has shown…

Computation and Language · Computer Science 2025-03-18 Michelle Elizabeth , Morgan Veyret , Miguel Couceiro , Ondrej Dusek , Lina M. Rojas-Barahona

This paper describes our system submitted to SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language Models. We present an efficient modular neuro-symbolic approach, combining a symbolic prover with small…

Computation and Language · Computer Science 2026-05-07 Ivan Kartáč , Kristýna Onderková , Jan Bronec , Zdeněk Kasner , Mateusz Lango , Ondřej Dušek

LLM-driven multi-agent frameworks address complex reasoning tasks through multi-role collaboration. However, existing approaches often suffer from reasoning instability, where individual agent errors are amplified through collaboration,…

Artificial Intelligence · Computer Science 2026-04-20 Haoyu Bian , Chaoning Zhang , Jiaquan Zhang , Xingyao Li , Yuanfang Guo , Wei Dong , Yang Yang

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Large Language Models (LLMs) have achieved strong performance across a wide range of natural language processing tasks in recent years, including machine translation, text generation, and question answering. As their applications extend to…

Computation and Language · Computer Science 2025-12-30 Xin Zhang , Yang Cao , Baoxing Wu , Xinyi Chen , Kai Song , Siying Li

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed

Large Language Models (LLMs) have shown promise as robotic planners but often struggle with long-horizon and complex tasks, especially in specialized environments requiring external knowledge. While hierarchical planning and…

Artificial Intelligence · Computer Science 2025-04-08 Cristina Cornelio , Flavio Petruzzellis , Pietro Lio

Wide applications of LLM-based agents require strong alignment with human social values. However, current works still exhibit deficiencies in self-cognition and dilemma decision, as well as self-emotions. To remedy this, we propose a novel…

Artificial Intelligence · Computer Science 2026-05-15 Jinxian Qu , Qingqing Gu , Teng Chen , Luo Ji

Small Language Models (SLMs) are a cost-effective alternative to Large Language Models (LLMs), but often struggle with complex reasoning due to their limited capacity and a tendency to produce mistakes or inconsistent answers during…

Computation and Language · Computer Science 2025-08-19 Yuanfeng Xu , Zehui Dai , Jian Liang , Jiapeng Guan , Guangrun Wang , Liang Lin , Xiaohui Lv

Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric…

Artificial Intelligence · Computer Science 2026-02-13 Yihang Yao , Zhepeng Cen , Haohong Lin , Shiqi Liu , Zuxin Liu , Jiacheng Zhu , Zhang-Wei Hong , Laixi Shi , Ding Zhao

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities, however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require…

Robotic systems operating in human environments must reason about how object interactions evolve over time, which actions are currently being performed, and what manipulation step is likely to follow. Classical enriched Semantic Event…

Robotics · Computer Science 2026-04-24 Fatemeh Ziaeetabar

We introduce SymbolicAI, a versatile and modular framework employing a logic-based approach to concept learning and flow management in generative processes. SymbolicAI enables the seamless integration of generative models with a diverse…

Large Reasoning Models (LRMs) often suffer from computational inefficiency due to overthinking, where a fixed reasoning budget fails to match the varying complexity of tasks. To address this issue, we propose Adaptive Overclocking, a method…

Machine Learning · Computer Science 2025-09-23 Shuhao Jiang , Songbo Wang , Yang Qiao , Chun Xu , Chaoyang Zheng , Shengyi Zhou , Huanjun Wang , Fangming Li , Cong Zhang , Jiyu Wang