English
Related papers

Related papers: TaskLAMA: Probing the Complex Task Understanding o…

200 papers

Large Language Models (LLMs) are increasingly being used for interactive decision-making tasks requiring planning and adapting to the environment. Recent works employ LLMs-as-agents in broadly two ways: iteratively determining the next…

Artificial Intelligence · Computer Science 2024-04-10 Archiki Prasad , Alexander Koller , Mareike Hartmann , Peter Clark , Ashish Sabharwal , Mohit Bansal , Tushar Khot

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Structured data sources, such as tables, graphs, and databases, are ubiquitous knowledge sources. Despite the demonstrated capabilities of large language models (LLMs) on plain text, their proficiency in interpreting and utilizing…

Computation and Language · Computer Science 2024-10-08 Alex Zhuang , Ge Zhang , Tianyu Zheng , Xinrun Du , Junjie Wang , Weiming Ren , Stephen W. Huang , Jie Fu , Xiang Yue , Wenhu Chen

Language interpretation is a compositional process, in which the meaning of more complex linguistic structures is inferred from the meaning of their parts. Large language models possess remarkable language interpretation capabilities and…

Artificial Intelligence · Computer Science 2025-10-31 David Maria Schmidt , Raoul Schubert , Philipp Cimiano

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this…

Artificial Intelligence · Computer Science 2025-12-01 Lei Zan , Keli Zhang , Ruichu Cai , Lujia Pan

Recently, decomposing complex problems into simple subtasks--a crucial part of human-like natural planning--to solve the given problem has significantly boosted the performance of large language models (LLMs). However, leveraging such…

Computation and Language · Computer Science 2025-07-11 Mihir Parmar , Palash Goyal , Xin Liu , Yiwen Song , Mingyang Ling , Chitta Baral , Hamid Palangi , Tomas Pfister

This work addresses the 3D situated reasoning task which aims to answer questions given egocentric observations in a 3D environment. The task remains challenging as it requires comprehensive 3D perception and complex reasoning skills.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Qingrong He , Kejun Lin , Shizhe Chen , Anwen Hu , Qin Jin

Large language models (LLMs) have demonstrated impressive task-solving capabilities through prompting techniques and system designs, including solving planning tasks (e.g., math proofs, basic travel planning) when sufficient data is…

Artificial Intelligence · Computer Science 2025-04-25 Wenjun Li , Changyu Chen , Pradeep Varakantham

Large Language Models (LLMs) have shown to be capable of various tasks, yet their capability in interpreting and reasoning over tabular data remains an underexplored area. In this context, this study investigates from three core…

Computation and Language · Computer Science 2023-12-29 Tianyang Liu , Fei Wang , Muhao Chen

Transforming a dynamic hypothesis into a causal loop diagram (CLD) is crucial for System Dynamics Modelling. Extracting key variables and causal relationships from text to build a CLD is often challenging and time-consuming for novice…

Machine Learning · Computer Science 2025-03-31 Ning-Yuan Georgia Liu , David R. Keith

Tool planning with large language models (LLMs), referring to selecting, organizing, and preparing the tools necessary to complete a user request, bridges the gap between natural language understanding and task execution. However, current…

Artificial Intelligence · Computer Science 2025-08-19 Wenjie Chen , Wenbin Li , Di Yao , Xuying Meng , Chang Gong , Jingping Bi

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Recent advances in large language models (LLMs) have enabled agents to autonomously execute complex, long-horizon tasks, yet planning remains a primary bottleneck for reliable task execution. Existing methods typically fall into two…

Artificial Intelligence · Computer Science 2026-01-13 Yunfan Li , Bingbing Xu , Xueyun Tian , Xiucheng Xu , Huawei Shen

Pretrained language models (PLMs) trained on large-scale unlabeled corpus are typically fine-tuned on task-specific downstream datasets, which have produced state-of-the-art results on various NLP tasks. However, the data discrepancy issue…

Computation and Language · Computer Science 2022-03-23 Jiali Zeng , Yufan Jiang , Shuangzhi Wu , Yongjing Yin , Mu Li

Spatial reasoning, which requires ability to perceive and manipulate spatial relationships in the 3D world, is a fundamental aspect of human intelligence, yet remains a persistent challenge for Multimodal large language models (MLLMs).…

Artificial Intelligence · Computer Science 2025-11-21 Weichen Liu , Qiyao Xue , Haoming Wang , Xiangyu Yin , Boyuan Yang , Wei Gao

Planning methods struggle with computational intractability in solving task-level problems in large-scale environments. This work explores leveraging the commonsense knowledge encoded in LLMs to empower planning techniques to deal with…

Robotics · Computer Science 2025-02-14 Rodrigo Pérez-Dattari , Zhaoting Li , Robert Babuška , Jens Kober , Cosimo Della Santina

Large language models~(LLMs) exhibit exceptional performance in language tasks, yet their auto-regressive inference is limited due to high computational requirements and is sub-optimal due to the exposure bias. Inspired by speculative…

Computation and Language · Computer Science 2024-03-14 Hongyi Yuan , Keming Lu , Fei Huang , Zheng Yuan , Chang Zhou

In-context learning of large-language models (LLMs) has achieved remarkable success in the field of natural language processing, while extensive case studies reveal that the single-step chain-of-thought prompting approach faces challenges…

Computation and Language · Computer Science 2024-07-04 Yuanzhen Xie , Xinzhou Jin , Tao Xie , MingXiong Lin , Liang Chen , Chenyun Yu , Lei Cheng , ChengXiang Zhuo , Bo Hu , Zang Li

Planning represents a fundamental capability of intelligent agents, requiring comprehensive environmental understanding, rigorous logical reasoning, and effective sequential decision-making. While Large Language Models (LLMs) have…

Artificial Intelligence · Computer Science 2025-05-27 Pengfei Cao , Tianyi Men , Wencan Liu , Jingwen Zhang , Xuzhao Li , Xixun Lin , Dianbo Sui , Yanan Cao , Kang Liu , Jun Zhao

Large Language Models (LLMs) often excel in specific domains but fall short in others due to the limitations of their training. Thus, enabling LLMs to solve problems collaboratively by integrating their complementary knowledge promises to…

Computation and Language · Computer Science 2025-03-20 Ziyao Wang , Muneeza Azmat , Ang Li , Raya Horesh , Mikhail Yurochkin