English
Related papers

Related papers: When Do Tools and Planning Help Large Language Mod…

200 papers

Large Language Models (LLMs) and other large foundation models have achieved noteworthy success, but their size exacerbates existing resource consumption and latency challenges. In particular, the large-scale deployment of these models is…

Machine Learning · Computer Science 2023-08-30 Banghua Zhu , Ying Sheng , Lianmin Zheng , Clark Barrett , Michael I. Jordan , Jiantao Jiao

Large Language Models (LLMs) struggle to directly generate correct plans for complex multi-constraint planning problems, even with self-verification and self-critique. For example, a U.S. domestic travel planning benchmark TravelPlanner was…

Artificial Intelligence · Computer Science 2025-01-30 Yilun Hao , Yongchao Chen , Yang Zhang , Chuchu Fan

Strategic planning is critical for multi-step reasoning, yet compact Large Language Models (LLMs) often lack the capacity to formulate global strategies, leading to error propagation in long-horizon tasks. Our analysis reveals that LLMs…

Computation and Language · Computer Science 2026-04-15 Haoyu Zheng , Yun Zhu , Yuqian Yuan , Bo Yuan , Wenqiao Zhang , Siliang Tang , Jun Xiao

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

Software Engineering · Computer Science 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos

In contemporary workplaces, meetings are essential for exchanging ideas and ensuring team alignment but often face challenges such as time consumption, scheduling conflicts, and inefficient participation. Recent advancements in Large…

Computation and Language · Computer Science 2025-02-10 Lingxiang Hu , Shurun Yuan , Xiaoting Qin , Jue Zhang , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Large Language Models (LLMs) are increasingly ubiquitous, yet their ability to retain and reason about temporal information remains limited, hindering their application in real-world scenarios where understanding the sequential nature of…

Computation and Language · Computer Science 2024-07-08 Himanshu Beniwal , Dishant Patel , Kowsik Nandagopan D , Hritik Ladia , Ankit Yadav , Mayank Singh

Large Language Models (LLMs) are transformer-based machine learning models that have shown remarkable performance in tasks for which they were not explicitly trained. Here, we explore the potential of LLMs to perform symbolic regression --…

Computation and Language · Computer Science 2026-04-17 Samiha Sharlin , Tyler R. Josephson

Large language models (LLMs) achieve impressive results on many benchmarks, yet their capacity for planning and stateful reasoning remains unclear. We study these abilities directly, without code execution or other tools, using the…

Artificial Intelligence · Computer Science 2025-11-27 Charles Schepanowski , Charles Ling

Reasoning about time and temporal relations is an integral aspect of human cognition, essential for perceiving the world and navigating our experiences. Though large language models (LLMs) have demonstrated impressive performance in many…

Computation and Language · Computer Science 2024-11-19 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Tool use, such as web search, has become a standard capability even in freely available large language models (LLMs). However, existing benchmarks evaluate temporal reasoning mainly in static, non-tool-using settings, which poorly reflect…

Computation and Language · Computer Science 2026-03-24 Zhengxiang Wang , Zeyu Dong

In this preliminary study, we investigate a GPT-driven intent-based reasoning approach to streamline tool selection for large language models (LLMs) aimed at system efficiency. By identifying the intent behind user prompts at runtime, we…

Machine Learning · Computer Science 2024-04-25 Michael Fore , Simranjit Singh , Dimitrios Stamoulis

Intrigued by the claims of emergent reasoning capabilities in LLMs trained on general web corpora, in this paper, we set out to investigate their planning capabilities. We aim to evaluate (1) how good LLMs are by themselves in generating…

Artificial Intelligence · Computer Science 2023-02-15 Karthik Valmeekam , Sarath Sreedharan , Matthew Marquez , Alberto Olmo , Subbarao Kambhampati

Recently, Large Language Models (LLMs) have demonstrated great potential in various data mining tasks, such as knowledge question answering, mathematical reasoning, and commonsense reasoning. However, the reasoning capability of LLMs on…

Computation and Language · Computer Science 2025-05-22 He Chang , Chenchen Ye , Zhulin Tao , Jie Wu , Zhengmao Yang , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

There has been considerable divergence of opinion on the reasoning abilities of Large Language Models (LLMs). While the initial optimism that reasoning might emerge automatically with scale has been tempered thanks to a slew of…

Artificial Intelligence · Computer Science 2024-08-06 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

Computation and Language · Computer Science 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Large language models~(LLMs) have been adopted to process textual task description and accomplish procedural planning in embodied AI tasks because of their powerful reasoning ability. However, there is still lack of study on how vision…

Computation and Language · Computer Science 2024-10-08 Ying Su , Zhan Ling , Haochen Shi , Jiayang Cheng , Yauwai Yim , Yangqiu Song

This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition. We present three different approaches to predicting turn-level qualities of chatbot responses based on large language models (LLMs). We…

Computation and Language · Computer Science 2023-08-15 Ondřej Plátek , Vojtěch Hudeček , Patricia Schmidtová , Mateusz Lango , Ondřej Dušek

Large language models (LLMs) have recently received considerable attention as alternative solutions for task planning. However, comparing the performance of language-oriented task planners becomes difficult, and there exists a dearth of…

Artificial Intelligence · Computer Science 2024-02-14 Jae-Woo Choi , Youngwoo Yoon , Hyobin Ong , Jaehong Kim , Minsu Jang

Reasoning about time is essential for understanding the nuances of events described in natural language. Previous research on this topic has been limited in scope, characterized by a lack of standardized benchmarks that would allow for…

Computation and Language · Computer Science 2024-06-03 Yuqing Wang , Yun Zhao

Large language models (LLMs) have revolutionized the field of AI, demonstrating unprecedented capacity across various tasks. However, the inference process for LLMs comes with significant computational costs. In this paper, we propose an…

Computation and Language · Computer Science 2023-05-30 Zangwei Zheng , Xiaozhe Ren , Fuzhao Xue , Yang Luo , Xin Jiang , Yang You