English
Related papers

Related papers: Dynamic Planning for LLM-based Graphical User Inte…

200 papers

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

Artificial Intelligence · Computer Science 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Large language models (LLMs) have recently demonstrated the potential in acting as autonomous agents for sequential decision-making tasks. However, most existing methods either take actions greedily without planning or rely on static plans…

Computation and Language · Computer Science 2023-06-01 Haotian Sun , Yuchen Zhuang , Lingkai Kong , Bo Dai , Chao Zhang

Embodied agents equipped with GPT as their brains have exhibited extraordinary decision-making and generalization abilities across various tasks. However, existing zero-shot agents for vision-and-language navigation (VLN) only prompt GPT-4…

Artificial Intelligence · Computer Science 2024-06-21 Jiaqi Chen , Bingqian Lin , Ran Xu , Zhenhua Chai , Xiaodan Liang , Kwan-Yee K. Wong

We introduce GamePlot, an LLM-powered assistant that supports game designers in crafting immersive narratives for turn-based games, and allows them to test these games through a collaborative game play and refine the plot throughout the…

Computation and Language · Computer Science 2024-11-06 Seyed Hossein Alavi , Weijia Xu , Nebojsa Jojic , Daniel Kennett , Raymond T. Ng , Sudha Rao , Haiyan Zhang , Bill Dolan , Vered Shwartz

Large language models demonstrated state-of-the-art results on various reasoning tasks when applying the chain-of-thought (CoT) prompting technique. CoT prompting guides the model into breaking tasks into a few intermediate steps and…

Computation and Language · Computer Science 2024-10-11 Oxana Vitman , Nika Amaglobeli , Paul Plachinda

While Large Language Models (LLMs) possess significant capabilities in open-world agent tasks, they also face challenges in rapidly adapting to new, specialized tasks due to their reliance on static pre-trained knowledge. Traditional…

Computation and Language · Computer Science 2025-06-25 Kelin Fu , Kaigui Bian

Lightweight Large Language Models (LwLLMs) are reduced-parameter, optimized models designed to run efficiently on consumer-grade hardware, offering significant advantages in resource efficiency, cost-effectiveness, and data privacy.…

Computation and Language · Computer Science 2025-06-10 Hongming Yang , Shi Lin , Jun Shao , Changting Lin , Donghai Zhu , Meng Han , Qinglei Kong

Recently, substantial advancements have been made in training language models to carry out step-by-step reasoning for solving intricate numerical reasoning tasks. Beyond the methods used to solve these problems, the structure and…

Artificial Intelligence · Computer Science 2025-02-19 Yu Zhang , Shujun Peng , Nengwu Wu , Xinhan Lin , Yang Hu , Jie Tang

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

Computation and Language · Computer Science 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Much worldly semantic knowledge can be encoded in large language models (LLMs). Such information could be of great use to robots that want to carry out high-level, temporally extended commands stated in natural language. However, the lack…

Robotics · Computer Science 2024-03-28 Ehsan Latif

Web agents powered by Large Language Models (LLMs) have demonstrated remarkable abilities in planning and executing multi-step interactions within complex web-based environments, fulfilling a wide range of web navigation tasks. Despite…

Computation and Language · Computer Science 2024-02-26 Yang Deng , Xuan Zhang , Wenxuan Zhang , Yifei Yuan , See-Kiong Ng , Tat-Seng Chua

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

To reduce the cost and consumption of computing resources caused by computational redundancy and delayed reward assignment in long CoT, this research proposes the dynamic chain-of-thought (D-CoT) with adaptive reasoning time and steps. The…

Artificial Intelligence · Computer Science 2025-04-08 Libo Wang

The rise of large language models (LLMs) has made natural language-driven route planning an emerging research area that encompasses rich user objectives. Current research exhibits two distinct approaches: direct route planning using…

Artificial Intelligence · Computer Science 2025-09-17 Liangqi Yuan , Dong-Jun Han , Christopher G. Brinton , Sabine Brunswicker

Recent studies have highlighted their proficiency in some simple tasks like writing and coding through various reasoning strategies. However, LLM agents still struggle with tasks that require comprehensive planning, a process that…

Artificial Intelligence · Computer Science 2024-05-29 Chengxing Xie , Difan Zou

Program-of-Thought (PoT), which aims to use programming language instead of natural language as an intermediate step in reasoning, is an important way for LLMs to solve mathematical problems. Since different programming languages excel in…

Computation and Language · Computer Science 2024-12-18 Nianqi Li , Zujie Liang , Siyu Yuan , Jiaqing Liang , Feng Wei , Yanghua Xiao

Large Language Models (LLMs) like GPT-4 have revolutionized natural language processing, showing remarkable linguistic proficiency and reasoning capabilities. However, their application in strategic multi-agent decision-making environments…

Computation and Language · Computer Science 2024-05-29 Chuanhao Li , Runhan Yang , Tiankai Li , Milad Bafarassat , Kourosh Sharifi , Dirk Bergemann , Zhuoran Yang

Large Language Models (LLMs) have demonstrated strong capabilities in complex reasoning tasks, while recent prompting strategies such as Chain-of-Thought (CoT) have further elevated their performance in handling complex logical problems.…

A long-standing goal of AI systems is to perform complex multimodal reasoning like humans. Recently, large language models (LLMs) have made remarkable strides in such multi-step reasoning on the language modality solely by leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ge Zheng , Bin Yang , Jiajin Tang , Hong-Yu Zhou , Sibei Yang

The recent advancement of autonomous agents powered by Large Language Models (LLMs) has demonstrated significant potential for automating tasks on mobile devices through graphical user interfaces (GUIs). Despite initial progress, these…

Human-Computer Interaction · Computer Science 2025-07-30 Yi Kong , Dianxi Shi , Guoli Yang , Zhang ke-di , Chenlin Huang , Xiaopeng Li , Songchang Jin