English
Related papers

Related papers: Large Language Models are Learnable Planners for L…

200 papers

Large Language Models (LLMs) exhibit remarkably powerful capabilities. One of the crucial factors to achieve success is aligning the LLM's output with human preferences. This alignment process often requires only a small amount of data to…

Large language models (LLMs) exhibit impressive capabilities across a wide range of tasks, yet the choice of which model to use often involves a trade-off between performance and cost. More powerful models, though effective, come with…

Machine Learning · Computer Science 2025-02-25 Isaac Ong , Amjad Almahairi , Vincent Wu , Wei-Lin Chiang , Tianhao Wu , Joseph E. Gonzalez , M Waleed Kadous , Ion Stoica

Large Language Models (LLMs) have been achieving competent performance on a wide range of downstream tasks, yet existing work shows that inference on structured data is challenging for LLMs. This is because LLMs need to either understand…

Computation and Language · Computer Science 2024-07-04 Younghun Lee , Sungchul Kim , Ryan A. Rossi , Tong Yu , Xiang Chen

Large language models (LLMs) hold promise for generating plans for complex tasks, but their effectiveness is limited by sequential execution, lack of control flow models, and difficulties in skill retrieval. Addressing these issues is…

Computation and Language · Computer Science 2024-10-18 Andrei Cosmin Redis , Mohammadreza Fani Sani , Bahram Zarrin , Andrea Burattin

The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays…

Information Retrieval · Computer Science 2025-01-14 Artun Boz , Wouter Zorgdrager , Zoe Kotti , Jesse Harte , Panos Louridas , Dietmar Jannach , Vassilios Karakoidas , Marios Fragkoulis

Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving…

Computation and Language · Computer Science 2024-02-08 Tongtong Wu , Linhao Luo , Yuan-Fang Li , Shirui Pan , Thuy-Trang Vu , Gholamreza Haffari

Large Language Models (LLMs) are increasingly being explored for building Agents capable of active environmental interaction (e.g., via tool use) to solve complex problems. Reinforcement Learning (RL) is considered a key technology with…

Computation and Language · Computer Science 2025-11-19 Mingyue Cheng , Jie Ouyang , Shuo Yu , Ruiran Yan , Yucong Luo , Zirui Liu , Daoyu Wang , Qi Liu , Enhong Chen

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of Large Language…

Computation and Language · Computer Science 2024-05-08 Daniele Grandi , Yash Patawari Jain , Allin Groom , Brandon Cramer , Christopher McComb

Reinforcement Learning (RL) is essential for evolving Large Language Models (LLMs) into autonomous agents capable of long-horizon planning, yet a practical recipe for scaling RL in complex, multi-turn environments remains elusive. This…

Machine Learning · Computer Science 2026-03-24 Xixi Wu , Qianguo Sun , Ruiyang Zhang , Chao Song , Junlong Wu , Yiyan Qi , Hong Cheng

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

Machine Learning · Computer Science 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Conversational recommender systems (CRSs) aim to recommend high-quality items to users through a dialogue interface. It usually contains multiple sub-tasks, such as user preference elicitation, recommendation, explanation, and item…

Information Retrieval · Computer Science 2023-08-14 Yue Feng , Shuchang Liu , Zhenghai Xue , Qingpeng Cai , Lantao Hu , Peng Jiang , Kun Gai , Fei Sun

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

Previous work has showcased the intriguing capabilities of Large Language Models (LLMs) in instruction-following and rhetorical fluency. However, systematic exploration of their dual capabilities to autonomously persuade and resist…

Computation and Language · Computer Science 2025-06-10 Tianjie Ju , Yujia Chen , Hao Fei , Mong-Li Lee , Wynne Hsu , Pengzhou Cheng , Zongru Wu , Zhuosheng Zhang , Gongshen Liu

Text-based recommendation holds a wide range of practical applications due to its versatility, as textual descriptions can represent nearly any type of item. However, directly employing the original item descriptions may not yield optimal…

Computation and Language · Computer Science 2024-04-03 Hanjia Lyu , Song Jiang , Hanqing Zeng , Yinglong Xia , Qifan Wang , Si Zhang , Ren Chen , Christopher Leung , Jiajie Tang , Jiebo Luo

Motivated by the substantial achievements observed in Large Language Models (LLMs) in the field of natural language processing, recent research has commenced investigations into the application of LLMs for complex, long-horizon sequential…

Robotics · Computer Science 2023-08-29 Zhehua Zhou , Jiayang Song , Kunpeng Yao , Zhan Shu , Lei Ma

Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with…

Computation and Language · Computer Science 2024-10-24 Junjie Wang , Mingyang Chen , Binbin Hu , Dan Yang , Ziqi Liu , Yue Shen , Peng Wei , Zhiqiang Zhang , Jinjie Gu , Jun Zhou , Jeff Z. Pan , Wen Zhang , Huajun Chen

Large Language Models (LLMs) have been widely used as general-purpose AI agents showing comparable performance on many downstream tasks. However, existing work shows that it is challenging for LLMs to integrate structured data (e.g. KG,…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Sungchul Kim , Tong Yu , Ryan A. Rossi , Xiang Chen