English
Related papers

Related papers: Retrospective Learning from Interactions

200 papers

While large language models (LLMs) have shown great potential across various domains, their applications in robotics remain largely limited to static prompt-based behaviors and still face challenges in complex tasks under zero-shot or…

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and…

Computation and Language · Computer Science 2023-09-11 Jiatong Li , Rui Li , Qi Liu

Large Language Models (LLMs) have recently emerged as promising tools for recommendation thanks to their advanced textual understanding ability and context-awareness. Despite the current practice of training and evaluating LLM-based…

Information Retrieval · Computer Science 2025-06-12 Sein Kim , Hongseok Kang , Kibum Kim , Jiwan Kim , Donghyun Kim , Minchul Yang , Kwangjin Oh , Julian McAuley , Chanyoung Park

Humans do not just find mistakes after the fact -- we often catch them mid-stream because 'reflection' is tied to the goal and its constraints. Today's large language models produce reasoning tokens and 'reflective' text, but is it…

Artificial Intelligence · Computer Science 2025-10-24 Sion Weatherhead , Flora Salim , Aaron Belbasis

Writing well requires not only expressing ideas but also refining them through revision, a process facilitated by reflection. Prior research suggests that feedback delivered through dialogues, such as those in writing center tutoring…

Human-Computer Interaction · Computer Science 2025-04-14 Jiho Kim , Philippe Laban , Xiang 'Anthony' Chen , Kenneth C. Arnold

Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a novel approach that enables LLMs to self-improve through…

Computation and Language · Computer Science 2024-02-02 Jianqiao Lu , Wanjun Zhong , Wenyong Huang , Yufei Wang , Qi Zhu , Fei Mi , Baojun Wang , Weichao Wang , Xingshan Zeng , Lifeng Shang , Xin Jiang , Qun Liu

Language Models (LMs) have shown impressive performance in various natural language tasks. However, when it comes to natural language reasoning, LMs still face challenges such as hallucination, generating incorrect intermediate reasoning…

Computation and Language · Computer Science 2023-10-20 Deepak Nathani , David Wang , Liangming Pan , William Yang Wang

Generative Large Language Models (LLMs) are capable of being in-context learners. However, the underlying mechanism of in-context learning (ICL) is still a major research question, and experimental research results about how models exploit…

Computation and Language · Computer Science 2025-02-11 Aliakbar Nafar , Kristen Brent Venable , Parisa Kordjamshidi

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

Learning from human preferences is important for language models to match human needs and to align with human and social values. Prior works have achieved remarkable successes by learning from human feedback to understand and follow…

Machine Learning · Computer Science 2023-10-19 Hao Liu , Carmelo Sferrazza , Pieter Abbeel

Large Language Models(LLMs) have dramatically revolutionized the field of Natural Language Processing(NLP), offering remarkable capabilities that have garnered widespread usage. However, existing interaction paradigms between LLMs and users…

Computation and Language · Computer Science 2024-03-11 Juhao Liang , Ziwei Wang , Zhuoheng Ma , Jianquan Li , Zhiyi Zhang , Xiangbo Wu , Benyou Wang

With large language models (LLMs) achieving remarkable breakthroughs in natural language processing (NLP) domains, LLM-enhanced recommender systems have received much attention and have been actively explored currently. In this paper, we…

Information Retrieval · Computer Science 2024-07-02 Jianghao Lin , Rong Shan , Chenxu Zhu , Kounianhua Du , Bo Chen , Shigang Quan , Ruiming Tang , Yong Yu , Weinan Zhang

Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns.…

Computation and Language · Computer Science 2026-03-17 Ruihao Pan , Suhang Wang

Tool learning aims to enhance and expand large language models' (LLMs) capabilities with external tools, which has gained significant attention recently. Current methods have shown that LLMs can effectively handle a certain amount of tools…

Computation and Language · Computer Science 2024-10-01 Qiancheng Xu , Yongqi Li , Heming Xia , Wenjie Li

Large language models~(LLMs) are expected to be helpful, harmless, and honest. In different alignment scenarios, such as safety, confidence, and general preference alignment, binary preference data collection and reward modeling are…

Computation and Language · Computer Science 2025-10-14 Shuai Zhao , Yunqiu Xu , Linchao Zhu , Yi Yang

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an…

Computation and Language · Computer Science 2024-06-19 Shimao Zhang , Changjiang Gao , Wenhao Zhu , Jiajun Chen , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Shujian Huang

Large language models (LLMs) have demonstrated remarkable performance on single-turn text-to-SQL tasks, but real-world database applications predominantly require multi-turn interactions to handle ambiguous queries, execution errors, and…

We propose RecaLLM, a set of reasoning language models post-trained to make effective use of long-context information. In-context retrieval, which identifies relevant evidence from context, and reasoning are deeply intertwined: retrieval…

Computation and Language · Computer Science 2026-04-13 Kyle Whitecross , Negin Rahimi

Large language model (LLM) based multi-turn dialogue systems often struggle to track dependencies across non-adjacent turns, undermining both consistency and scalability. As conversations lengthen, essential information becomes sparse and…

Computation and Language · Computer Science 2026-05-15 Renning Pang , Tian Lan , Leyuan Liu , Xiaoming Huang , Piao Tong , Xiaosong Zhang