English
Related papers

Related papers: In-Place Feedback: Reliable Refinement for Multi-T…

200 papers

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

Natural Language Feedback (NLF) is an increasingly popular mechanism for aligning Large Language Models (LLMs) to human preferences. Despite the diversity of the information it can convey, NLF methods are often hand-designed and arbitrary,…

Computation and Language · Computer Science 2024-10-24 Beatriz Borges , Niket Tandon , Tanja Käser , Antoine Bosselut

Recommender systems utilizing explicit feedback have witnessed significant advancements and widespread applications over the past years. However, generating recommendations in few-shot scenarios remains a persistent challenge. Recently,…

Information Retrieval · Computer Science 2023-12-22 Zhoumeng Wang

Humans follow criteria when they execute tasks, and these criteria are directly used to assess the quality of task completion. Therefore, having models learn to use criteria to provide feedback can help humans or models to perform tasks…

Computation and Language · Computer Science 2024-06-05 Weizhe Yuan , Pengfei Liu , Matthias Gallé

Recently, advanced large language models (LLMs) have emerged at an increasingly rapid pace. However, when faced with complex problems, most users are often unable to provide accurate and effective prompts to interact with LLMs, thus…

Computation and Language · Computer Science 2026-04-17 Wenjin Liu , Haoran Luo , Xueyuan Lin , Haoming Liu , Tiesunlong Shen , Jiapu Wang , Rui Mao , Erik Cambria

Large language models (LLMs) have shown exceptional proficiency in natural language processing but often fall short of generating creative and original responses to open-ended questions. To enhance LLM creativity, our key insight is to…

Computation and Language · Computer Science 2024-08-09 Li-Chun Lu , Shou-Jen Chen , Tsung-Min Pai , Chan-Hung Yu , Hung-yi Lee , Shao-Hua Sun

Large Language Models (LLMs) like the GPT and LLaMA families have demonstrated exceptional capabilities in capturing and condensing critical contextual information and achieving state-of-the-art performance in the summarization task.…

Computation and Language · Computer Science 2023-11-06 Prakamya Mishra , Zonghai Yao , Shuwei Chen , Beining Wang , Rohan Mittal , Hong Yu

Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect…

Computation and Language · Computer Science 2025-05-23 Kexin Shang , Chia-Hsuan Chang , Christopher C. Yang

Evaluating large language models (LLMs) is fundamental, particularly in the context of practical applications. Conventional evaluation methods, typically designed primarily for LLM development, yield numerical scores that ignore the user…

Computation and Language · Computer Science 2024-04-12 Yongqiang Ma , Lizhi Qing , Jiawei Liu , Yangyang Kang , Yue Zhang , Wei Lu , Xiaozhong Liu , Qikai Cheng

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

Computation and Language · Computer Science 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

Computation and Language · Computer Science 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Large Language Models (LLMs) have revolutionized code generation, evolving from static tools into dynamic conversational interfaces that facilitate complex, multi-turn collaborative programming. While LLMs exhibit remarkable proficiency in…

Software Engineering · Computer Science 2026-03-31 Binquan Zhang , Li Zhang , Lin Shi , Song Wang , Yuwei Qian , Linhui Zhao , Fang Liu , An Fu , Yida Ye

Large language model (LLM)-powered chatbots are increasingly used for opinion exploration. Prior research examined how LLMs alter user views, yet little work extended beyond one-way influence to address how user input can affect LLM…

Human-Computer Interaction · Computer Science 2025-10-24 Yuyang Jiang , Longjie Guo , Yuchen Wu , Aylin Caliskan , Tanu Mitra , Hua Shen

Machine Translation (MT) remains one of the last NLP tasks where large language models (LLMs) have not yet replaced dedicated supervised systems. This work exploits the complementary strengths of LLMs and supervised MT by guiding LLMs to…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Marine Carpuat

Job interviews play a critical role in shaping one's career, yet practicing interview skills can be challenging, especially without access to human coaches or peers for feedback. Recent advancements in large language models (LLMs) present…

Human-Computer Interaction · Computer Science 2024-11-05 Taufiq Daryanto , Xiaohan Ding , Lance T. Wilhelm , Sophia Stil , Kirk McInnis Knutsen , Eugenia H. Rho

Natural language (NL) feedback offers rich insights into user experience. While existing studies focus on an instance-level approach, where feedback is used to refine specific examples, we introduce a framework for system-level use of NL…

Computation and Language · Computer Science 2024-02-06 Weizhe Yuan , Kyunghyun Cho , Jason Weston

Feedback plays a central role in learning, yet pre-service teachers' engagement with feedback depends not only on its quality but also on their perception of the feedback content and source. Large Language Models (LLMs) are increasingly…

Human-Computer Interaction · Computer Science 2025-07-23 Lucas Jasper Jacobsen , Ute Mertens , Thorben Jansen , Kira Elena Weber

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question answering. Previous…

Computation and Language · Computer Science 2023-06-08 Zixian Huang , Jiaying Zhou , Gengyang Xiao , Gong Cheng

Peer review at AI conferences is stressed by rapidly rising submission volumes, leading to deteriorating review quality and increased author dissatisfaction. To address these issues, we developed Review Feedback Agent, a system leveraging…

Artificial Intelligence · Computer Science 2025-04-15 Nitya Thakkar , Mert Yuksekgonul , Jake Silberg , Animesh Garg , Nanyun Peng , Fei Sha , Rose Yu , Carl Vondrick , James Zou

Reinforcement Learning from Human Feedback (\textbf{RLHF}) has emerged as a dominant approach for aligning LLM outputs with human preferences. Inspired by the success of RLHF, we study the performance of multiple algorithms that learn from…