English
Related papers

Related papers: Feedback-Based Self-Learning in Large-Scale Conver…

200 papers

Characterizing the patterns of errors that a system makes helps researchers focus future development on increasing its accuracy and robustness. We propose a novel form of "meta learning" that automatically learns interpretable rules that…

Computation and Language · Computer Science 2022-02-15 Tong Gao , Shivang Singh , Raymond J. Mooney

Robotics learning highly relies on human expertise and efforts, such as demonstrations, design of reward functions in reinforcement learning, performance evaluation using human feedback, etc. However, reliance on human assistance can lead…

Robotics · Computer Science 2024-03-26 Yiwen Chen , Yuyao Ye , Ziyi Chen , Chuheng Zhang , Marcelo H. Ang

The application of machine learning techniques to large-scale personalized recommendation problems is a challenging task. Such systems must make sense of enormous amounts of implicit feedback in order to understand user preferences across…

Information Retrieval · Computer Science 2019-01-15 Thom Lake , Sinead A. Williamson , Alexander T. Hawk , Christopher C. Johnson , Benjamin P. Wing

Recent advancements in large language models (LLMs) have significantly enhanced the ability of LLM-based systems to perform complex tasks through natural language processing and tool interaction. However, optimizing these LLM-based systems…

Computation and Language · Computer Science 2025-06-19 Peiyan Zhang , Haibo Jin , Leyang Hu , Xinnuo Li , Liying Kang , Man Luo , Yangqiu Song , Haohan Wang

User simulation is increasingly vital to develop and evaluate recommender systems (RSs). While Large Language Models (LLMs) offer promising avenues to simulate user behavior, they often struggle with the absence of specific task alignment…

Human-Computer Interaction · Computer Science 2026-04-20 Tianjun Wei , Huizhong Guo , Yingpeng Du , Zhu Sun , Huang Chen , Dongxia Wang , Jie Zhang

The rapid advancement of large language models (LLMs) has significantly enhanced the capabilities of AI-driven agents across various tasks. However, existing agentic systems, whether based on fixed pipeline algorithms or pre-defined…

Artificial Intelligence · Computer Science 2025-06-03 Xunjian Yin , Xinyi Wang , Liangming Pan , Li Lin , Xiaojun Wan , William Yang Wang

Large Language Models (LLMs) are widely used to support software developers in tasks such as code generation, optimization, and documentation. However, their ability to improve existing programming answers in a human-like manner remains…

Software Engineering · Computer Science 2026-01-27 Suborno Deb Bappon , Saikat Mondal , Chanchal K. Roy , Kevin Schneider

We study whether multiple large language models (LLMs) can autonomously improve each other in a negotiation game by playing, reflecting, and criticizing. We are interested in this question because if LLMs were able to improve each other, it…

Computation and Language · Computer Science 2023-05-18 Yao Fu , Hao Peng , Tushar Khot , Mirella Lapata

To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task,…

Computation and Language · Computer Science 2024-07-15 Jinglong Gao , Xiao Ding , Yiming Cui , Jianbai Zhao , Hepeng Wang , Ting Liu , Bing Qin

Abstract Meaning Representation (AMR) parsing has experienced a notable growth in performance in the last two years, due both to the impact of transfer learning and the development of novel architectures specific to AMR. At the same time,…

Computation and Language · Computer Science 2020-10-22 Young-Suk Lee , Ramon Fernandez Astudillo , Tahira Naseem , Revanth Gangi Reddy , Radu Florian , Salim Roukos

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a…

Machine Learning · Computer Science 2024-02-20 Archit Sharma , Sedrick Keh , Eric Mitchell , Chelsea Finn , Kushal Arora , Thomas Kollar

Large language models (LLMs) are increasingly positioned as scalable tools for annotating educational data, including classroom discourse, interaction logs, and qualitative learning artifacts. Their ability to rapidly summarize…

Artificial Intelligence · Computer Science 2026-03-17 Bakhtawar Ahtisham , Kirk Vanacore , Rene F. Kizilcec

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Accurate automatic evaluation metrics for open-domain dialogs are in high demand. Existing model-based metrics for system response evaluation are trained on human annotated data, which is cumbersome to collect. In this work, we propose to…

Computation and Language · Computer Science 2022-03-29 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

Building assistive interfaces for controlling robots through arbitrary, high-dimensional, noisy inputs (e.g., webcam images of eye gaze) can be challenging, especially when it involves inferring the user's desired action in the absence of a…

Robotics · Computer Science 2022-02-08 Sean Chen , Jensen Gao , Siddharth Reddy , Glen Berseth , Anca D. Dragan , Sergey Levine

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

Computation and Language · Computer Science 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

Speaker recognition, recognizing speaker identities based on voice alone, enables important downstream applications, such as personalization and authentication. Learning speaker representations, in the context of supervised learning,…

Machine Learning · Computer Science 2022-07-13 Metehan Cekic , Ruirui Li , Zeya Chen , Yuguang Yang , Andreas Stolcke , Upamanyu Madhow

Autonomous systems use extensively learning-enabled components such as deep neural networks (DNNs) for prediction and decision making. In this paper, we utilize a feedback loop between learning-enabled components used for classification and…

Machine Learning · Computer Science 2021-10-08 Dimitrios Boursinos , Xenofon Koutsoukos

Semi-supervised learning in automatic speech recognition (ASR) typically relies on pseudo-labeling, which often suffers from confirmation bias and error accumulation due to noisy supervision. To address this limitation, we propose ReHear, a…

Computation and Language · Computer Science 2026-02-24 Zefang Liu , Chenyang Zhu , Sangwoo Cho , Shi-Xiong Zhang