English
Related papers

Related papers: To Ask or Not to Ask: Learning to Require Human Fe…

200 papers

Research in human-centered AI has shown the benefits of systems that can explain their predictions. Methods that allow an AI to take advice from humans in response to explanations are similarly useful. While both capabilities are…

Information Retrieval · Computer Science 2023-01-19 Benjamin Charles Germain Lee , Doug Downey , Kyle Lo , Daniel S. Weld

Large Language Models (LLMs) have demonstrated considerable advances, and several claims have been made about their exceeding human performance. However, in real-world tasks, domain knowledge is often required. Low-resource learning methods…

Computation and Language · Computer Science 2023-11-17 Yuxuan Lu , Bingsheng Yao , Shao Zhang , Yun Wang , Peng Zhang , Tun Lu , Toby Jia-Jun Li , Dakuo Wang

Large language models (LLMs) are increasingly used as automated evaluators of AI systems, including in high-stakes applications. In this role, LLMs are used to generate judgments about the quality, appropriateness, or even safety of model…

Machine Learning · Computer Science 2026-05-19 Jane Paik Kim

Despite substantial advances in large language models (LLMs), generating factually consistent responses for knowledge-intensive question answering remains challenging. These difficulties are primarily due to hallucinations and the…

Computation and Language · Computer Science 2026-05-19 Taolin Zhang , Dongyang Li , Chen Chen , Qizhou Chen , Jiuheng Wan , Xiaofeng He , Chengyu Wang , Richang Hong

The applicability of Large Language Models (LLMs) in temporal reasoning tasks over data that is not present during training is still a field that remains to be explored. In this paper we work on this topic, focusing on structured and…

Computation and Language · Computer Science 2025-12-03 Alfredo Garrachón Ruiz , Tomás de la Rosa , Daniel Borrajo

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

We address the product question generation task. For a given product description, our goal is to generate questions that reflect potential user information needs that are either missing or not well covered in the description. Moreover, we…

Computation and Language · Computer Science 2022-07-07 Haggai Roitman , Uriel Singer , Yotam Eshel , Alexander Nus , Eliyahu Kiperwasser

Continuing advances in Large Language Models (LLMs) in artificial intelligence offer important capacities in intuitively accessing and using medical knowledge in many contexts, including education and training as well as assessment and…

Computation and Language · Computer Science 2024-08-01 Roma Shusterman , Allison C. Waters , Shannon O`Neill , Phan Luu , Don M. Tucker

Machine Teaching (MT) is an interactive process where humans train a machine learning model by playing the role of a teacher. The process of designing an MT system involves decisions that can impact both efficiency of human teachers and…

Artificial Intelligence · Computer Science 2022-04-25 Karan Taneja , Harshvardhan Sikka , Ashok Goel

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

Computation and Language · Computer Science 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating human-like text, yet they largely operate as reactive agents, responding only when directly prompted. This passivity creates an…

Computation and Language · Computer Science 2026-05-18 Deep Anil Patel , Iain Melvin , Christopher Malon , Martin Renqiang Min

A long-lived LLM agent, such as OpenClaw, earns its value by acting on a user's preferences and constraints across sessions, not just the current request. Yet today's agents keep what a user volunteers but rarely ask for what stays…

Computation and Language · Computer Science 2026-05-29 Bin Wu , Guanyun Zou , Bingbing Wang , Huan Zhao , Chuan Shi

The ubiquity of AI leads to situations where humans and AI work together, creating the need for learning-to-defer algorithms that determine how to partition tasks between AI and humans. We work to improve learning-to-defer algorithms when…

Machine Learning · Computer Science 2021-12-22 Naveen Raman , Michael Yee

Answering complex natural language questions often necessitates multi-step reasoning and integrating external information. Several systems have combined knowledge retrieval with a large language model (LLM) to answer such questions. These…

Large language model (LLM)-driven AI systems are increasingly important for autonomous decision-making in dynamic and open environments. However, most existing systems rely on predefined tasks and fixed prompts, limiting their ability to…

Artificial Intelligence · Computer Science 2026-02-03 Hong Su

Learning to defer (L2D) enables human-AI cooperation by deciding when an AI system should act autonomously or defer to a human expert. Existing L2D methods, however, assume static human performance, contradicting well-established findings…

Machine Learning · Computer Science 2026-04-07 Zheng Zhang , Cuong C. Nguyen , David Rosewarne , Kevin Wells , Gustavo Carneiro

In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our…

Computation and Language · Computer Science 2025-12-30 Navid Asgari , Benjamin M. Cole

Expert decision makers are starting to rely on data-driven automated agents to assist them with various tasks. For this collaboration to perform properly, the human decision maker must have a mental model of when and when not to rely on the…

Machine Learning · Computer Science 2021-12-15 Hussein Mozannar , Arvind Satyanarayan , David Sontag

We introduce an interactive learning framework for the development and testing of intelligent visual systems, called learning-by-asking (LBA). We explore LBA in context of the Visual Question Answering (VQA) task. LBA differs from standard…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Ishan Misra , Ross Girshick , Rob Fergus , Martial Hebert , Abhinav Gupta , Laurens van der Maaten

Table Question Answering (TQA) aims to answer natural language questions about tabular data, often accompanied by additional contexts such as text passages. The task spans diverse settings, varying in table representation, question/answer…

Computation and Language · Computer Science 2026-04-21 Wei Zhou , Bolei Ma , Annemarie Friedrich , Mohsen Mesgar