English
Related papers

Related papers: To Ask or Not to Ask: Learning to Require Human Fe…

200 papers

Machine learning models implemented in hardware on physical devices may be deployed for a long time. The computational abilities of the device may be limited and become outdated with respect to newer improvements. Because of the size of ML…

Machine Learning · Computer Science 2024-09-25 Yu Wu , Anand Sarwate

In human learning, an effective skill in improving learning outcomes is learning by teaching: a learner deepens his/her understanding of a topic by teaching this topic to others. In this paper, we aim to borrow this teaching-driven learning…

Machine Learning · Computer Science 2021-03-15 Parth Sheth , Yueyu Jiang , Pengtao Xie

Natural Language Feedback (NLF) is an increasingly popular mechanism for aligning Large Language Models (LLMs) to human preferences. Despite the diversity of the information it can convey, NLF methods are often hand-designed and arbitrary,…

Computation and Language · Computer Science 2024-10-24 Beatriz Borges , Niket Tandon , Tanja Käser , Antoine Bosselut

Machine Learning (ML) and its applications have been transforming our lives but it is also creating issues related to the development of fair, accountable, transparent, and ethical Artificial Intelligence. As the ML models are not fully…

Applications · Statistics 2021-06-30 Yihuang Kang , Yi-Wen Chiu , Ming-Yen Lin , Fang-yi Su , Sheng-Tai Huang

Learning to Reject (LtR) frameworks allow ML models to abstain from uncertain predictions and promote user trust. However, since current LtR strategies focus solely on predictive performance, they completely neglect explanation quality.…

Machine Learning · Computer Science 2026-03-19 Luca Stradiotti , Dario Pesenti , Stefano Teso , Jesse Davis

The exponential growth of volume, variety and velocity of data is raising the need for investigations of automated or semi-automated ways to extract useful patterns from the data. It requires deep expert knowledge and extensive…

Machine Learning · Computer Science 2020-07-22 Abbas Raza Ali , Marcin Budka , Bogdan Gabrys

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

This paper addresses the critical data scarcity that hinders the practical deployment of learning to defer (L2D) systems to the population. We introduce a context-aware, semi-supervised framework that uses meta-learning to generate…

Human-Computer Interaction · Computer Science 2025-10-24 Nilesh Ramgolam , Gustavo Carneiro , Hsiang-Ting Chen

Large Language Models (LLMs) can generate SQL queries from natural language questions but struggle with database-specific schemas and tacit domain knowledge. We introduce a framework for continual learning from human feedback in…

Computation and Language · Computer Science 2025-12-01 Thomas Cook , Kelly Patel , Sivapriya Vellaichamy , Udari Madhushani Sehwag , Saba Rahimi , Zhen Zeng , Sumitra Ganesh

When prompted with a few examples and intermediate steps, large language models (LLMs) have demonstrated impressive performance in various reasoning tasks. However, prompting methods that rely on implicit knowledge in an LLM often generate…

Artificial Intelligence · Computer Science 2024-12-23 Zhaocheng Zhu , Yuan Xue , Xinyun Chen , Denny Zhou , Jian Tang , Dale Schuurmans , Hanjun Dai

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

Machine Learning · Computer Science 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

Large Language Models (LLMs) excel as passive responders, but teaching them to be proactive, goal-oriented partners, a critical capability in high-stakes domains, remains a major challenge. Current paradigms either myopically optimize…

Computation and Language · Computer Science 2025-11-10 Fei Wei , Daoyuan Chen , Ce Wang , Yilun Huang , Yushuo Chen , Xuchen Pan , Yaliang Li , Bolin Ding

Learning to defer (L2D) aims to improve human-AI collaboration systems by learning how to defer decisions to humans when they are more likely to be correct than an ML classifier. Existing research in L2D overlooks key real-world aspects…

Human-AI collaboration (HAIC) in decision-making aims to create synergistic teaming between human decision-makers and AI systems. Learning to defer (L2D) has been presented as a promising framework to determine who among humans and AI…

Machine Learning · Computer Science 2022-07-14 Diogo Leitão , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Large language models (LLMs) excel at complex tasks thanks to advances in their reasoning abilities. However, existing methods overlook the trade-off between reasoning effectiveness and efficiency, often encouraging unnecessarily long…

Machine Learning · Computer Science 2025-10-16 Jingyao Wang , Wenwen Qiang , Zeen Song , Changwen Zheng , Hui Xiong

How can a robot provide unobtrusive physical support within a group of humans? We present Attentive Support, a novel interaction concept for robots to support a group of humans. It combines scene perception, dialogue acquisition, situation…

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

Computation and Language · Computer Science 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Designing user-centered LLM systems requires understanding how people use them, but patterns of user behavior are often masked by the variability of queries. In this work, we introduce a new framework to describe request-making that…

Computation and Language · Computer Science 2025-10-09 Shengqi Zhu , Jeffrey M. Rzeszotarski , David Mimno

We propose a novel approach for decision making problems leveraging the generalization capabilities of large language models (LLMs). Traditional methods such as expert systems, planning algorithms, and reinforcement learning often exhibit…

Computation and Language · Computer Science 2024-08-13 Yu Zhang , Haoxiang Liu , Feijun Jiang , Weihua Luo , Kaifu Zhang