English
Related papers

Related papers: Combining Learning from Human Feedback and Knowled…

200 papers

While the role of humans is increasingly recognized in machine learning community, representation of and interaction with models in current human-in-the-loop machine learning (HITL-ML) approaches are too low-level and far-removed from…

Computation and Language · Computer Science 2021-09-17 Yiwei Yang , Eser Kandogan , Yunyao Li , Walter S. Lasecki , Prithviraj Sen

Attention, or prioritization of certain information items over others, is a critical element of any learning process, for both humans and machines. Given that humans continue to outperform machines in certain learning tasks, it seems…

Machine Learning · Computer Science 2025-02-21 Avihay Chriqui , Inbal Yahav , Dov Teeni , Ahmed Abbasi

We present the Battlesnake Challenge, a framework for multi-agent reinforcement learning with Human-In-the-Loop Learning (HILL). It is developed upon Battlesnake, a multiplayer extension of the traditional Snake game in which 2 or more…

Artificial Intelligence · Computer Science 2020-07-22 Jonathan Chung , Anna Luo , Xavier Raffin , Scott Perry

In this paper, we present our solution to the Multilingual Information Retrieval Across a Continuum of Languages (MIRACL) challenge of WSDM CUP 2023\footnote{https://project-miracl.github.io/}. Our solution focuses on enhancing the ranking…

Information Retrieval · Computer Science 2023-02-15 Qi Zhang , Zijian Yang , Yilun Huang , Ze Chen , Zijian Cai , Kangxu Wang , Jiewen Zheng , Jiarong He , Jin Gao

Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a simulated building…

Computation and Language · Computer Science 2022-04-22 Zhengxiang Shi , Yue Feng , Aldo Lipani

When developing AI systems that interact with humans, it is essential to design both a system that can understand humans, and a system that humans can understand. Most deep network based agent-modeling approaches are 1) not interpretable…

Machine Learning · Computer Science 2021-07-14 Ini Oguntola , Dana Hughes , Katia Sycara

In this paper, we introduce a new set of reinforcement learning (RL) tasks in Minecraft (a flexible 3D world). We then use these tasks to systematically compare and contrast existing deep reinforcement learning (DRL) architectures with our…

Artificial Intelligence · Computer Science 2016-05-31 Junhyuk Oh , Valliappa Chockalingam , Satinder Singh , Honglak Lee

A typical way in which a machine acquires knowledge from humans is by programming. Compared to learning from demonstrations or experiences, programmatic learning allows the machine to acquire a novel skill as soon as the program is written,…

Artificial Intelligence · Computer Science 2023-10-19 Leonardo Hernandez Cano , Yewen Pu , Robert D. Hawkins , Josh Tenenbaum , Armando Solar-Lezama

\textit{Reasoning} may be viewed as an algorithm $P$ that makes a choice of an action $a^* \in \mathcal{A}$, aiming to optimize some outcome. However, executing $P$ itself bears costs (time, energy, limited capacity, etc.) and needs to be…

Artificial Intelligence · Computer Science 2026-02-12 Prakhar Godara , Tilman Diego Alemán

Large language model (LLM) based agents have shown great potential in following human instructions and automatically completing various tasks. To complete a task, the agent needs to decompose it into easily executed steps by planning.…

Computation and Language · Computer Science 2025-06-02 Weihong Du , Wenrui Liao , Binyu Yan , Hongru Liang , Anthony G. Cohn , Wenqiang Lei

Human cognition is profoundly shaped by the environments in which it unfolds. Yet, it remains an open question whether learning and decision making can be explained as a principled adaptation to the statistical structure of real-world…

Neurons and Cognition · Quantitative Biology 2025-09-04 Akshay K. Jagadish , Mirko Thalmann , Julian Coda-Forno , Marcel Binz , Eric Schulz

An important goal in artificial intelligence is to create agents that can both interact naturally with humans and learn from their feedback. Here we demonstrate how to use reinforcement learning from human feedback (RLHF) to improve upon…

This paper extends recent work in interactive machine learning (IML) focused on effectively incorporating human feedback. We show how control and feedback signals complement each other in systems which model human reward. We demonstrate…

Human-Computer Interaction · Computer Science 2017-01-27 Kory W. Mathewson , Patrick M. Pilarski

Embodied intelligence requires high-fidelity simulation environments to support perception and decision-making, yet existing platforms often suffer from data contamination and limited flexibility. To mitigate this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Lechao Zhang , Haoran Xu , Jingyu Gong , Xuhong Wang , Yuan Xie , Xin Tan

Reliable real-world deployment of reinforcement learning (RL) methods requires a nuanced understanding of their strengths and weaknesses and how they compare to those of humans. Human-machine systems are becoming more prevalent and the…

Artificial Intelligence · Computer Science 2024-05-21 Eric Pulick , Vladimir Menkov , Yonatan Mintz , Paul Kantor , Vicki Bier

Learning from human feedback has gained traction in fields like robotics and natural language processing in recent years. While prior works mostly rely on human feedback in the form of comparisons, language is a preferable modality that…

Robotics · Computer Science 2024-10-10 Zhaojing Yang , Miru Jun , Jeremy Tien , Stuart J. Russell , Anca Dragan , Erdem Bıyık

We study the problem of cross-embodiment inverse reinforcement learning, where we wish to learn a reward function from video demonstrations in one or more embodiments and then transfer the learned reward to a different embodiment (e.g.,…

Robotics · Computer Science 2024-08-13 Connor Mattson , Anurag Aribandi , Daniel S. Brown

We present Plancraft, a multi-modal evaluation dataset for LLM agents. Plancraft has both a text-only and multi-modal interface, based on the Minecraft crafting GUI. We include the Minecraft Wiki to evaluate tool use and Retrieval Augmented…

Computation and Language · Computer Science 2025-07-16 Gautier Dagan , Frank Keller , Alex Lascarides

Workers participating in a crowdsourcing platform can have a wide range of abilities and interests. An important problem in crowdsourcing is the task recommendation problem, in which tasks that best match a particular worker's preferences…

Human-Computer Interaction · Computer Science 2018-07-30 Qiyu Kang , Wee Peng Tay

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

Robotics · Computer Science 2022-10-21 Erdem Bıyık