English
Related papers

Related papers: Optimal Fidelity Selection for Human-Supervised Se…

200 papers

Online reinforcement learning from human feedback (RLHF) has emerged as a promising paradigm for aligning large language models (LLMs) by continuously collecting new preference feedback during training. A foundational challenge in this…

Machine Learning · Computer Science 2026-05-07 Zhen-Yu Zhang , Yuting Tang , Jiandong Zhang , Lanjihong Ma , Masashi Sugiyama

AI-assisted task delegation is increasingly common, yet human effort in such systems is costly and typically unobserved. Recent work by Bastani and Cachon (2025); Sambasivan et al. (2021) shows that accuracy-based payment schemes suffer…

Machine Learning · Statistics 2026-03-31 Qichuan Yin , Ziwei Su , Shuangning Li

The query-based moment retrieval is a problem of localising a specific clip from an untrimmed video according a query sentence. This is a challenging task that requires interpretation of both the natural language query and the video…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä

Video-based person recognition achieves robust identification by integrating face, body, and gait. However, current systems waste computational resources by processing all modalities with fixed heavyweight ensembles regardless of input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuyang Ji , Yixuan Shen , Kien Nguyen , Lifeng Zhou , Feng Liu

A learner aims to minimize a function $f$ by repeatedly querying a distributed oracle that provides noisy gradient evaluations. At the same time, the learner seeks to hide $\arg\min f$ from a malicious eavesdropper that observes the…

Machine Learning · Computer Science 2023-08-21 Adit Jain , Vikram Krishnamurthy

Human cooperation depends on how accurately we infer others' motives--how much they value fairness, generosity, or self-interest from the choices they make. We model that process in binary dictator games, which isolate moral trade-offs…

Neurons and Cognition · Quantitative Biology 2025-11-12 Gregory Stanley , Jun Zhang , Rick Lewis

Reward shaping is critical in reinforcement learning (RL), particularly for complex tasks where sparse rewards can hinder learning. However, choosing effective shaping rewards from a set of reward functions in a computationally efficient…

Machine Learning · Computer Science 2025-02-26 Chen Bo Calvin Zhang , Zhang-Wei Hong , Aldo Pacchiano , Pulkit Agrawal

We study a fundamental problem in optimization under uncertainty. There are $n$ boxes; each box $i$ contains a hidden reward $x_i$. Rewards are drawn i.i.d. from an unknown distribution $\mathcal{D}$. For each box $i$, we see $y_i$, an…

Computer Science and Game Theory · Computer Science 2023-07-13 Kamyar Azizzadenesheli , Trung Dang , Aranyak Mehta , Alexandros Psomas , Qian Zhang

This paper has been withdrawn by the authors. We present a framework for sequential decision making in problems described by graphical models. The setting is given by dependent discrete random variables with associated costs or revenues. In…

Applications · Statistics 2013-07-01 Gabriele Martinelli , Jo Eidsvik , Ragnar Hauge

Instruction tuning has been proven effective in enhancing zero-shot generalization across various tasks and in improving the performance of specific tasks. For task-specific improvements, strategically selecting and training on related…

Computation and Language · Computer Science 2024-10-18 Changho Lee , Janghoon Han , Seonghyeon Ye , Stanley Jungkyu Choi , Honglak Lee , Kyunghoon Bae

In AI-assisted decision-making, effective hybrid (human-AI) teamwork is not solely dependent on AI performance alone, but also on its impact on human decision-making. While prior work studies the effects of model accuracy on humans, we…

Human-Computer Interaction · Computer Science 2022-02-25 Andi Peng , Besmira Nushi , Emre Kiciman , Kori Inkpen , Ece Kamar

In this paper, we seek to answer what-if questions - i.e., given recorded data of an existing deployed networked system, what would be the performance impact if we changed the design of the system (a task also known as causal inference). We…

Networking and Internet Architecture · Computer Science 2022-08-29 Chandan Bothra , Jianfei Gao , Sanjay Rao , Bruno Ribeiro

Decision making or scientific discovery pipelines such as job hiring and drug discovery often involve multiple stages: before any resource-intensive step, there is often an initial screening that uses predictions from a machine learning…

Methodology · Statistics 2023-05-30 Ying Jin , Emmanuel J. Candès

Self-supervised learning methods are attractive candidates for automatic object picking. However, the trial samples lack the complete ground truth because the observable parts of the agent are limited. That is, the information contained in…

Robotics · Computer Science 2023-10-04 Kanata Suzuki , Yasuto Yokota , Yuzi Kanazawa , Tomoyoshi Takebayashi

Computer vision algorithms are known to be extremely sensitive to the environmental conditions in which the data is captured, e.g., lighting conditions and target density. Tuning of parameters or choosing a completely new algorithm is often…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Shu Zhang , Qi Zhu , Amit Roy-Chowdhury

Understanding human intentions is critical for safe and effective human-robot collaboration. While state of the art methods for human goal prediction utilize learned models to account for the uncertainty of human motion data, that data is…

Robotics · Computer Science 2024-01-24 Yi-Shiuan Tung , Matthew B. Luebbers , Alessandro Roncone , Bradley Hayes

Learning collaborative behaviors is essential for multi-agent systems. Traditionally, multi-agent reinforcement learning solves this implicitly through a joint reward and centralized observations, assuming collaborative behavior will…

Robotics · Computer Science 2025-02-27 Zhengran Ji , Lingyu Zhang , Paul Sajda , Boyuan Chen

Despite the advantages of having robot swarms, human supervision is required for real-world applications. The performance of the human-swarm system depends on several factors including the data availability for the human operators. In this…

Human-Computer Interaction · Computer Science 2023-07-18 Ayodeji O. Abioye , Mohammad Naiseh , William Hunt , Jediah Clark , Sarvapali D. Ramchurn , Mohammad D. Soorati

In cellular systems, virtual multiple-input multiple-output (V-MIMO) technology promises to achieve performance gains comparable to conventional MIMO. In this paper, we propose cooperative relay selection algorithm based on machine learning…

Networking and Internet Architecture · Computer Science 2015-06-08 Kunal Sankhe , Chandan Pradhan , Sumit Kumar , Garimella Ramamurthy

Real-world black-box optimization often involves time-consuming or costly experiments and simulations. Multi-fidelity optimization (MFO) stands out as a cost-effective strategy that balances high-fidelity accuracy with computational…

Machine Learning · Computer Science 2024-02-16 Ke Li , Fan Li