English
Related papers

Related papers: Conformalized Interactive Imitation Learning: Hand…

200 papers

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

The ability to accurately predict human behavior is central to the safety and efficiency of robot autonomy in interactive settings. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as…

Robotics · Computer Science 2022-06-07 Haimin Hu , Jaime F. Fisac

Mobile robots navigating in crowds trained using reinforcement learning are known to suffer performance degradation when faced with out-of-distribution scenarios. We propose that by properly accounting for the uncertainties of pedestrians,…

Robotics · Computer Science 2025-08-08 Jianpeng Yao , Xiaopan Zhang , Yu Xia , Zejin Wang , Amit K. Roy-Chowdhury , Jiachen Li

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Instruction fine-tuning (IFT) can increase the informativeness of large language models (LLMs), but may reduce their truthfulness. This trade-off arises because IFT steers LLMs to generate responses containing long-tail knowledge that was…

Computation and Language · Computer Science 2025-06-26 Tianyi Wu , Jingwei Ni , Bryan Hooi , Jiaheng Zhang , Elliott Ash , See-Kiong Ng , Mrinmaya Sachan , Markus Leippold

We propose a novel framework for uncertainty quantification via information bottleneck (IB-UQ) for scientific machine learning tasks, including deep neural network (DNN) regression and neural operator learning (DeepONet). Specifically, we…

Numerical Analysis · Mathematics 2023-05-31 Ling Guo , Hao Wu , Wenwen Zhou , Yan Wang , Tao Zhou

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

Machine Learning · Computer Science 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

Existing deep learning methods have made significant progress in gait representation learning. Quantization can facilitate the application of gait models as a model-agnostic general compression technique. Typically, appearance-based models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 S. Tian , H. Gao , G. Hong , S. Wang , J. Wang , X. Yu , S. Zhang

As an autonomous system performs a task, it should maintain a calibrated estimate of the probability that it will achieve the user's goal. If that probability falls below some desired level, it should alert the user so that appropriate…

Machine Learning · Computer Science 2024-04-04 Alexander Guyer , Thomas G. Dietterich

Reliable, informative, and individual uncertainty quantification (UQ) remains missing in current ML community. This hinders the effective application of AI/ML to risk-sensitive domains. Most methods either fail to provide coverage on new…

Machine Learning · Computer Science 2025-10-20 Amitesh Badkul , Lei Xie

Unreliable predictions can occur when using artificial intelligence (AI) systems with negative consequences for downstream applications, particularly when employed for decision-making. Conformal prediction provides a model-agnostic…

Machine Learning · Computer Science 2024-01-15 Geethen Singh , Glenn Moncrieff , Zander Venter , Kerry Cawse-Nicholson , Jasper Slingsby , Tamara B Robinson

Conformal prediction is a distribution-free method that wraps a given machine learning model and returns a set of plausible labels that contain the true label with a prescribed coverage rate. In practice, the empirical coverage achieved…

Machine Learning · Statistics 2024-05-08 Zhou Wang , Xingye Qiao

Uncertainty estimation is a significant issue for current large language models (LLMs) that are generally poorly calibrated and over-confident, especially with reinforcement learning from human feedback (RLHF). Unlike humans, whose…

Computation and Language · Computer Science 2024-05-13 Ruixin Yang , Dheeraj Rajagopal , Shirley Anugrah Hayati , Bin Hu , Dongyeop Kang

Deep neural networks often produce overconfident predictions, undermining their reliability in safety-critical applications. This miscalibration is further exacerbated under distribution shift, where test data deviates from the training…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Yilin Zhang , Cai Xu , You Wu , Ziyu Guan , Wei Zhao

Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need for continuous expert monitoring to recover from failures…

Robotics · Computer Science 2026-04-10 Yiou Huang , Ning Ma , Weichu Zhao , Zinuo Liu , Jun Sun , Qiufeng Wang , Yaran Chen

Reliable uncertainty estimation for 3D object detection is critical for deploying safe autonomous systems, yet modern detectors remain poorly calibrated, especially under distribution shifts. Although post-hoc calibration methods address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Till Beemelmanns , Alexey Nekrasov , Stefan Vilceanu , Jonas Steinhaus , Timo Woopen , Bastian Leibe , Lutz Eckstein

While modern deep neural networks are performant perception modules, performance (accuracy) alone is insufficient, particularly for safety-critical robotic applications such as self-driving vehicles. Robot autonomy stacks also require these…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Dhaivat Bhatt , Kaustubh Mani , Dishank Bansal , Krishna Murthy , Hanju Lee , Liam Paull

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

Kullback--Leibler (KL) divergence is a fundamental measure of the dissimilarity between two probability distributions, but it can become unstable in high-dimensional settings due to its sensitivity to mismatches in distributional support.…

Information Theory · Computer Science 2025-02-03 Yifeng Peng , Dantong Li , Xinyi Li , Zhiding Liang , Yongshan Ding , Ying Wang

This paper proposes a Koopman-based framework for modeling, prediction, and control of unknown nonlinear time-varying systems. We present a novel Koopman-based learning method for predicting the state of unknown nonlinear time-varying…

Systems and Control · Electrical Eng. & Systems 2026-01-30 Hengde Zhang , Yunxiao Ren , Zhisheng Duan , Zhiyong Sun , Guanrong Chen