English
Related papers

Related papers: Better Training Data Attribution via Better Invers…

200 papers

Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need for continuous expert monitoring to recover from failures…

Robotics · Computer Science 2026-04-10 Yiou Huang , Ning Ma , Weichu Zhao , Zinuo Liu , Jun Sun , Qiufeng Wang , Yaran Chen

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

Machine Learning · Computer Science 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

Predicting student performance is a fundamental task in Intelligent Tutoring Systems (ITSs), by which we can learn about students' knowledge level and provide personalized teaching strategies for them. Researchers have made plenty of…

Artificial Intelligence · Computer Science 2021-06-02 Mengfan Liu , Pengyang Shao , Kun Zhang

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Haoxing Chen , Zizheng Huang , Yan Hong , Yanshuo Wang , Zhongcai Lyu , Zhuoer Xu , Jun Lan , Zhangxuan Gu

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

Negotiation requires dynamically balancing self-interest and cooperation within the flow of conversation to maximize one's own utility. Yet, existing agents struggle due to bounded rationality in human data, low adaptability to counterpart…

Computation and Language · Computer Science 2025-09-23 Deuksin Kwon , Jiwon Hae , Emma Clift , Daniel Shamsoddini , Jonathan Gratch , Gale M. Lucas

Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xianxu Hou , Jingxin Liu , Bolei Xu , Xiaolong Wang , Bozhi Liu , Guoping Qiu

Modern reinforcement learning algorithms reach super-human performance on many board and video games, but they are sample inefficient, i.e. they typically require significantly more playing experience than humans to reach an equal…

Machine Learning · Computer Science 2018-06-12 Dane Corneil , Wulfram Gerstner , Johanni Brea

Deep neural networks demonstrate strong performance under aligned training-test distributions. However, real-world test data often exhibit domain shifts. Test-Time Adaptation (TTA) addresses this challenge by adapting the model to test data…

Artificial Intelligence · Computer Science 2025-08-27 Byung-Joon Lee , Jin-Seop Lee , Jee-Hyong Lee

This work proposes a robust Partial Domain Adaptation (PDA) framework that mitigates the negative transfer problem by incorporating a robust target-supervision strategy. It leverages ensemble learning and includes diverse, complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen

Graph-based learning excels at capturing interaction patterns in diverse domains like recommendation, fraud detection, and particle physics. However, its performance often degrades under distribution shifts, especially those altering…

Machine Learning · Computer Science 2026-05-12 Hans Hao-Hsun Hsu , Shikun Liu , Han Zhao , Pan Li

Several proposals have been put forward in recent years for improving out-of-distribution (OOD) performance through mitigating dataset biases. A popular workaround is to train a robust model by re-weighting training examples based on a…

Computation and Language · Computer Science 2023-02-07 Ali Modarressi , Hossein Amirkhani , Mohammad Taher Pilehvar

Adversarial training is an effective defense method to protect classification models against adversarial attacks. However, one limitation of this approach is that it can require orders of magnitude additional training time due to high cost…

Machine Learning · Computer Science 2020-07-03 Haizhong Zheng , Ziqi Zhang , Juncheng Gu , Honglak Lee , Atul Prakash

To determine the optimal set of hyperparameters of a Gaussian process based on a large number of training data, both a linear system and a trace estimation problem must be solved. In this paper, we focus on establishing numerical methods…

Optimization and Control · Mathematics 2023-12-27 Josie König , Max Pfeffer , Martin Stoll

Model-agnostic meta-reinforcement learning requires estimating the Hessian matrix of value functions. This is challenging from an implementation perspective, as repeatedly differentiating policy gradient estimates may lead to biased Hessian…

Machine Learning · Computer Science 2021-11-04 Yunhao Tang , Tadashi Kozuno , Mark Rowland , Rémi Munos , Michal Valko

Parameter-specific adaptive learning rate methods are computationally efficient ways to reduce the ill-conditioning problems encountered when training large deep networks. Following recent work that strongly suggests that most of the…

Machine Learning · Computer Science 2015-09-01 Yann N. Dauphin , Harm de Vries , Yoshua Bengio

Optimizing the learning rate remains a critical challenge in machine learning, essential for achieving model stability and efficient convergence. The Vector Auxiliary Variable (VAV) algorithm introduces a novel energy-based self-adjustable…

Machine Learning · Computer Science 2024-11-12 Jiahao Zhang , Christian Moya , Guang Lin

Reliable models should not only predict correctly, but also justify decisions with acceptable evidence. Yet conventional supervised learning typically provides only class-level labels, allowing models to achieve high accuracy through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Ruoyu Chen , Shangquan Sun , Xiaoqing Guo , Sanyi Zhang , Kangwei Liu , Shiming Liu , Zhangcheng Wang , Qunli Zhang , Hua Zhang , Xiaochun Cao

A core data-centric learning challenge is the identification of training samples that are detrimental to model performance. Influence functions serve as a prominent tool for this task and offer a robust framework for assessing training data…

Machine Learning · Computer Science 2025-11-04 Anshuman Chhabra , Bo Li , Jian Chen , Prasant Mohapatra , Hongfu Liu

Reinforcement learning has been successful across several applications in which agents have to learn to act in environments with sparse feedback. However, despite this empirical success there is still a lack of theoretical understanding of…

Machine Learning · Statistics 2023-11-08 Blake Bordelon , Paul Masset , Henry Kuo , Cengiz Pehlevan