English
Related papers

Related papers: TRACED: Transition-aware Regret Approximation with…

200 papers

Adaptive curricula in reinforcement learning (RL) have proven effective for producing policies robust to discrepancies between the train and test environment. Recently, the Unsupervised Environment Design (UED) framework generalized RL…

Unsupervised reinforcement learning (URL) poses a promising paradigm to learn useful behaviors in a task-agnostic environment without the guidance of extrinsic rewards to facilitate the fast adaptation of various downstream tasks. Previous…

Machine Learning · Computer Science 2023-02-23 Yifu Yuan , Jianye Hao , Fei Ni , Yao Mu , Yan Zheng , Yujing Hu , Jinyi Liu , Yingfeng Chen , Changjie Fan

Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training.…

Machine Learning · Computer Science 2024-06-17 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

Unsupervised Domain Adaptation (UDA) essentially trades a model's performance on a source domain for improving its performance on a target domain. To overcome this, Unsupervised Domain Expansion (UDE) has been introduced, which adapts the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Hailan Lin , Qijie Wei , Kaibin Tian , Ruixiang Zhao , Xirong Li

Diffusion models have emerged as the mainstream approach for visual generation. However, these models typically suffer from sample inefficiency and high training costs. Consequently, methods for efficient finetuning, inference and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Felix Krause , Timy Phan , Ming Gui , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer

In collaborative settings, sustaining momentum and engagement between checkpoints (e.g., meetings) can be challenging, often leading to task drift and reduced preparedness. To address this gap, we developed ReflectEd, an AI-assisted system…

Human-Computer Interaction · Computer Science 2026-03-25 Md Nazmus Sakib , Ishika Tarin , Naga Manogna Rayasam , Manas Gaur , Sanorita Dey

Applying pseudo labeling techniques has been found to be advantageous in semi-supervised 3D object detection (SSOD) in Bird's-Eye-View (BEV) for autonomous driving, particularly where labeled data is limited. In the literature, Exponential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Saheli Hazra , Sudip Das , Rohit Choudhary , Arindam Das , Ganesh Sistu , Ciaran Eising , Ujjwal Bhattacharya

An open problem in Machine Learning is how to avoid models to exploit spurious correlations in the data; a famous example is the background-label shortcut in the Waterbirds dataset. A common remedy is to train a model across multiple…

Machine Learning · Statistics 2025-10-15 Madi Matymov , Ba-Hien Tran , Maurizio Filippone

The electric power sector has seen an increased penetration of renewable energy sources (RESs) that could strain the system reliability due to their inherent uncertainties in availability and controllability. Effective load carrying…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Ethan Cantor , Yinyin Ge , Hongxing Ye , Jie Li

We introduce Unsupervised Partner Design (UPD) - a population-free, multi-agent reinforcement learning framework for robust ad-hoc teamwork that adaptively generates training partners without requiring pretrained partners or manual…

Machine Learning · Computer Science 2025-08-11 Constantin Ruhdorfer , Matteo Bortoletto , Victor Oei , Anna Penzkofer , Andreas Bulling

We propose UAD, a method for vision-based end-to-end autonomous driving (E2EAD), achieving the best open-loop evaluation performance in nuScenes, meanwhile showing robust closed-loop driving quality in CARLA. Our motivation stems from the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Mingzhe Guo , Zhipeng Zhang , Yuan He , Ke Wang , Liping Jing

Recently, in order to address the unsupervised domain adaptation (UDA) problem, extensive studies have been proposed to achieve transferrable models. Among them, the most prevalent method is adversarial domain adaptation, which can shorten…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Han Sun , Lei Lin , Ningzhong Liu , Huiyu Zhou

Open-ended learning methods that automatically generate a curriculum of increasingly challenging tasks serve as a promising avenue toward generally capable reinforcement learning agents. Existing methods adapt curricula independently over…

Agent decision making using Reinforcement Learning (RL) heavily relies on either a model or simulator of the environment (e.g., moving in an 8x8 maze with three rooms, playing Chess on an 8x8 board). Due to this dependence, small changes in…

Artificial Intelligence · Computer Science 2023-09-20 Wenjun Li , Pradeep Varakantham , Dexun Li

In this paper, we consider the problem of building learning agents that can efficiently learn to navigate in constrained environments. The main goal is to design agents that can efficiently learn to understand and generalize to different…

Machine Learning · Computer Science 2020-03-04 Kei Ota , Yoko Sasaki , Devesh K. Jha , Yusuke Yoshiyasu , Asako Kanezaki

Transfer learning has become crucial in computer vision tasks due to the vast availability of pre-trained deep learning models. However, selecting the optimal pre-trained model from a diverse pool for a specific downstream task remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xiaotong Li , Zixuan Hu , Yixiao Ge , Ying Shan , Ling-Yu Duan

Many engineering and scientific workflows rely on expensive black-box evaluations, requiring sequential decisions that must both improve task performance and reduce uncertainty. Bayesian optimization (BO) and Bayesian experimental design…

Machine Learning · Computer Science 2026-05-14 Yingke Li , Anjali Parashar , Enlu Zhou , Chuchu Fan

Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully…

Artificial Intelligence · Computer Science 2026-04-08 Hangoo Kang , Tarun Suresh , Jon Saad-Falcon , Azalia Mirhoseini

Universal online learning aims to achieve optimal regret guarantees without requiring prior knowledge of the curvature of online functions. Existing methods have established minimax-optimal regret bounds for universal online learning, where…

Machine Learning · Computer Science 2025-11-26 Peng Zhao , Yu-Hu Yan , Hang Yu , Zhi-Hua Zhou

Large reasoning models, such as OpenAI o1 and DeepSeek-R1, tend to become increasingly verbose as their reasoning capabilities improve. These inflated Chain-of-Thought (CoT) trajectories often exceed what the underlying problems require,…

Machine Learning · Computer Science 2026-05-12 Songtao Wei , Yi Li , Zhikai Li , Xu Hu , Yuede Ji , Guanpeng Li , Feng Chen , Carl Yang , Zhichun Guo , Bingzhe Li