English
Related papers

Related papers: Improving Environment Novelty Quantification for E…

200 papers

Autonomous agents trained using deep reinforcement learning (RL) often lack the ability to successfully generalise to new environments, even when these environments share characteristics with the ones they have encountered during training.…

Machine Learning · Computer Science 2024-06-17 Samuel Garcin , James Doran , Shangmin Guo , Christopher G. Lucas , Stefano V. Albrecht

We propose UAD, a method for vision-based end-to-end autonomous driving (E2EAD), achieving the best open-loop evaluation performance in nuScenes, meanwhile showing robust closed-loop driving quality in CARLA. Our motivation stems from the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Mingzhe Guo , Zhipeng Zhang , Yuan He , Ke Wang , Liping Jing

Humans do not memorize everything. Thus, humans recognize scene changes by exploring the past images. However, available past (i.e., reference) images typically represent nearby viewpoints of the present (i.e., query) scene, rather than the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Kyusik Cho , Suhan Woo , Hongje Seong , Euntai Kim

Deep reinforcement learning (RL) approaches have been broadly applied to a large number of robotics tasks, such as robot manipulation and autonomous driving. However, an open problem in deep RL is learning policies that are robust to…

Robotics · Computer Science 2023-12-19 Rohan Banerjee , Prishita Ray , Mark Campbell

Applying pseudo labeling techniques has been found to be advantageous in semi-supervised 3D object detection (SSOD) in Bird's-Eye-View (BEV) for autonomous driving, particularly where labeled data is limited. In the literature, Exponential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Saheli Hazra , Sudip Das , Rohit Choudhary , Arindam Das , Ganesh Sistu , Ciaran Eising , Ujjwal Bhattacharya

Ensemble learning aims to improve generalization ability by using multiple base learners. It is well-known that to construct a good ensemble, the base learners should be accurate as well as diverse. In this paper, unlabeled data is…

Machine Learning · Computer Science 2010-09-28 Min-Ling Zhang , Zhi-Hua Zhou

In Reinforcement Learning (RL), an agent explores the environment and collects trajectories into the memory buffer for later learning. However, the collected trajectories can easily be imbalanced with respect to the achieved goal states.…

Machine Learning · Computer Science 2020-05-27 Rui Zhao , Volker Tresp

Masked image modeling has been demonstrated as a powerful pretext task for generating robust representations that can be effectively generalized across multiple downstream tasks. Typically, this approach involves randomly masking patches…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Neelu Madan , Nicolae-Catalin Ristea , Kamal Nasrollahi , Thomas B. Moeslund , Radu Tudor Ionescu

Large language model based agents are increasingly deployed in complex, tool augmented environments. While reinforcement learning provides a principled mechanism for such agents to improve through interaction, its effectiveness critically…

Artificial Intelligence · Computer Science 2025-12-04 Shinji Mai , Yunpeng Zhai , Ziqian Chen , Cheng Chen , Anni Zou , Shuchang Tao , Zhaoyang Liu , Bolin Ding

Recent advances in self-evolution video understanding frameworks have demonstrated the potential of autonomous learning without human annotations. However, existing methods often suffer from weakly controlled optimization and uncontrolled…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Guiyi Zeng , Junqing Yu , Yi-Ping Phoebe Chen , Xu Chen , Wei Yang , Zikai Song

We consider the problem of teaching via demonstrations in sequential decision-making settings. In particular, we study how to design a personalized curriculum over demonstrations to speed up the learner's convergence. We provide a unified…

Machine Learning · Computer Science 2021-12-17 Gaurav Yengera , Rati Devidze , Parameswaran Kamalaruban , Adish Singla

A major challenge for reinforcement learning is automatically generating curricula to reduce training time or improve performance in some target task. We introduce SEBNs (Skill-Environment Bayesian Networks) which model a probabilistic…

Artificial Intelligence · Computer Science 2025-02-24 Vincent Hsiao , Mark Roberts , Laura M. Hiatt , George Konidaris , Dana Nau

The focus of this study is on Unsupervised Continual Learning (UCL), as it presents an alternative to Supervised Continual Learning which needs high-quality manual labeled data. The experiments under the UCL paradigm indicate a phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chen Cheng , Jingkuan Song , Xiaosu Zhu , Junchen Zhu , Lianli Gao , Hengtao Shen

Recovering a globally accurate complex physics field from limited sensor is critical to the measurement and control in the aerospace engineering. General reconstruction methods for recovering the field, especially the deep learning with…

Machine Learning · Computer Science 2023-02-24 Yunyang Zhang , Zhiqiang Gong , Xiaoyu Zhao , Wen Yao

Unsupervised domain adaptation (UDA) aims at inferring class labels for unlabeled target domain given a related labeled source dataset. Intuitively, a model trained on source domain normally produces higher uncertainties for unseen data. In…

Machine Learning · Computer Science 2019-07-26 Ligong Han , Yang Zou , Ruijiang Gao , Lezi Wang , Dimitris Metaxas

Many real-world problems are compositional - solving them requires completing interdependent sub-tasks, either in series or in parallel, that can be represented as a dependency graph. Deep reinforcement learning (RL) agents often struggle…

Machine Learning · Computer Science 2022-01-25 Izzeddin Gur , Natasha Jaques , Yingjie Miao , Jongwook Choi , Manoj Tiwari , Honglak Lee , Aleksandra Faust

Universities are microcosms of urban ecosystems, with concentrated consumption patterns in food, transport, energy, and product usage. These environments not only contribute substantially to sustainability pressures but also provide a…

Human-Computer Interaction · Computer Science 2026-04-20 Caleb Adu , Neil Kapadia , Binhe Liu , Jonathan Randall , Sruthi Viswanathan

Unsupervised Camouflaged Object Detection (UCOD) remains a challenging task due to the high intrinsic similarity between target objects and their surroundings, as well as the reliance on noisy pseudo-labels that hinder fine-grained texture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Shuo Jiang , Gaojia Zhang , Min Tan , Yufei Yin , Gang Pan

Concrete is the most widely used engineered material in the world with more than 10 billion tons produced annually. Unfortunately, with that scale comes a significant burden in terms of energy, water, and release of greenhouse gases and…

Artificial Intelligence · Computer Science 2019-05-21 Xiou Ge , Richard T. Goodwin , Jeremy R. Gregory , Randolph E. Kirchain , Joana Maria , Lav R. Varshney

Recent curriculum Reinforcement Learning (RL) has shown notable progress in solving complex tasks by proposing sequences of surrogate tasks. However, the previous approaches often face challenges when they generate curriculum goals in a…

Machine Learning · Computer Science 2023-10-27 Seungjae Lee , Daesol Cho , Jonghae Park , H. Jin Kim