English
Related papers

Related papers: Attention-Driven Hierarchical Reinforcement Learni…

200 papers

Hierarchical abstraction and curiosity-driven exploration are two common paradigms in current reinforcement learning approaches to break down difficult problems into a sequence of simpler ones and to overcome reward sparsity. However, there…

Machine Learning · Computer Science 2020-08-18 Frank Röder , Manfred Eppe , Phuong D. H. Nguyen , Stefan Wermter

To achieve scenario intelligence, humans must transfer knowledge to robots by developing goal-oriented algorithms, which are sometimes insensitive to dynamically changing environments. While deep reinforcement learning achieves significant…

Artificial Intelligence · Computer Science 2018-07-31 Tingguang Li , Jin Pan , Delong Zhu , Max Q. -H. Meng

With the deterioration of climate, the phenomenon of rain-induced flooding has become frequent. To mitigate its impact, recent works adopt convolutional neural network or its variants to predict the floods. However, these methods directly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Feifei Wang , Yong Wang , Bing Li , Qidong Huang , Shaoqing Chen

We develop a framework for localized source detection in dynamical systems governed by nonlinear partial differential equations based on first and second-order sensitivity analysis. Building on the standard adjoint formulation, which…

Fluid Dynamics · Physics 2026-05-18 Qi Wang , Zejian You

Object parsing and segmentation from point clouds are challenging tasks because the relevant data is available only as thin structures along object boundaries or other features, and is corrupted by large amounts of noise. To handle this…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 Adrian Barbu

Reinforcement Learning (RL) algorithms can suffer from poor sample efficiency when rewards are delayed and sparse. We introduce a solution that enables agents to learn temporally extended actions at multiple levels of abstraction in a…

Machine Learning · Computer Science 2019-03-11 Andrew Levy , Robert Platt , Kate Saenko

Graph-based Retrieval-Augmented Generation (GraphRAG) frameworks face a trade-off between the comprehensiveness of global search and the efficiency of local search. Existing methods are often challenged by navigating large-scale…

Information Retrieval · Computer Science 2026-01-30 Yuejie Li , Ke Yang , Tao Wang , Bolin Chen , Bowen Li , Chengjun Mao

Multisource domain adaptation (MDA) aims to use multiple source datasets with available labels to infer labels on a target dataset without available labels for target supervision. Prior works on MDA in the literature is ad-hoc as the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Alexander M. Glandon , Khan M. Iftekharuddin

This work pushes the boundaries of learning-based methods in autonomous robot exploration in terms of environmental scale and exploration efficiency. We present HEADER, an attention-based reinforcement learning approach with hierarchical…

Robotics · Computer Science 2025-10-20 Yuhong Cao , Yizhuo Wang , Jingsong Liang , Shuhao Liao , Yifeng Zhang , Peizhuo Li , Guillaume Sartoretti

Modeling complex spatiotemporal dynamics, particularly in far-from-equilibrium systems, remains a grand challenge in science. The governing partial differential equations (PDEs) for these systems are often intractable to derive from first…

Machine Learning · Computer Science 2026-01-26 Xizhe Wang , Xiaobin Song , Qingshan Jia , Hao Sun , Hongbo Zhao , Benben Jiang

Particle filters are computational techniques for estimating the state of dynamical systems by integrating observational data with model predictions. This work introduces a class of Localized Particle Filters (LPFs) that exploit spatial…

Applications · Statistics 2025-07-10 Dan Crisan , Eliana Fausti

Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for…

Machine Learning · Computer Science 2021-05-04 Xudong Sun , Jiali Lin , Bernd Bischl

This paper presents an Impedance Primitive-augmented hierarchical reinforcement learning framework for efficient robotic manipulation in sequential contact tasks. We leverage this hierarchical structure to sequentially execute behavior…

Robotics · Computer Science 2025-08-28 Amin Berjaoui Tahmaz , Ravi Prakash , Jens Kober

Deep hierarchical reinforcement learning has gained a lot of attention in recent years due to its ability to produce state-of-the-art results in challenging environments where non-hierarchical frameworks fail to learn useful policies.…

Artificial Intelligence · Computer Science 2018-05-21 Marc Brittain , Peng Wei

In this article, we use artificial intelligence algorithms to show how to enhance the resolution of the elementary particle track fitting in inhomogeneous dense detectors, such as plastic scintillators. We use deep learning to replace more…

Data Analysis, Statistics and Probability · Physics 2023-06-21 Saúl Alonso-Monsalve , Davide Sgalaberna , Xingyu Zhao , Clark McGrew , André Rubbia

When related learning tasks are naturally arranged in a hierarchy, an appealing approach for coping with scarcity of instances is that of transfer learning using a hierarchical Bayes framework. As fully Bayesian computations can be…

Machine Learning · Computer Science 2012-06-18 Gal Elidan , Ben Packer , Geremy Heitz , Daphne Koller

Establishing the correct correspondence of feature points is a fundamental task in computer vision. However, the presence of numerous outliers among the feature points can significantly affect the matching results, reducing the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shuyuan Lin , Yu Guo , Xiao Chen , Yanjie Liang , Guobao Xiao , Feiran Huang

Feature transformation aims to generate new pattern-discriminative feature space from original features to improve downstream machine learning (ML) task performances. However, the discrete search space for the optimal feature explosively…

Machine Learning · Computer Science 2023-09-26 Dongjie Wang , Meng Xiao , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

We propose a Bayesian neural network-based continual learning algorithm using Variational Inference, aiming to overcome several drawbacks of existing methods. Specifically, in continual learning scenarios, storing network parameters at each…

Machine Learning · Computer Science 2024-11-22 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz