English
Related papers

Related papers: Flow-based Intrinsic Curiosity Module

200 papers

The autonomous learning of new goals in robotics remains a complex issue to address. Here, we propose a model where curiosity influence learning flexibility. To do so, this paper proposes to root curiosity and attention together by taking…

Robotics · Computer Science 2025-09-22 Quentin Houbre , Roel Pieters

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Large language model (LLM) pruning with fixed N:M structured sparsity significantly limits the expressivity of the sparse model, yielding sub-optimal performance. In contrast, supporting multiple N:M patterns to provide sparse…

Machine Learning · Computer Science 2025-04-22 Akshat Ramachandran , Souvik Kundu , Arnab Raha , Shamik Kundu , Deepak K. Mathaikutty , Tushar Krishna

Discrete choice models (DCM) are widely employed in travel demand analysis as a powerful theoretical econometric framework for understanding and predicting choice behaviors. DCMs are formed as random utility models (RUM), with their key…

Machine Learning · Computer Science 2023-06-02 Shadi Haj-Yahia , Omar Mansour , Tomer Toledo

The sparsity of extrinsic rewards poses a serious challenge for reinforcement learning (RL). Currently, many efforts have been made on curiosity which can provide a representative intrinsic reward for effective exploration. However, the…

Artificial Intelligence · Computer Science 2023-11-21 Zijian Gao , YiYing Li , Kele Xu , Yuanzhao Zhai , Dawei Feng , Bo Ding , XinJun Mao , Huaimin Wang

In this paper, we focus on the problem of inferring the underlying reward function of an expert given demonstrations, which is often referred to as inverse reinforcement learning (IRL). In particular, we propose a model-free density-based…

Robotics · Computer Science 2016-10-03 Sungjoon Choi , Kyungjae Lee , Andy Park , Songhwai Oh

Continuous normalizing flows (CNFs) can model data distributions with expressive infinite-length architectures. But this modeling involves computationally expensive process of solving an ordinary differential equation (ODE) during maximum…

Machine Learning · Computer Science 2024-10-15 Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata

In environments with sparse rewards, finding a good inductive bias for exploration is crucial to the agent's success. However, there are two competing goals: novelty search and systematic exploration. While existing approaches such as…

Machine Learning · Computer Science 2023-08-31 Stefan Sylvius Wagner , Peter Arndt , Jan Robine , Stefan Harmeling

Multi-agent deep reinforcement learning (MADRL) problems often encounter the challenge of sparse rewards. This challenge becomes even more pronounced when coordination among agents is necessary. As performance depends not only on one…

Multiagent Systems · Computer Science 2024-02-07 Maxime Toquebiau , Nicolas Bredeche , Faïz Benamar , Jae-Yun Jun

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Estimating the correspondences between pixels in sequences of images is a critical first step for a myriad of tasks including vision-aided navigation (e.g., visual odometry (VO), visual-inertial odometry (VIO), and visual simultaneous…

Image and Video Processing · Electrical Eng. & Systems 2018-03-16 E. Jared Shamwell , William D. Nothwang , Donald Perlis

Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jifeng Shen , Haibo Zhan , Xin Zuo , Heng Fan , Xiaohui Yuan , Jun Li , Wankou Yang

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

Machine Learning · Statistics 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

Current video understanding models rely on fixed frame sampling strategies, processing predetermined visual inputs regardless of the specific reasoning requirements of each question. This static approach limits their ability to adaptively…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Haonan Ge , Yiwei Wang , Kai-Wei Chang , Hang Wu , Yujun Cai

As entertainment robots gain popularity, the demand for natural and expressive motion, particularly in dancing, continues to rise. Traditionally, dancing motions have been manually designed by artists, a process that is both labor-intensive…

Robotics · Computer Science 2025-02-26 Ryo Watanabe , Chenhao Li , Marco Hutter

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Model-based reinforcement learning (MBRL) with real-time planning has shown great potential in locomotion and manipulation control tasks. However, the existing planning methods, such as the Cross-Entropy Method (CEM), do not scale well to…

Machine Learning · Computer Science 2023-09-12 Mostafa Kotb , Cornelius Weber , Stefan Wermter

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

Recent advances in deep learning renewed the research interests in machine learning for Network Intrusion Detection Systems (NIDS). Specifically, attention has been given to sequential learning models, due to their ability to extract the…

Cryptography and Security · Computer Science 2022-07-06 Andrea Corsini , Shanchieh Jay Yang , Giovanni Apruzzese

Flow map learning (FML), in conjunction with deep neural networks (DNNs), has shown promises for data driven modeling of unknown dynamical systems. A remarkable feature of FML is that it is capable of producing accurate predictive models…

Machine Learning · Computer Science 2023-07-21 Victor Churchill , Dongbin Xiu