English
Related papers

Related papers: AdaFlow: Imitation Learning with Variance-Adaptive…

200 papers

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

Machine Learning · Computer Science 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

Autonomous driving requires reasoning about interactions with surrounding traffic. A prevailing approach is large-scale imitation learning on expert driving datasets, aimed at generalizing across diverse real-world scenarios. For online…

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

Machine Learning · Computer Science 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

Generative Behavior Cloning (GBC) is a simple yet effective framework for robot learning, particularly in multi-task settings. Recent GBC methods often employ diffusion policies with open-loop (OL) control, where actions are generated via a…

Robotics · Computer Science 2025-10-15 Junhyuk So , Chiwoong Lee , Shinyoung Lee , Jungseul Ok , Eunhyeok Park

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

Machine Learning · Computer Science 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

Learning from observation (LfO) aims to imitate experts by learning from state-only demonstrations without requiring action labels. Existing adversarial imitation learning approaches learn a generator agent policy to produce state…

Machine Learning · Computer Science 2024-10-10 Bo-Ruei Huang , Chun-Kai Yang , Chun-Mao Lai , Dai-Jie Wu , Shao-Hua Sun

Robotic manipulation in unstructured environments requires the generation of robust and long-horizon trajectory-level policy with conditions of perceptual observations and benefits from the advantages of SE(3)-equivariant diffusion models…

Robotics · Computer Science 2025-09-30 Zhitao Wang , Yanke Wang , Jiangtao Wen , Roberto Horowitz , Yuxing Han

Decision-focused learning (DFL) integrates predictive modeling and optimization by training predictors to optimize the downstream decision target rather than merely minimizing prediction error. To date, existing DFL methods typically rely…

Machine Learning · Computer Science 2025-10-14 Zihao Zhao , Christopher Yeh , Lingkai Kong , Kai Wang

Beyond estimating parameters of interest from data, one of the key goals of statistical inference is to properly quantify uncertainty in these estimates. In Bayesian inference, this uncertainty is provided by the posterior distribution, the…

Machine Learning · Computer Science 2025-01-03 Daniela de Albuquerque , John Pearson

Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy…

Machine Learning · Computer Science 2023-12-13 Bingzheng Wang , Guoqiang Wu , Teng Pang , Yan Zhang , Yilong Yin

Learning from demonstrations in embodied control is often cast as behavioral cloning, and recent diffusion or flow-matching policies improve this paradigm by modeling multi-modal expert actions. Yet these methods remain offline supervised…

Machine Learning · Computer Science 2026-05-27 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor W. Tsang , Yang You

We propose an inference-time scaling approach for pretrained flow models. Recently, inference-time scaling has gained significant attention in LLMs and diffusion models, improving sample quality or better aligning outputs with user…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jaihoon Kim , Taehoon Yoon , Jisung Hwang , Minhyuk Sung

Diffusion and flow matching policies have recently demonstrated remarkable performance in robotic applications by accurately capturing multimodal robot trajectory distributions. However, their computationally expensive inference, due to the…

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

Sound · Computer Science 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow training is notoriously unstable, with non-decreasing loss and…

Machine Learning · Computer Science 2026-05-12 Juanwu Lu , Ziran Wang

Recent advances in hierarchical robot systems leverage a high-level planner to propose task plans and a low-level policy to generate robot actions. This design allows training the planner on action-free or even non-robot data sources (e.g.,…

Robotics · Computer Science 2026-02-13 Yitian Zheng , Zhangchen Ye , Weijun Dong , Shengjie Wang , Yuyang Liu , Chongjie Zhang , Chuan Wen , Yang Gao

Limited by inference latency, existing robot manipulation policies lack sufficient real-time interaction capability with the environment. Although faster generation methods such as flow matching are gradually replacing diffusion methods,…

Robotics · Computer Science 2026-02-17 Zhenchen Dong , Jinna Fu , Jiaming Wu , Shengyuan Yu , Fulin Chen , Yide Liu

Imitation learning, particularly Diffusion Policies based methods, has recently gained significant traction in embodied AI as a powerful approach to action policy generation. These models efficiently generate action policies by learning to…

Robotics · Computer Science 2025-04-15 Haiyong Yu , Yanqiong Jin , Yonghao He , Wei Sui

Diffusion Q-Learning (DQL) has established diffusion policies as a high-performing paradigm for offline reinforcement learning, but its reliance on multi-step denoising for action generation renders both training and inference slow and…

Machine Learning · Computer Science 2026-02-25 Thanh Nguyen , Chang D. Yoo

We tackle unsupervised anomaly detection (UAD), a problem of detecting data that significantly differ from normal data. UAD is typically solved by using density estimation. Recently, deep neural network (DNN)-based density estimators, such…

Machine Learning · Statistics 2019-03-14 Masataka Yamaguchi , Yuma Koizumi , Noboru Harada