English
Related papers

Related papers: Liquid Networks with Mixture Density Heads for Eff…

200 papers

Diffusion Policies have significantly advanced robotic manipulation tasks via imitation learning, but their application on resource-constrained mobile platforms remains challenging due to computational inefficiency and extensive memory…

Robotics · Computer Science 2025-08-04 Yiming Wu , Huan Wang , Zhenghao Chen , Jianxin Pang , Dong Xu

We introduce Invertible Dense Networks (i-DenseNets), a more parameter efficient extension of Residual Flows. The method relies on an analysis of the Lipschitz continuity of the concatenation in DenseNets, where we enforce invertibility of…

Machine Learning · Statistics 2021-10-26 Yura Perugachi-Diaz , Jakub M. Tomczak , Sandjai Bhulai

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

Robotics · Computer Science 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

Robots can acquire complex manipulation skills by learning policies from expert demonstrations, which is often known as vision-based imitation learning. Generating policies based on diffusion and flow matching models has been shown to be…

Robotics · Computer Science 2024-12-17 Qinglun Zhang , Zhen Liu , Haoqiang Fan , Guanghui Liu , Bing Zeng , Shuaicheng Liu

Diffusion policies have achieved great success in online reinforcement learning (RL) due to their strong expressive capacity. However, the inference of diffusion policy models relies on a slow iterative sampling process, which limits their…

Machine Learning · Computer Science 2025-10-17 Tianyi Chen , Haitong Ma , Na Li , Kai Wang , Bo Dai

Reinforcement Learning (RL) has demonstrated its potential to improve the reasoning ability of Large Language Models (LLMs). One major limitation of most existing Reinforcement Finetuning (RFT) methods is that they are on-policy RL in…

Machine Learning · Computer Science 2025-07-14 Jing Liang , Hongyao Tang , Yi Ma , Jinyi Liu , Yan Zheng , Shuyue Hu , Lei Bai , Jianye Hao

This paper proposes a new data-driven approach to model detailed splashes for liquid simulations with neural networks. Our model learns to generate small-scale splash detail for the fluid-implicit-particle method using training data…

Graphics · Computer Science 2018-06-27 Kiwon Um , Xiangyu Hu , Nils Thuerey

Diffusion models have seen rapid adoption in robotic imitation learning, enabling autonomous execution of complex dexterous tasks. However, action synthesis is often slow, requiring many steps of iterative denoising, limiting the extent to…

Robotics · Computer Science 2024-10-14 Sigmund H. Høeg , Yilun Du , Olav Egeland

When applying imitation learning techniques to fit a policy from expert demonstrations, one can take advantage of prior stability/robustness assumptions on the expert's policy and incorporate such control-theoretic prior knowledge…

Optimization and Control · Mathematics 2021-03-25 Aaron Havens , Bin Hu

Fluid motion can be considered as a point cloud transformation when using the SPH method. Compared to traditional numerical analysis methods, using machine learning techniques to learn physics simulations can achieve near-accurate results,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yu Chen , Shuai Zheng , Menglong Jin , Yan Chang , Nianyi Wang

Motivated by the very low diffusivity recently found in ab initio simulations of liquid water, we have studied its dependence with temperature, system size, and duration of the simulations. We use ab initio molecular dynamics (AIMD),…

Soft Condensed Matter · Physics 2009-11-10 M. V. Fernandez-Serra , Emilio Artacho

Imitation learning considerably simplifies policy synthesis compared to alternative approaches by exploiting access to expert demonstrations. For such imitation policies, errors away from the training samples are particularly critical. Even…

Machine Learning · Computer Science 2024-03-19 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , James Weimer , Insup Lee

Approximating model predictive control (MPC) using imitation learning (IL) allows for fast control without solving expensive optimization problems online. However, methods that use neural networks in a simple L2-regression setup fail to…

Diffusion models have been leveraged to perform adversarial purification and thus provide both empirical and certified robustness for a standard model. On the other hand, different robustly trained smoothed models have been studied to…

Machine Learning · Computer Science 2023-08-29 Jiawei Zhang , Zhongzhu Chen , Huan Zhang , Chaowei Xiao , Bo Li

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Imitation learning for robotic tasks has relied primarily on policies trained only on successful demonstrations, although failures are unavoidable during human data collection. Many existing approaches for exploiting failure data require…

Robotics · Computer Science 2026-05-21 Kana Miyamoto , Kanata Suzuki , Tetsuya Ogata

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear…

Machine Learning · Computer Science 2020-12-16 Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus , Radu Grosu

Recent advances in diffusion$/$flow-matching policies have enabled imitation learning of complex, multi-modal action trajectories. However, they are computationally expensive because they sample a trajectory of trajectories: a…

Diffusion models have recently emerged as expressive policy representations for online reinforcement learning (RL). However, their iterative generative processes introduce substantial training and inference overhead. To overcome this…

Machine Learning · Computer Science 2026-04-17 Xiaoyi Dong , Xi Sheryl Zhang , Jian Cheng

The deployment of agile autonomous systems in challenging, unstructured environments requires adaptation capabilities and robustness to uncertainties. Existing robust and adaptive controllers, such as those based on model predictive control…

Robotics · Computer Science 2023-10-03 Tong Zhao , Andrea Tagliabue , Jonathan P. How