English
Related papers

Related papers: Guided Streaming Stochastic Interpolant Policy

200 papers

This paper introduces a Spiking Diffusion Policy (SDP) learning method for robotic manipulation by integrating Spiking Neurons and Learnable Channel-wise Membrane Thresholds (LCMT) into the diffusion policy model, thereby enhancing…

Robotics · Computer Science 2024-09-18 Zhixing Hou , Maoxu Gao , Hang Yu , Mengyu Yang , Chio-In Ieong

Training-free diffusion guidance offers a flexible framework for leveraging off-the-shelf classifiers without additional training. Yet, current approaches hinge on posterior approximations via Tweedie's formula, which often yield unreliable…

Machine Learning · Computer Science 2026-05-19 Van Khoa Nguyen , Lionel Blondé , Alexandros Kalousis

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

This paper presents a novel Stochastic Optimal Control (SOC) method based on Model Predictive Path Integral control (MPPI), named Stein Variational Guided MPPI (SVG-MPPI), designed to handle rapidly shifting multimodal optimal action…

Robotics · Computer Science 2024-03-04 Kohei Honda , Naoki Akai , Kosuke Suzuki , Mizuho Aoki , Hirotaka Hosogaya , Hiroyuki Okuda , Tatsuya Suzuki

Generative modeling has recently shown remarkable promise for visuomotor policy learning, enabling flexible and expressive control across diverse embodied AI tasks. However, existing generative policies often struggle with data…

Robotics · Computer Science 2025-12-16 Jianlei Chang , Ruofeng Mei , Wei Ke , Xiangyu Xu

Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay…

Optimization and Control · Mathematics 2021-01-19 Hidekazu Yoshioka , Yuta Yaegashi

We present a policy search method for learning complex feedback control policies that map from high-dimensional sensory inputs to motor torques, for manipulation tasks with discontinuous contact dynamics. We build on a prior technique…

Robotics · Computer Science 2018-10-15 Yevgen Chebotar , Mrinal Kalakrishnan , Ali Yahya , Adrian Li , Stefan Schaal , Sergey Levine

The stochastic interpolant framework offers a powerful approach for constructing generative models based on ordinary differential equations (ODEs) or stochastic differential equations (SDEs) to transform arbitrary data distributions.…

Machine Learning · Computer Science 2025-07-29 Yuhao Liu , Yu Chen , Rui Hu , Longbo Huang

In gradient-based learning, a step size chosen in parameter units does not produce a predictable per-step change in function output. This often leads to instability in the streaming setting (i.e., batch size=1), where stochasticity is not…

Machine Learning · Computer Science 2026-04-22 Arsalan Sharifnassab , Mohamed Elsayed , Kris De Asis , A. Rupam Mahmood , Richard S. Sutton

Gaussian Processes (GPs), as a nonparametric learning method, offer flexible modeling capabilities and calibrated uncertainty quantification for function approximations. Additionally, GPs support online learning by efficiently incorporating…

Machine Learning · Computer Science 2025-11-18 Zewen Yang , Dongfa Zhang , Xiaobing Dai , Fengyi Yu , Chi Zhang , Bingkun Huang , Hamid Sadeghian , Sami Haddadin

Reinforcement learning is essential for neural architecture search and hyperparameter optimization, but the conventional approaches impede widespread use due to prohibitive time and computational costs. Inspired by DeepSeek-V3 multi-token…

Machine Learning · Computer Science 2025-06-19 Zheng Li , Jerry Cheng , Huanying Helen Gu

We formalize action emergence as a target capability for end-to-end autonomous driving: the ability to generate physically feasible, semantically appropriate, and safety-compliant actions in arbitrary, long-tail traffic scenes through…

Robotics · Computer Science 2026-05-15 Pengfei Jing , Victor Shea-Jay Huang , Hengtong Lu , Jifeng Dai , Yan Xie , Benjin Zhu

Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancement is constrained by the high cost of acquiring large-scale…

This paper proposes a fully data-driven approach for optimal control of nonlinear control-affine systems represented by a stochastic diffusion. The focus is on the scenario where both the nonlinear dynamics and stage cost functions are…

Optimization and Control · Mathematics 2025-11-03 Nicolas Hoischen , Petar Bevanda , Stefan Sosnowski , Sandra Hirche , Boris Houska

Human trajectory forecasting is important for intelligent multimedia systems operating in visually complex environments, such as autonomous driving and crowd surveillance. Although Conditional Flow Matching (CFM) has shown strong ability in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xuepeng Jing , Wenhuan Lu , Hao Meng , Zhizhi Yu , Jianguo Wei

We develop and analyze algorithms for instrumental variable regression by viewing the problem as a conditional stochastic optimization problem. In the context of least-squares instrumental variable regression, our algorithms neither require…

Machine Learning · Statistics 2024-05-31 Xuxing Chen , Abhishek Roy , Yifan Hu , Krishnakumar Balasubramanian

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Rectified Flow (RF) models achieve state-of-the-art generation quality, yet controlling them for precise tasks -- such as semantic editing or blind image recovery -- remains a challenge. Current approaches bifurcate into inversion-based…

Machine Learning · Computer Science 2026-03-09 Vansh Bansal , James G Scott

Dynamic behaviors are becoming prevalent in tensor applications, like machine learning, where many widely used models contain data-dependent tensor shapes and control flow. However, the limited expressiveness of prior programming…

Programming Languages · Computer Science 2026-01-29 Gina Sohn , Genghan Zhang , Konstantin Hossfeld , Jungwoo Kim , Nathan Sobotka , Nathan Zhang , Olivia Hsu , Kunle Olukotun

Classifier-Free Guidance (CFG) is a widely used mechanism for controlling diffusion-based generative models, yet its guidance scale is typically treated as a fixed hyperparameter throughout generation. This static design yields a suboptimal…

Computation and Language · Computer Science 2026-05-11 Fan Zhou , Tim Van de Cruys