English
Related papers

Related papers: SCRIPT: Scalable Diffusion Policy with Multi-stage…

200 papers

Diffusion policies trained via offline behavioral cloning have recently gained traction in robotic motion generation. While effective, these policies typically require a large number of trainable parameters. This model size affords powerful…

Robotics · Computer Science 2025-04-29 Xiatao Sun , Shuo Yang , Yinxing Chen , Francis Fan , Yiyan Liang , Daniel Rakita

In this work, we present FRIGID, a framework with a novel diffusion language model that generates molecular structures conditioned on mass spectra via intermediate fingerprint representations and determined chemical formulae, training at…

Prompt-based continual learning (CL) provides a parameter-efficient approach for adapting large language models (LLMs) across task sequences. However, most existing methods rely on task-aware inference and maintain a growing set of…

Machine Learning · Computer Science 2025-10-02 Anushka Tiwari , Sayantan Pal , Rohini K. Srihari , Kaiyi Ji

We address dynamic manipulation of deformable linear objects by presenting SPiD, a physics-informed self-supervised learning framework that couples an accurate deformable object model with an augmented self-supervised training strategy. On…

Robotics · Computer Science 2026-02-04 Youyuan Long , Gokhan Solak , Sara Zeynalpour , Heng Zhang , Arash Ajoudani

Skin-friction drag induced by wall-bounded turbulent flows accounts for a substantial fraction of energy consumption across commercial aerospace, wind energy, and marine transport. Its active reduction is one of the highest-value targets in…

Fluid Dynamics · Physics 2026-05-15 Atharva Mahajan , Abhijeet Vishwasrao , Yuning Wang , Ricardo Vinuesa

Humanoid robots can suffer significant performance drops under small changes in dynamics, task specifications, or environment setup. We propose HoRD, a two-stage learning framework for robust humanoid control under domain shift. First, we…

Robotics · Computer Science 2026-03-17 Puyue Wang , Jiawei Hu , Yan Gao , Junyan Wang , Yu Zhang , Gillian Dobbie , Tao Gu , Wafa Johal , Ting Dang , Hong Jia

Humanoid robots are well suited for human habitats due to their morphological similarity, but developing controllers for them is a challenging task that involves multiple sub-problems, such as control, planning and perception. In this…

Robotics · Computer Science 2023-10-11 K. Niranjan Kumar , Irfan Essa , Sehoon Ha

Learning from unstructured and uncurated data has become the dominant paradigm for generative approaches in language and vision. Such unstructured and unguided behavior data, commonly known as play, is also easier to collect in robotics but…

Robotics · Computer Science 2023-12-08 Lili Chen , Shikhar Bahl , Deepak Pathak

Human videos are a scalable source of training data for robot learning. However, humans and robots significantly differ in embodiment, making many human actions infeasible for direct execution on a robot. Still, these demonstrations convey…

Cooperative driving is a safety- and efficiency-critical task that requires the coordination of diverse, interaction-realistic multi-agent trajectories. Although existing diffusion-based methods can capture multimodal behaviors from…

Robotics · Computer Science 2026-05-12 Haojie Bai , Aimin Li , Ruoyu Yao , Xiongwei Zhao , Tingting Zhang , Xing Zhang , Lin Gao , and Jun Ma

Learning a generalist embodied agent capable of completing multiple tasks poses challenges, primarily stemming from the scarcity of action-labeled robotic datasets. In contrast, a vast amount of human videos exist, capturing intricate tasks…

Machine Learning · Computer Science 2024-10-10 Haoran He , Chenjia Bai , Ling Pan , Weinan Zhang , Bin Zhao , Xuelong Li

Model-free reinforcement learning has emerged as a powerful method for developing robust robot control policies capable of navigating through complex and unstructured environments. The effectiveness of these methods hinges on two essential…

Robotics · Computer Science 2025-06-06 Youwei Yu , Junhong Xu , Lantao Liu

Achieving both realism and controllability in closed-loop traffic simulation remains a key challenge in autonomous driving. Dataset-based methods reproduce realistic trajectories but suffer from covariate shift in closed-loop deployment,…

Robotics · Computer Science 2025-09-23 Keyu Chen , Wenchao Sun , Hao Cheng , Sifa Zheng

Recent advances in humanoid whole-body motion tracking have enabled the execution of diverse and highly coordinated motions on real hardware. However, existing controllers are commonly driven either by predefined motion trajectories, which…

Robotics · Computer Science 2026-02-10 Weiji Xie , Jiakun Zheng , Jinrui Han , Jiyuan Shi , Weinan Zhang , Chenjia Bai , Xuelong Li

Current robots struggle with long-horizon manipulation tasks requiring sequences of prehensile and non-prehensile skills, contact-rich interactions, and long-term reasoning. We present $\texttt{SPIN}$ ($\textbf{S}$kill $\textbf{P}$lanning…

Robotics · Computer Science 2025-05-08 Haewon Jung , Donguk Lee , Haecheol Park , JunHyeop Kim , Beomjoon Kim

Language models can be used to provide interactive, personalized student feedback in educational settings. However, real-world deployment faces three key challenges: privacy concerns, limited computational resources, and the need for…

Computation and Language · Computer Science 2025-10-31 Fares Fawzi , Vinitra Swamy , Dominik Glandorf , Tanya Nazaretsky , Tanja Käser

Large Language Models (LLMs) face a fundamental safety-helpfulness trade-off due to static, one-size-fits-all safety policies that lack runtime controllabilityxf, making it difficult to tailor responses to diverse application needs. %As a…

Computation and Language · Computer Science 2026-02-09 Jianfeng Si , Lin Sun , Weihong Lin , Xiangzheng Zhang

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

Physically-simulated models for human motion can generate high-quality responsive character animations, often in real-time. Natural language serves as a flexible interface for controlling these models, allowing expert and non-expert users…

Machine Learning · Computer Science 2024-07-16 Jordan Juravsky , Yunrong Guo , Sanja Fidler , Xue Bin Peng

We propose a two-stage framework for motion in-betweening that combines diffusion-based motion generation with physics-based character adaptation. In Stage 1, a character-agnostic diffusion model synthesizes transitions from sparse…

Graphics · Computer Science 2025-04-15 Jia Qin