English
Related papers

Related papers: CLAD: Constrained Latent Action Diffusion for Visi…

200 papers

We propose a new formulation of temporal action detection (TAD) with denoising diffusion, DiffTAD in short. Taking as input random temporal proposals, it can yield action proposals accurately given an untrimmed long video. This presents a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Sauradip Nag , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang

The rapid progress of auto-regressive vision-language models (VLMs) has inspired growing interest in vision-language-action models (VLA) for robotic manipulation. Recently, masked diffusion models, a paradigm distinct from autoregressive…

Robotics · Computer Science 2025-09-11 Yuqing Wen , Hebei Li , Kefan Gu , Yucheng Zhao , Tiancai Wang , Xiaoyan Sun

Video-based AI systems are increasingly adopted in safety-critical domains such as autonomous driving and healthcare. However, interpreting their decisions remains challenging due to the inherent spatiotemporal complexity of video data and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Payal Varshney , Adriano Lucieri , Christoph Balada , Sheraz Ahmed , Andreas Dengel

Acting in human environments is a crucial capability for general-purpose robots, necessitating a robust understanding of natural language and its application to physical tasks. This paper seeks to harness the capabilities of diffusion…

Robotics · Computer Science 2026-04-28 Jonas Bode , Raphael Memmesheimer , Sven Behnke

Most existing Vision-Language-Action (VLA) models rely primarily on RGB information, while ignoring geometric cues crucial for spatial reasoning and manipulation. In this work, we introduce GLaD, a geometry-aware VLA framework that…

Robotics · Computer Science 2025-12-11 Minghao Guo , Meng Cao , Jiachen Tao , Rongtao Xu , Yan Yan , Xiaodan Liang , Ivan Laptev , Xiaojun Chang

In this work, we propose Causal Autoregressive Diffusion (CARD), a novel framework that unifies the training efficiency of ARMs with the high-throughput inference of diffusion models. CARD reformulates the diffusion process within a…

Computation and Language · Computer Science 2026-01-30 Junhao Ruan , Bei Li , Yongjing Yin , Pengcheng Huang , Xin Chen , Jingang Wang , Xunliang Cai , Tong Xiao , JingBo Zhu

The explosive growth of system logs makes streaming compression essential, yet existing log anomaly detection (LAD) methods incur severe pre-processing overhead by requiring full decompression and parsing. We introduce CLAD, the first deep…

Machine Learning · Computer Science 2026-04-15 Benzhao Tang , Shiyu Yang

Diffusion models have demonstrated strong capabilities for modeling human-like driving behaviors in autonomous driving, but their iterative sampling process induces substantial latency, and operating directly on raw trajectory points forces…

Robotics · Computer Science 2026-03-06 Jinhao Zhang , Wenlong Xia , Zhexuan Zhou , Haoming Song , Youmin Gong , Jie Mei

Generative modeling and clustering are conventionally distinct tasks in machine learning. Variational Autoencoders (VAEs) have been widely explored for their ability to integrate both, providing a framework for generative clustering.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jorge da Silva Gonçalves , Laura Manduchi , Moritz Vandenhirtz , Julia E. Vogt

Text-driven motion generation has advanced significantly with the rise of denoising diffusion models. However, previous methods often oversimplify representations for the skeletal joints, temporal frames, and textual words, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Seokhyeon Hong , Chaelin Kim , Serin Yoon , Junghyun Nam , Sihun Cha , Junyong Noh

Safety-critical traffic simulation plays a crucial role in evaluating autonomous driving systems under rare and challenging scenarios. However, existing approaches often generate unrealistic scenarios due to insufficient consideration of…

Robotics · Computer Science 2025-05-02 Mingxing Peng , Ruoyu Yao , Xusen Guo , Yuting Xie , Xianda Chen , Jun Ma

In this paper, we present an approach in the Multimodal Learning Analytics field. Within this approach, we have developed a tool to visualize and analyze eye movement data collected during learning sessions in online courses. The tool is…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Miriam Navarro , Álvaro Becerra , Roberto Daza , Ruth Cobos , Aythami Morales , Julian Fierrez

Internal activations of diffusion models encode rich semantic information, but interpreting such representations remains challenging. While Sparse Autoencoders (SAEs) have shown promise in disentangling latent representations, existing…

Machine Learning · Computer Science 2026-01-23 Zhenghao He , Guangzhi Xiong , Boyang Wang , Sanchit Sinha , Aidong Zhang

In recent years, Vision-Language-Action (VLA) models have become a vital research direction in robotics due to their impressive multimodal understanding and generalization capabilities. Despite the progress, their practical deployment is…

Robotics · Computer Science 2025-06-17 Wenxuan Song , Jiayi Chen , Pengxiang Ding , Yuxin Huang , Han Zhao , Donglin Wang , Haoang Li

Our goal is to generate realistic human motion from natural language. Modern methods often face a trade-off between model expressiveness and text-to-motion alignment. Some align text and motion latent spaces but sacrifice expressiveness;…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Nefeli Andreou , Xi Wang , Victoria Fernández Abrevaya , Marie-Paule Cani , Yiorgos Chrysanthou , Vicky Kalogeiton

Temporal action detection (TAD) involves the localization and classification of action instances within untrimmed videos. While standard TAD follows fully supervised learning with closed-set setting on large training data, recent zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Thinh Phan , Khoa Vo , Duy Le , Gianfranco Doretto , Donald Adjeroh , Ngan Le

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Recent advances in Vision-Language-Action (VLA) models have shown promise for robot control, but their dependence on action supervision limits scalability and generalization. To address this challenge, we introduce CARE, a novel framework…

Robotics · Computer Science 2026-02-02 Jiaqi Shi , Xulong Zhang , Xiaoyang Qu , Jianzong Wang

This paper focuses on temporal localization of actions in untrimmed videos. Existing methods typically train classifiers for a pre-defined list of actions and apply them in a sliding window fashion. However, activities in the wild consist…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Jiyang Gao , Chen Sun , Zhenheng Yang , Ram Nevatia

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We…