English
Related papers

Related papers: CLAD: Constrained Latent Action Diffusion for Visi…

200 papers

Training generalist agents is difficult across several axes, requiring us to deal with high-dimensional inputs (space), long horizons (time), and generalization to novel tasks. Recent advances with architectures have allowed for improved…

Machine Learning · Computer Science 2024-12-10 Edwin Zhang , Yujie Lu , Shinda Huang , William Wang , Amy Zhang

Medical image segmentation is crucial for clinical diagnosis and treatment planning. Traditional methods typically produce a single segmentation mask, failing to capture inherent uncertainty. Recent generative models enable the creation of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Huynh Trinh Ngoc , Toan Nguyen Hai , Ba Luong Son , Long Tran Quoc

The field of Continual Learning (CL) has inspired numerous researchers over the years, leading to increasingly advanced countermeasures to the issue of catastrophic forgetting. Most studies have focused on the single-class scenario, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Martin Menabue , Emanuele Frascaroli , Matteo Boschini , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

The introduction of diffusion models has brought significant advances to the field of audio-driven talking head generation. However, the extremely slow inference speed severely limits the practical implementation of diffusion-based talking…

Graphics · Computer Science 2025-11-18 Haotian Wang , Yuzhe Weng , Jun Du , Haoran Xu , Xiaoyan Wu , Shan He , Bing Yin , Cong Liu , Jianqing Gao , Qingfeng Liu

Diffusion models have shown superior performance on unsupervised anomaly detection tasks. Since trained with normal data only, diffusion models tend to reconstruct normal counterparts of test images with certain noises added. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Hang Yao , Ming Liu , Haolin Wang , Zhicun Yin , Zifei Yan , Xiaopeng Hong , Wangmeng Zuo

Despite progress, Vision-Language-Action models (VLAs) are limited by a scarcity of large-scale, diverse robot data. While human manipulation videos offer a rich alternative, existing methods are forced to choose between small,…

Robotics · Computer Science 2026-02-26 Hao Luo , Ye Wang , Wanpeng Zhang , Haoqi Yuan , Yicheng Feng , Haiweng Xu , Sipeng Zheng , Zongqing Lu

Variational Autoencoder (VAE) aims to compress pixel data into low-dimensional latent space, playing an important role in OpenAI's Sora and other latent video diffusion generation models. While most of existing video VAEs inflate a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Pingyu Wu , Kai Zhu , Yu Liu , Liming Zhao , Wei Zhai , Yang Cao , Zheng-Jun Zha

Vision-language-action (VLA) models have recently emerged as a promising paradigm for robotic control, enabling end-to-end policies that ground natural language instructions into visuomotor actions. However, current VLAs often struggle to…

Robotics · Computer Science 2025-09-18 Zijian An , Ran Yang , Yiming Feng , Lifeng Zhou

Spatio-temporal action detection (STAD) is an important fine-grained video understanding task. Current methods require box and label supervision for all action classes in advance. However, in real-world applications, it is very likely to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Tao Wu , Shuqiu Ge , Jie Qin , Gangshan Wu , Limin Wang

Modern generative and multimodal models increasingly rely on compact latent representations that trade and balance semantic richness with high-fidelity reconstruction. We introduce SALAD-VAE, a continuous and highly compact semantic Audio…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-10 Sebastian Braun , Hannes Gamper , Dimitra Emmanouilidou

Open-vocabulary Temporal Action Detection (Open-vocab TAD) is an advanced video analysis approach that expands Closed-vocabulary Temporal Action Detection (Closed-vocab TAD) capabilities. Closed-vocab TAD is typically confined to localizing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Trung Thanh Nguyen , Yasutomo Kawanishi , Takahiro Komamizu , Ichiro Ide

Pathological examination of the placenta is an effective method for detecting and mitigating health risks associated with childbirth. Recent advancements in AI have enabled the use of photographs of the placenta and pathology reports for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Manas Mehta , Yimu Pan , Kelly Gallagher , Alison D. Gernand , Jeffery A. Goldstein , Delia Mwinyelle , Leena Mithal , James Z. Wang

Understanding human activity is a crucial yet intricate task in egocentric vision, a field that focuses on capturing visual perspectives from the camera wearer's viewpoint. Traditional methods heavily rely on representation learning that is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sanghwan Kim , Daoji Huang , Yongqin Xian , Otmar Hilliges , Luc Van Gool , Xi Wang

In this work, we focus on unsupervised vision-language-action mapping in the area of robotic manipulation. Recently, multiple approaches employing pre-trained large language and vision models have been proposed for this task. However, they…

Robotics · Computer Science 2025-05-29 Gabriela Sejnova , Michal Vavrecka , Karla Stepanova

Diffusion models have emerged as powerful generative tools for modeling complex data distributions, yet their purely data-driven nature limits applicability in practical engineering and scientific problems where physical laws need to be…

Driven by the evolution toward 6G and AI-native edge intelligence, network operations increasingly require predictive and risk-aware adaptation under stringent computation and latency constraints. Network Traffic Matrix (TM), which…

Machine Learning · Computer Science 2026-02-03 Yu Sun , Yaqiong Liu , Nan Cheng , Jiayuan Li , Zihan Jia , Xialin Du , Mugen Peng

Latent space is one of the key concepts in generative AI, offering powerful means for creative exploration through vector manipulation. However, diffusion models like Stable Diffusion lack the intuitive latent vector control found in GANs,…

Machine Learning · Computer Science 2025-09-29 Zhihua Zhong , Xuanyang Huang

Vision-Language-Action (VLA) models, trained via flow-matching or diffusion objectives, excel at learning complex behaviors from large-scale, multi-modal datasets (e.g., human teleoperation, scripted policies). However, since VLAs…

Robotics · Computer Science 2025-12-03 Siyuan Yang , Yang Zhang , Haoran He , Ling Pan , Xiu Li , Chenjia Bai , Xuelong Li

Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

We introduce $\textbf{F}$uture $\textbf{LA}$tent $\textbf{RE}$presentation Alignment ($\textbf{FLARE}$), a novel framework that integrates predictive latent world modeling into robot policy learning. By aligning features from a diffusion…