English
Related papers

Related papers: SDAR-VL: Stable and Efficient Block-wise Diffusion…

200 papers

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

Robotics · Computer Science 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Real-world video super-resolution (VSR) presents significant challenges due to complex and unpredictable degradations. Although some recent methods utilize image diffusion models for VSR and have shown improved detail generation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhe Kong , Le Li , Yong Zhang , Feng Gao , Shaoshu Yang , Tao Wang , Kaihao Zhang , Zhuoliang Kang , Xiaoming Wei , Guanying Chen , Wenhan Luo

We introduce DiverseVAR, a framework that enhances the diversity of text-conditioned visual autoregressive models (VAR) at test time without requiring retraining, fine-tuning, or substantial computational overhead. While VAR models have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mingue Park , Prin Phunyaphibarn , Phillip Y. Lee , Minhyuk Sung

Vision-language models (VLMs) have achieved remarkable multimodal understanding and reasoning capabilities, yet remain computationally expensive due to dense visual tokenization. Existing efficiency approaches either merge redundant visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Aditya Kumar Singh , Hitesh Kandala , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction guarantees under calibrated uncertainty bounds despite partial observability, sensor noise,…

Robotics · Computer Science 2026-04-29 Antoine P. Leeman , Shuyu Zhan , Melanie N. Zeilinger , Glen Chou

Diffusion-based models demonstrate impressive generation capabilities. However, they also have a massive number of parameters, resulting in enormous model sizes, thus making them unsuitable for deployment on resource-constraint devices.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Avideep Mukherjee , Soumya Banerjee , Piyush Rai , Vinay P. Namboodiri

Due to the limitations of the model structure and pre-training objectives, existing vision-and-language generation models cannot utilize pair-wise images and text through bi-directional generation. In this paper, we propose DU-VLG, a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Luyang Huang , Guocheng Niu , Jiachen Liu , Xinyan Xiao , Hua Wu

Generating long-form content, such as minute-long videos and extended texts, is increasingly important for modern generative models. Block diffusion improves inference efficiency via KV caching and block-wise causal inference and has been…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zhuokun Chen , Jianfei Cai , Bohan Zhuang

Latent Video Diffusion Models (LVDMs) have achieved state-of-the-art generative quality for image and video generation; however, they remain brittle under noisy conditioning, where small perturbations in text or multimodal embeddings can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Chika Maduabuchi , Hao Chen , Yujin Han , Jindong Wang

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive…

Robotics · Computer Science 2026-05-19 Qianzhong Chen , Naixiang Gao , Suning Huang , JunEn Low , Timothy Chen , Jiankai Sun , Mac Schwager

Diffusion Language Models (DLMs) enable fast generation, yet training large DLMs from scratch is costly. As a practical shortcut, adapting off-the-shelf Auto-Regressive (AR) model weights into a DLM could quickly equip the DLM with strong…

Computation and Language · Computer Science 2026-02-02 Yuchuan Tian , Yuchen Liang , Shuo Zhang , Yingte Shu , Guangwen Yang , Wei He , Sibo Fang , Tianyu Guo , Kai Han , Chao Xu , Hanting Chen , Xinghao Chen , Yunhe Wang

Vision-Language Models (VLMs) have achieved remarkable progress in integrating visual perception with language understanding. However, effective multimodal reasoning requires both accurate perception and robust reasoning, and weakness in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Sourabh Sharma , Sonam Gupta , Sadbhawna

Discrete diffusion models offer global context awareness and flexible parallel generation. However, uniform random noise schedulers in standard DLLM training overlook the highly non-uniform information density inherent in real-world…

Machine Learning · Computer Science 2026-03-18 Linrui Ma , Yufei Cui , Kai Han , Yunhe Wang

Vision-Language Models (VLMs) have great potential in medical tasks, like Visual Question Answering (VQA), where they could act as interactive assistants for both patients and clinicians. Yet their robustness to distribution shifts on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Kim-Celine Kahl , Selen Erkan , Jeremias Traub , Carsten T. Lüth , Klaus Maier-Hein , Lena Maier-Hein , Paul F. Jaeger

The "style trap" poses a significant challenge for Large Vision-Language Models (LVLMs), hindering robust semantic understanding across diverse visual styles, especially in in-context learning (ICL). Existing methods often fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Aya Nakayama , Brian Wong , Yuji Nishimura , Kaito Tanaka

Reliable benchmarking is critical for advancing Vision-Language-Action (VLA) models, as it reveals their generalization, robustness, and alignment of perception with language-driven manipulation tasks. However, existing benchmarks often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Guodong Wang , Chenkai Zhang , Qingjie Liu , Jinjin Zhang , Jiancheng Cai , Junjie Liu , Xinmin Liu

Super-resolution (SR) is an ill-posed inverse problem with many feasible solutions consistent with a given low-resolution image. On one hand, regressive SR models aim to balance fidelity and perceptual quality to yield a single solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Cansu Korkmaz , Ahmet Murat Tekalp , Zafer Dogan

Analysis of vision-and-language models has revealed their brittleness under linguistic phenomena such as paraphrasing, negation, textual entailment, and word substitutions with synonyms or antonyms. While data augmentation techniques have…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Tejas Gokhale , Abhishek Chaudhary , Pratyay Banerjee , Chitta Baral , Yezhou Yang

Recent advances in vision-language pre-training (VLP) have demonstrated impressive performance in a range of vision-language (VL) tasks. However, there exist several challenges for measuring the community's progress in building general…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Wangchunshu Zhou , Yan Zeng , Shizhe Diao , Xinsong Zhang