English
Related papers

Related papers: AsyncShield: A Plug-and-Play Edge Adapter for Asyn…

200 papers

This paper introduces Unified Language-driven Zero-shot Domain Adaptation (ULDA), a novel task setting that enables a single model to adapt to diverse target domains without explicit domain-ID knowledge. We identify the constraints in the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Senqiao Yang , Zhuotao Tian , Li Jiang , Jiaya Jia

Pervasive mobile AI applications primarily employ one of the two learning paradigms: cloud-based learning (with powerful large models) or on-device learning (with lightweight small models). Despite their own advantages, neither paradigm can…

Machine Learning · Computer Science 2023-11-21 Yan Zhuang , Zhenzhe Zheng , Yunfeng Shao , Bingshuai Li , Fan Wu , Guihai Chen

VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly…

Robotics · Computer Science 2026-01-14 Shaoan Wang , Yuanfei Luo , Xingyu Chen , Aocheng Luo , Dongyue Li , Chang Liu , Sheng Chen , Yangang Zhang , Junzhi Yu

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is…

End-to-end autonomous driving via Vision-Language-Action (VLA) models demands a precarious balance between high-fidelity trajectory planning and efficient inference. Existing paradigms typically fall short: autoregressive (AR) VLAs are…

Computation and Language · Computer Science 2026-05-26 Kewei Zhang , Jin Wang , Sensen Gao , Chengyue Wu , Yulong Cao , Songyang Han , Boris Ivanovic , Langechuan Liu , Marco Pavone , Song Han , Daquan Zhou , Enze Xie

The problem of Rehearsal-Free Continual Learning (RFCL) aims to continually learn new knowledge while preventing forgetting of the old knowledge, without storing any old samples and prototypes. The latest methods leverage large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinyuan Gao , Songlin Dong , Yuhang He , Qiang Wang , Yihong Gong

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

Robotics · Computer Science 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

Modern autonomous vehicles (AVs) often rely on vision, LIDAR, and even radar-based simultaneous localization and mapping (SLAM) frameworks for precise localization and navigation. However, modern SLAM frameworks often lead to unacceptably…

Autonomous drones capable of interpreting and executing high-level language instructions in unstructured environments remain a long-standing goal. Yet existing approaches are constrained by their dependence on hand-crafted skills, extensive…

Robotics · Computer Science 2026-05-19 Qianzhong Chen , Naixiang Gao , Suning Huang , JunEn Low , Timothy Chen , Jiankai Sun , Mac Schwager

Stochastic gradient methods (SGMs) are the predominant approaches to train deep learning models. The adaptive versions (e.g., Adam and AMSGrad) have been extensively used in practice, partly because they achieve faster convergence than the…

Optimization and Control · Mathematics 2022-04-14 Yangyang Xu , Yibo Xu , Yonggui Yan , Colin Sutcher-Shepard , Leopold Grinberg , Jie Chen

The increasing scale and complexity of large language models (LLMs) pose significant inference latency challenges, primarily due to their autoregressive decoding paradigm characterized by the sequential nature of next-token prediction. By…

Computation and Language · Computer Science 2025-08-15 Keyu Chen , Zhifeng Shen , Daohai Yu , Haoqian Wu , Wei Wen , Jianfeng He , Ruizhi Qiao , Xing Sun

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

Robotics · Computer Science 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Point cloud completion is essential for robust 3D perception in safety-critical applications such as robotics and augmented reality. However, existing models perform static inference and rely heavily on inductive biases learned during…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Linlian Jiang , Rui Ma , Li Gu , Ziqiang Wang , Xinxin Zuo , Yang Wang

Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in reinforcement learning. To bridge…

Robotics · Computer Science 2026-04-27 Haoxiang Jie , Yaoyuan Yan , Xiangyu Wei , Kailin Wang , Hongjie Yan , Zhiyou Heng , Daocheng Chen

The widespread adoption of machine learning on edge devices, such as mobile phones, laptops, IoT devices, etc., has enabled real-time AI applications in resource-constrained environments. Existing solutions for managing computational…

Software Engineering · Computer Science 2025-02-11 Akhila Matathammal , Kriti Gupta , Larissa Lavanya , Ananya Vishal Halgatti , Priyanshi Gupta , Karthik Vaidhyanathan

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

End-to-end autonomous driving systems built on Vision Language Models (VLMs) have shown significant promise, yet their reliance on autoregressive architectures introduces some limitations for real-world applications. The sequential,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Can Cui , Yupeng Zhou , Juntong Peng , Sung-Yeon Park , Zichong Yang , Prashanth Sankaranarayanan , Jiaru Zhang , Ruqi Zhang , Ziran Wang

Deploying Vision-Language Models (VLMs) on edge devices remains challenging due to their substantial computational and memory demands, which exceed the capabilities of resource-constrained embedded platforms. Conversely, fully offloading…

Machine Learning · Computer Science 2026-04-30 Cyril Shih-Huan Hsu , Wig Yuan-Cheng Cheng , Chrysa Papagianni

Vision-Language-Action (VLA) models have emerged as a powerful paradigm in Embodied AI. However, the significant computational overhead of processing redundant visual tokens remains a critical bottleneck for real-time robotic deployment.…

Robotics · Computer Science 2025-11-25 Juntao Gao , Feiyang Ye , Jing Zhang , Wenjing Qian

A robot's deployment environment often involves perceptual changes that differ from what it has experienced during training. Standard practices such as data augmentation attempt to bridge this gap by augmenting source images in an effort to…

Machine Learning · Computer Science 2022-05-18 Takuma Yoneda , Ge Yang , Matthew R. Walter , Bradly Stadie