English
Related papers

Related papers: CORAL: Scalable Multi-Task Robot Learning via LoRA…

200 papers

The capability of performing long-horizon, language-guided robotic manipulation tasks critically relies on leveraging historical information and generating coherent action sequences. However, such capabilities are often overlooked by…

Robotics · Computer Science 2025-12-24 Xiaofan Wang , Xingyu Gao , Jianlong Fu , Zuolei Li , Dean Fortier , Galen Mullins , Andrey Kolobov , Baining Guo

Grounding natural-language instructions into continuous control for quadruped robots remains a fundamental challenge in vision language action. Existing methods struggle to bridge high-level semantic reasoning and low-level actuation,…

Robotics · Computer Science 2025-11-25 Ting Huang , Dongjian Li , Rui Yang , Zeyu Zhang , Zida Yang , Hao Tang

Reinforcement learning (RL) has become a critical paradigm for LLM post-training, yet the rollout phase -- accounting for 50--80% of total step time -- is bottlenecked by skewed generation: long-tailed trajectories indispensable for model…

Hierarchical multi-robot exploration commonly decouples frontier allocation from local navigation, which can make the system brittle in dense and dynamic environments. Because the allocator lacks direct awareness of execution difficulty,…

Robotics · Computer Science 2026-03-10 Ning Liu , Sen Shen , Zheng Li , Sheng Liu , Dongkun Han , Shangke Lyu , Thomas Braunl

The emergence of vision-language-action (VLA) models has given rise to foundation models for robot manipulation. Although these models have achieved significant improvements, their generalization in multi-task manipulation remains limited.…

Multi-Task Learning (MTL) for Vision Transformer aims at enhancing the model capability by tackling multiple tasks simultaneously. Most recent works have predominantly focused on designing Mixture-of-Experts (MoE) structures and in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Hanwen Zhong , Jiaxin Chen , Yutong Zhang , Di Huang , Yunhong Wang

Despite their strong performance in embodied tasks, recent Vision-Language-Action (VLA) models remain highly fragile under multimodal perturbations, where visual corruption and linguistic noise jointly induce distribution shifts that…

Robotics · Computer Science 2026-04-15 Yuhan Xie , Yuping Yan , Yunqi Zhao , Handing Wang , Yaochu Jin

Humans possess a unified cognitive ability to perceive, comprehend, and interact with the physical world. Why can't large language models replicate this holistic understanding? Through a systematic analysis of existing training paradigms in…

Despite the multitude of excellent software components and tools available in the robotics and broader software engineering communities, successful integration of software for robotic systems remains a time-consuming and challenging task…

Robotics · Computer Science 2025-09-03 Steven Swanbeck , Mitch Pryor

Cooperative multi-agent reinforcement learning (MARL) aims to develop agents that can collaborate effectively. However, most cooperative MARL methods overfit training agents, making learned policies not generalize well to unseen…

Artificial Intelligence · Computer Science 2025-01-13 Kanefumi Matsuyama , Kefan Su , Jiangxing Wang , Deheng Ye , Zongqing Lu

Low-Rank Adaptation (LoRA) is widely adopted for downstream fine-tuning of foundation models due to its efficiency and zero additional inference cost. Many real-world applications require foundation models to specialize in several specific…

Machine Learning · Computer Science 2025-09-30 Jian Liang , Wenke Huang , Xianda Guo , Guancheng Wan , Bo Du , Mang Ye

Low-Rank Adaptation (LoRA) has emerged as a popular parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), yet it still incurs notable overhead and suffers from parameter interference in multi-task scenarios. We…

Machine Learning · Computer Science 2025-08-05 Juzheng Zhang , Jiacheng You , Ashwinee Panda , Tom Goldstein

Scaling multi-task low-rank adaptation (LoRA) to a large number of tasks induces catastrophic performance degradation, such as an accuracy drop from 88.2% to 2.0% on DOTA when scaling from 5 to 15 tasks. This failure is due to parameter and…

Machine Learning · Computer Science 2026-03-03 Zichen Tian , Antoine Ledent , Qianru Sun

Robotic real-world reinforcement learning (RL) with vision-language-action (VLA) models is bottlenecked by sparse, handcrafted rewards and inefficient exploration. We introduce VLAC, a general process reward model built upon InternVL and…

Vision-Language-Action (VLA) models have become a cornerstone in robotic policy learning, leveraging large-scale multimodal data for robust and scalable control. However, existing VLA frameworks primarily address short-horizon tasks, and…

Low-Rank Adaptation (LoRA) is a widely used parameter-efficient fine-tuning method for foundation models, but it suffers from parameter interference, resulting in suboptimal performance. Although Mixture-of-Experts (MoE)-based LoRA variants…

Machine Learning · Computer Science 2025-10-24 Heming Zou , Yunliang Zang , Wutong Xu , Yao Zhu , Xiangyang Ji

Multi-agent reinforcement learning (MARL) has been gaining extensive attention from academia and industries in the past few decades. One of the fundamental problems in MARL is how to evaluate different approaches comprehensively. Most…

Multiagent Systems · Computer Science 2022-06-22 Zhiuxan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Jinlin Chen , Huafeng Xu

Developing versatile quadruped robots that can smoothly perform various actions and tasks in real-world environments remains a significant challenge. This paper introduces a novel vision-language-action (VLA) model, mixture of robotic…

Robotics · Computer Science 2025-03-12 Han Zhao , Wenxuan Song , Donglin Wang , Xinyang Tong , Pengxiang Ding , Xuelian Cheng , Zongyuan Ge

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing…

Computation and Language · Computer Science 2024-10-29 Zi Gong , Hang Yu , Cong Liao , Bingchang Liu , Chaoyu Chen , Jianguo Li

Multi-objective reinforcement learning (MORL) is effective for multi-echelon combinatorial supply chain optimisation, where tasks involve high dimensionality, uncertainty, and competing objectives. However, its deployment in dynamic…

Machine Learning · Computer Science 2026-03-09 Rifny Rachman , Josh Tingey , Richard Allmendinger , Wei Pan , Pradyumn Shukla , Bahrul Ilmi Nasution