English
Related papers

Related papers: ABot-Claw: A Foundation for Persistent, Cooperativ…

200 papers

Vision-language-action (VLA) models have significantly advanced robotic learning, enabling training on large-scale, cross-embodiment data and fine-tuning for specific robots. However, state-of-the-art autoregressive VLAs struggle with…

Robotics · Computer Science 2025-11-04 Chengmeng Li , Yaxin Peng

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Although LLMs demonstrate proficiency in several text-based reasoning and planning tasks, their implementation in robotics control is constrained by significant deficiencies: (1) LLM agents are designed to work mainly with textual inputs…

Artificial Intelligence · Computer Science 2025-10-17 Shuang Ao , Flora D. Salim , Simon Khan

Embodied AI is widely recognized as a cornerstone of artificial general intelligence (AGI) because it involves controlling embodied agents to perform tasks in the physical world. Building on the success of large language models (LLMs) and…

Robotics · Computer Science 2026-05-04 Yueen Ma , Zixing Song , Yuzheng Zhuang , Jianye Hao , Irwin King

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

Building general-purpose embodied agents across diverse hardware remains a central challenge in robotics, often framed as the ''one-brain, many-forms'' paradigm. Progress is hindered by fragmented data, inconsistent representations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yandan Yang , Shuang Zeng , Tong Lin , Xinyuan Chang , Dekang Qi , Junjin Xiao , Haoyun Liu , Ronghan Chen , Yuzhi Chen , Dongjie Huo , Feng Xiong , Xing Wei , Zhiheng Ma , Mu Xu

In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate…

Robotics · Computer Science 2026-03-04 Shinas Shaji , Fabian Huppertz , Alex Mitrevski , Sebastian Houben

Machine learning has long since become a keystone technology, accelerating science and applications in a broad range of domains. Consequently, the notion of applying learning methods to a particular problem set has become an established and…

Artificial intelligence has demonstrated remarkable capability in predicting scientific properties, yet scientific discovery remains an inherently physical, long-horizon pursuit governed by experimental cycles. Most current computational…

Artificial Intelligence · Computer Science 2026-03-23 Xiang Zhuang , Chenyi Zhou , Kehua Feng , Zhihui Zhu , Yunfan Gao , Yijie Zhong , Yichi Zhang , Junjie Huang , Keyan Ding , Lei Bai , Haofen Wang , Qiang Zhang , Huajun Chen

Recent advances in embodied intelligence have leveraged massive scaling of data and model parameters to master natural-language command following and multi-task control. In contrast, biological systems demonstrate an innate ability to…

Robotics · Computer Science 2026-01-22 Weiyu Guo , He Zhang , Pengteng Li , Tiefu Cai , Ziyang Chen , Yandong Guo , Xiao He , Yongkui Yang , Ying Sun , Hui Xiong

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are…

Robotics · Computer Science 2025-10-10 Yandu Chen , Kefan Gu , Yuqing Wen , Yucheng Zhao , Tiancai Wang , Liqiang Nie

Vision-Language-Action models have emerged as essential generalist robot policies for diverse manipulation tasks, conventionally relying on directly translating multimodal inputs into actions via Vision-Language Model embeddings. Recent…

Robotics · Computer Science 2026-03-31 Linqing Zhong , Yi Liu , Yifei Wei , Ziyu Xiong , Maoqing Yao , Si Liu , Guanghui Ren

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…

The increase in available computing power and the Deep Learning revolution have allowed the exploration of new topics and frontiers in Artificial Intelligence research. A new field called Embodied Artificial Intelligence, which places at…

Robotics · Computer Science 2025-05-05 Roberto Bigazzi

Vision-Language-Action (VLA) models have demonstrated significant potential for embodied decision-making; however, their application in complex chemical laboratory automation remains restricted by limited long-horizon reasoning and the…

Robotics · Computer Science 2026-04-20 Xu Huang , Weixin Mao , Yinhao Li , Hua Chen , Jiabao Zhao

Vision-language-action (VLA) models are effective robot action executors, but they remain limited on long-horizon tasks due to the dual burden of extended closed-loop planning and diverse physical operations. We therefore propose…

Robotics · Computer Science 2026-05-14 Zixing Lei , Changxing Liu , Yichen Xiong , Minhao Xiong , Yuanzhuo Ding , Zhipeng Zhang , Weixin Li , Siheng Chen

Large language model (LLM) agents are increasingly used for complex tasks, yet deployed agents often remain static, failing to adapt as user needs evolve. This creates a tension between the need for continuous service and the necessity of…

Machine Learning · Computer Science 2026-03-19 Peng Xia , Jianwen Chen , Xinyu Yang , Haoqin Tu , Jiaqi Liu , Kaiwen Xiong , Siwei Han , Shi Qiu , Haonian Ji , Yuyin Zhou , Zeyu Zheng , Cihang Xie , Huaxiu Yao

Recent advances in vision language models (VLMs) have shown strong potential for spatial reasoning and 3D scene layout generation from open-ended language instructions. However, generating layouts that are not only semantically coherent but…

Artificial Intelligence · Computer Science 2026-03-10 Ali Shamsaddinlou

Recent vision-language-action (VLA) models rely on 2D inputs, lacking integration with the broader realm of the 3D physical world. Furthermore, they perform action prediction by learning a direct mapping from perception to action,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Haoyu Zhen , Xiaowen Qiu , Peihao Chen , Jincheng Yang , Xin Yan , Yilun Du , Yining Hong , Chuang Gan

This paper focuses on embodied task planning, where an agent acquires visual observations from the environment and executes atomic actions to accomplish a given task. Although recent Vision-Language Models (VLMs) have achieved impressive…

Robotics · Computer Science 2026-04-10 Peiran Xu , Jiaqi Zheng , Yadong Mu