English
Related papers

Related papers: Kimi K2.5: Visual Agentic Intelligence

200 papers

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

Artificial Intelligence · Computer Science 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

Current vision-language-action (VLA) models, pre-trained on large-scale robotic data, exhibit strong multi-task capabilities and generalize well to variations in visual and language instructions for manipulation. However, their success rate…

Robotics · Computer Science 2025-10-17 Han Zhao , Jiaxuan Zhang , Wenxuan Song , Pengxiang Ding , Donglin Wang

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

Large Language Models (LLMs) and Visual Language Models (VLMs) are attracting increasing interest due to their improving performance and applications across various domains and tasks. However, LLMs and VLMs can produce erroneous results,…

Artificial Intelligence · Computer Science 2024-12-31 Michele Brienza , Francesco Argenziano , Vincenzo Suriani , Domenico D. Bloisi , Daniele Nardi

As agentic systems increasingly rely on reinforcement learning from verifiable rewards, standardized ``gym'' infrastructure has become essential for rapid iteration, reproducibility, and fair comparison. Vision agents lack such…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Fanqing Meng , Lingxiao Du , Jiawei Gu , Jiaqi Liao , Linjie Li , Zijian Wu , Xiangyan Liu , Ziqi Zhao , Mengkang Hu , Zichen Liu , Jiaheng Zhang , Michael Qizhe Shieh

Current knowledge-enhanced large language models (LLMs) rely on static, pre-constructed knowledge bases that suffer from coverage gaps and temporal obsolescence, limiting their effectiveness in dynamic information environments. We present…

Machine Learning · Computer Science 2025-10-13 Jing Li , Zhijie Sun , Zhicheng Zhou , Suming Qiu , Junjie Huang , Haijia Sun , Linyuan Qiu

Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semantic understanding of environments, limiting their…

Robotics · Computer Science 2025-09-03 Jianyu Dou , Yinan Deng , Jiahui Wang , Xingsi Tang , Yi Yang , Yufeng Yue

We introduce QiboAgent, a reference implementation designed to serve as a practitioner's guideline for developing specialized coding assistants in Quantum Computing middleware. Addressing the limitations in scientific software development…

Quantum Physics · Physics 2026-03-17 Lorenzo Esposito , Andrea Papaluca , Stefano Carrazza

Vision-Language Models (VLMs) show promise for autonomous driving, yet their struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. To overcome…

The development of Generalist Virtual Agents (GVAs) has shown significant promise in autonomous task execution. However, current training paradigms face critical limitations, including reliance on outcome supervision and labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bingchen Miao , Yang Wu , Minghe Gao , Qifan Yu , Wendong Bu , Wenqiao Zhang , Yunfei Li , Siliang Tang , Tat-Seng Chua , Juncheng Li

We introduce Ming-Lite-Uni, an open-source multimodal framework featuring a newly designed unified visual generator and a native multimodal autoregressive model tailored for unifying vision and language. Specifically, this project provides…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Inclusion AI , Biao Gong , Cheng Zou , Dandan Zheng , Hu Yu , Jingdong Chen , Jianxin Sun , Junbo Zhao , Jun Zhou , Kaixiang Ji , Lixiang Ru , Libin Wang , Qingpei Guo , Rui Liu , Weilong Chai , Xinyu Xiao , Ziyuan Huang

Existing mobile device control agents often perform poorly when solving complex tasks requiring long-horizon planning and precise operations, typically due to a lack of relevant task experience or unfamiliarity with skill execution. We…

Artificial Intelligence · Computer Science 2026-03-03 Zhe Wu , Donglin Mo , Hongjin Lu , Junliang Xing , Jianheng Liu , Yuheng Jing , Kai Li , Kun Shao , Jianye Hao , Yuanchun Shi

As the capability frontier of autonomous agents continues to expand, they are increasingly able to complete specialized tasks through plug-and-play external skills. Yet current benchmarks mostly test whether models can use provided skills,…

Artificial Intelligence · Computer Science 2026-04-21 Ziao Zhang , Kou Shi , Shiting Huang , Avery Nie , Yu Zeng , Yiming Zhao , Zhen Fang , Qishen Su , Haibo Qiu , Wei Yang , Qingnan Ren , Shun Zou , Wenxuan Huang , Lin Chen , Zehui Chen , Feng Zhao

Multi-agent frameworks powered by large language models (LLMs) have demonstrated great success in automated planning and task execution. However, the effective adjustment of agentic workflows during execution has not been well studied. An…

Artificial Intelligence · Computer Science 2025-02-25 Boye Niu , Yiliao Song , Kai Lian , Yifan Shen , Yu Yao , Kun Zhang , Tongliang Liu

With the recent emergence of revolutionary autonomous agentic systems, research community is witnessing a significant shift from traditional static, passive, and domain-specific AI agents toward more dynamic, proactive, and generalizable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Huanjin Yao , Ruifei Zhang , Jiaxing Huang , Jingyi Zhang , Yibo Wang , Bo Fang , Ruolin Zhu , Yongcheng Jing , Shunyu Liu , Guanbin Li , Dacheng Tao

The advancement of large language models (LLMs) prompts the development of multi-modal agents, which are used as a controller to call external tools, providing a feasible way to solve practical tasks. In this paper, we propose a multi-modal…

Artificial Intelligence · Computer Science 2025-02-04 Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

The integration of Large Language Models (LLMs) with microscopic traffic simulation offers a promising path toward autonomous urban planning and intelligent transportation analysis. However, existing monolithic agent architectures often…

Multiagent Systems · Computer Science 2026-05-28 Shuyang Li , Ruimin Ke

This paper proposes EvoAgent - an evolvable large language model (LLM) agent framework that integrates structured skill learning with a hierarchical sub-agent delegation mechanism. EvoAgent models skills as multi-file structured capability…

Artificial Intelligence · Computer Science 2026-04-27 Aimin Zhang , Jiajing Guo , Fuwei Jia , Chen Lv , Boyu Wang , Fangzheng Li