English
Related papers

Related papers: Towards On-Policy Data Evolution for Visual-Native…

200 papers

Procedural memory enables large language model (LLM) agents to internalize "how-to" knowledge, theoretically reducing redundant trial-and-error. However, existing frameworks predominantly suffer from a "passive accumulation" paradigm,…

Artificial Intelligence · Computer Science 2026-04-16 Zouying Cao , Jiaji Deng , Li Yu , Weikang Zhou , Zhaoyang Liu , Bolin Ding , Hai Zhao

Agent harness evolution improves frozen language-model agents by modifying the executable structures around them. We study this paradigm as a form of sample-efficient fast adaptation: instead of updating model weights, an agent can acquire…

Artificial Intelligence · Computer Science 2026-05-26 Lirong Che , Yuzhe yang , Peiwen lin , Chuang wang , Xueqian wang , Jian su

We pursue a life-long learning approach to artificial intelligence that makes extensive use of reinforcement learning algorithms. We build on our prior work with general value functions (GVFs) and the Horde architecture. GVFs have been…

Artificial Intelligence · Computer Science 2012-06-28 Adam White , Joseph Modayil , Richard S. Sutton

Recent multi-LLM agent systems have shown promising capabilities for automated problem-solving, yet they predominantly rely on frozen agents or static fine-tuning pipelines. To address this limitation, our primary contribution is ATLAS…

Artificial Intelligence · Computer Science 2026-05-22 Ujin Jeon , Jiyong Kwon , Madison Ann Sullivan , Caleb Eunho Lee , Guang Lin

The advancement of large language models (LLMs) prompts the development of multi-modal agents, which are used as a controller to call external tools, providing a feasible way to solve practical tasks. In this paper, we propose a multi-modal…

Artificial Intelligence · Computer Science 2025-02-04 Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

MLLMs exhibit strong reasoning on isolated queries, yet they operate de novo -- solving each problem independently and often repeating the same mistakes. Existing memory-augmented agents mainly store past trajectories for reuse. However,…

Artificial Intelligence · Computer Science 2026-05-05 Weihao Bo , Shan Zhang , Yanpeng Sun , Jingjing Wu , Qunyi Xie , Xiao Tan , Kunbin Chen , Wei He , Xiaofan Li , Na Zhao , Jingdong Wang , Zechao Li

The challenge in the widely applicable online matching problem lies in making irrevocable assignments while there is uncertainty about future inputs. Most theoretically-grounded policies are myopic or greedy in nature. In real-world…

Machine Learning · Computer Science 2022-11-01 Mohammad Ali Alomrani , Reza Moravej , Elias B. Khalil

While Large Multimodal Models (LMMs) demonstrate impressive visual perception, they remain epistemically constrained by their static parametric knowledge. To transcend these boundaries, multimodal search models have been adopted to actively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yikun Liu , Yuan Liu , Le Tian , Xiao Zhou , Jiangchao Yao , Yanfeng Wang , Weidi Xie

Agents, whether software or hardware, perceive their environment through sensors and act using actuators, often operating in dynamic, partially observable settings. They face challenges like incomplete and noisy data, unforeseen situations,…

Artificial Intelligence · Computer Science 2024-05-29 Saeedeh Ghanadbashi , Fatemeh Golpayegani

Edge computing breaks with traditional autoscaling due to strict resource constraints, thus, motivating more flexible scaling behaviors using multiple elasticity dimensions. This work introduces an agent-based autoscaling framework that…

Artificial Intelligence · Computer Science 2026-01-13 Boris Sedlak , Alireza Furutanpey , Zihang Wang , Víctor Casamayor Pujol , Schahram Dustdar

Existing multimodal search agents process target entities sequentially, issuing one tool call per entity and accumulating redundant interaction rounds whenever a query decomposes into independent sub-retrievals. We argue that effective…

Machine Learning · Computer Science 2026-05-12 Guankai Li , Jiabin Chen , Yi Xu , Xichen Zhang , Yuan Lu

Recent research in language-guided visual navigation has demonstrated a significant demand for the diversity of traversable environments and the quantity of supervision for training generalizable agents. To tackle the common data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Zun Wang , Jialu Li , Yicong Hong , Yi Wang , Qi Wu , Mohit Bansal , Stephen Gould , Hao Tan , Yu Qiao

Multimodal large language models (MLLMs), equipped with increasingly advanced planning and tool-use capabilities, are evolving into autonomous agents capable of performing multimodal web browsing and deep search in open-world environments.…

Multimodal large language models are increasingly deployed as long-horizon agents, where memory must do more than recall: it must track an evolving world, revise what has gone stale, and surface the right evidence at decision time. Existing…

Mainstream visuomotor policies predominantly rely on generative models for holistic action prediction, while current autoregressive policies, predicting the next token or chunk, have shown suboptimal results. This motivates a search for…

Robotics · Computer Science 2025-03-18 Yue Su , Xinyu Zhan , Hongjie Fang , Han Xue , Hao-Shu Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

The practical impact of deep learning on complex supervised learning problems has been significant, so much so that almost every Artificial Intelligence problem, or at least a portion thereof, has been somehow recast as a deep learning…

Machine Learning · Statistics 2018-03-19 Housam Khalifa Bashier Babiker , Randy Goebel

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang

Vision-language models are increasingly deployed as computer-use agents (CUAs) that operate desktops and browsers. Top-performing CUAs are framework-based systems that decompose planning and execution, while end-to-end screenshot-to-action…

Artificial Intelligence · Computer Science 2026-02-11 Zezhou Wang , Ziyun Zhang , Xiaoyi Zhang , Zhuzhong Qian , Yan Lu

Multimodal large language models (MLLMs) have achieved remarkable success across a broad range of vision tasks. However, constrained by the capacity of their internal world knowledge, prior work has proposed augmenting MLLMs by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Wenxuan Huang , Yu Zeng , Qiuchen Wang , Zhen Fang , Shaosheng Cao , Zheng Chu , Qingyu Yin , Shuang Chen , Zhenfei Yin , Lin Chen , Zehui Chen , Xu Tang , Yao Hu , Shaohui Lin , Philip Torr , Feng Zhao , Wanli Ouyang