English
Related papers

Related papers: AIDE: Agentically Improve Visual Language Model wi…

200 papers

Vision-language models (VLMs) have achieved strong multimodal reasoning capabilities, but further improving them still relies heavily on large-scale human-constructed supervision for post-training. Such supervision is costly to obtain,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Chaoran Xu , Yingmao Miao , Pengfei Zhang , Hao Dou , Lei Sun , Xiangxiang Chu

Industrial anomaly detection (IAD) is challenging due to the subtle and highly localized nature of many defects, which single-pass vision--language models (VLMs) often fail to capture. Moreover, existing approaches lack mechanisms to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Junwen Miao , Penghui Du , Yingying Fan , Yi Liu , Yu Wang , Runze He , Lida Huang , Yan Wang

We propose a novel approach for training large language models (LLMs) to adhere to objectives defined within a latent embedding space. Our method leverages reinforcement learning (RL), treating a pre-trained LLM as an environment. Our…

Computation and Language · Computer Science 2024-10-29 Guy Tennenholtz , Yinlam Chow , Chih-Wei Hsu , Lior Shani , Ethan Liang , Craig Boutilier

Large Language Models (LLMs) have emerged as powerful tools for accelerating scientific discovery, yet their static knowledge and hallucination issues hinder autonomous research applications. Recent advances integrate LLMs into agentic…

Artificial Intelligence · Computer Science 2025-12-23 Zeyu Xia , Jinzhe Ma , Congjie Zheng , Shufei Zhang , Yuqiang Li , Hang Su , P. Hu , Changshui Zhang , Xingao Gong , Wanli Ouyang , Lei Bai , Dongzhan Zhou , Mao Su

Reinforcement Learning (RL) agents often struggle to generalize knowledge to new tasks, even those structurally similar to ones they have mastered. Although recent approaches have attempted to mitigate this issue via zero-shot transfer,…

Artificial Intelligence · Computer Science 2026-04-13 Ajsal Shereef Palattuparambil , Thommen George Karimpanal , Santu Rana

The Internet of Agents is propelling edge computing toward agentic AI and edge general intelligence (EGI). However, deploying multi-agent service (MAS) on resource-constrained edge infrastructure presents severe challenges. MAS service…

Networking and Internet Architecture · Computer Science 2026-01-06 Runze Zheng , Yuqing Zheng , Zhengyi Cheng , Long Luo , Haoxiang Luo , Gang Sun , Hongfang Yu , Dusit Niyato

Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands…

Computation and Language · Computer Science 2024-04-02 Tong Niu , Weihao Zhang , Rong Zhao

The rapid evolution of agentic AI marks a new phase in artificial intelligence, where Large Language Models (LLMs) no longer merely respond but act, reason, and adapt. This survey traces the paradigm shift in building agentic AI: from…

Artificial Intelligence · Computer Science 2025-10-28 Jitao Sang , Jinlin Xiao , Jiarun Han , Jilin Chen , Xiaoyi Chen , Shuyu Wei , Yongjie Sun , Yuhang Wang

Agentic AI systems use specialized agents to handle tasks within complex workflows, enabling automation and efficiency. However, optimizing these systems often requires labor-intensive, manual adjustments to refine roles, tasks, and…

Computation and Language · Computer Science 2024-12-24 Kamer Ali Yuksel , Hassan Sawaf

Pre-trained visual language models (VLM) have shown excellent performance in image caption tasks. However, it sometimes shows insufficient reasoning ability. In contrast, large language models (LLMs) emerge with powerful reasoning…

Computation and Language · Computer Science 2023-05-23 Yueting Yang , Xintong Zhang , Wenjuan Han

Ensembling large language models (LLMs) can effectively combine diverse strengths of different models, offering a promising approach to enhance performance across various tasks. However, existing methods typically rely on fixed weighting…

Machine Learning · Computer Science 2025-06-03 Yuqian Fu , Yuanheng Zhu , Jiajun Chai , Guojun Yin , Wei Lin , Qichao Zhang , Dongbin Zhao

While Vision-language models (VLMs) have demonstrated remarkable performance across multi-modal tasks, their choice of vision encoders presents a fundamental weakness: their low-level features lack the robust structural and spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Brandon Huang , Hang Hua , Zhuoran Yu , Trevor Darrell , Rogerio Feris , Roei Herzig

In recent years, the upstream of Large Language Models (LLM) has also encouraged the computer vision community to work on substantial multimodal datasets and train models on a scale in a self-/semi-supervised manner, resulting in Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Keno Moenck , Duc Trung Thieu , Julian Koch , Thorsten Schüppstuhl

Autonomous coding agents built on large language models (LLMs) can now solve many general software and machine learning tasks, but they remain ineffective on complex, domain-specific scientific problems. Medical imaging is a particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Roshan Kenia , Xiaoman Zhang , Pranav Rajpurkar

Large Language Model (LLM) based agents excel at general reasoning but often fail in specialized domains where success hinges on long-tail knowledge absent from their training data. While human experts can provide this missing knowledge,…

Artificial Intelligence · Computer Science 2026-02-27 Zhiming Wang , Jinwei He , Feng Lu

Human drivers rely on commonsense reasoning to navigate diverse and dynamic real-world scenarios. Existing end-to-end (E2E) autonomous driving (AD) models are typically optimized to mimic driving patterns observed in data, without capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yi Xu , Yuxin Hu , Zaiwei Zhang , Gregory P. Meyer , Siva Karthik Mustikovela , Siddhartha Srinivasa , Eric M. Wolff , Xin Huang

The rapid shift from stateless large language models (LLMs) to autonomous, goal-driven agents raises a central question: When is agentic AI truly necessary? While agents enable multi-step reasoning, persistent memory, and tool…

Artificial Intelligence · Computer Science 2025-12-03 Shubhi Asthana , Bing Zhang , Chad DeLuca , Ruchi Mahindru , Hima Patel

Large Language Models (LLMs) like ChatGPT and GPT-4 are versatile and capable of addressing a diverse range of tasks. However, general LLMs, which are developed on open-domain data, may lack the domain-specific knowledge essential for tasks…

Computation and Language · Computer Science 2024-03-28 Haitao Li , Qingyao Ai , Jia Chen , Qian Dong , Zhijing Wu , Yiqun Liu , Chong Chen , Qi Tian

Recent advancements in Large Language Models (LLMs) have spurred interest in deploying LLM agents to undertake tasks in the world. LLMs are often deployed in agent systems: code that orchestrates LLM calls and provides them with tools. We…

Artificial Intelligence · Computer Science 2025-05-20 Maxime Robeyns , Martin Szummer , Laurence Aitchison

AI agent-based systems are becoming increasingly integral to modern software architectures, enabling autonomous decision-making, dynamic task execution, and multimodal interactions through large language models (LLMs). However, these…