中文
相关论文

相关论文: Agentic Jigsaw Interaction Learning for Enhancing …

200 篇论文

Within Multi Agent Systems, communication by means of Agent Communication Languages (ACLs) has a key role to play in the co-operation, co-ordination and knowledge-sharing between agents. Despite this, complex reasoning about agent…

多智能体系统 · 计算机科学 2015-08-12 David Lillis , Rem W. Collier`

Visual Language Models (VLMs) have increasingly become the main paradigm for understanding indoor scenes, but they still struggle with metric and spatial reasoning. Current approaches rely on end-to-end video understanding or large-scale…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Fernando Ropero , Erkin Turkoz , Daniel Matos , Junqing Du , Antonio Ruiz , Yanfeng Zhang , Lu Liu , Mingwei Sun , Yongliang Wang

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

计算机视觉与模式识别 · 计算机科学 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

We show that multi-agent systems guided by vision-language models (VLMs) improve end-to-end autonomous scientific discovery. By treating plots as verifiable checkpoints, a VLM-as-a-judge evaluates figures against dynamically generated…

计算与语言 · 计算机科学 2025-11-19 Kahaan Gandhi , Boris Bolliet , Inigo Zubeldia

Scientific Machine Learning (SciML) integrates data-driven inference with physical modeling to solve complex problems in science and engineering. However, the design of SciML architectures, loss formulations, and training strategies remains…

人工智能 · 计算机科学 2026-02-17 Qile Jiang , George Karniadakis

Agentic AI represents a major shift in how autonomous systems reason, plan, and execute multi-step tasks through the coordination of Large Language Models (LLMs), Vision Language Models (VLMs), tools, and external services. While these…

Retrieval-augmented generation with tool-calling agents (agentic RAG) has become increasingly powerful in understanding, processing, and responding to user queries. However, the scope of the grounding knowledge is limited and asking…

计算与语言 · 计算机科学 2026-01-14 Fabian Spaeh , Tianyi Chen , Chen-Hao Chiang , Bin Shen

Large visual language models (VLMs) have shown strong multi-modal medical reasoning ability, but most operate as end-to-end black boxes, diverging from clinicians' evidence-based, staged workflows and hindering clinical accountability.…

人工智能 · 计算机科学 2026-03-12 Yuexi Du , Jinglu Wang , Shujie Liu , Nicha C. Dvornek , Yan Lu

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Jinghan He , Junfeng Fang , Feng Xiong , Zijun Yao , Fei Shen , Haiyun Guo , Jinqiao Wang , Tat-Seng Chua

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multimodal tasks, but their performance is often constrained by the lack of external knowledge integration, limiting their ability to handle…

计算与语言 · 计算机科学 2025-01-16 Julian Perry , Surasakdi Siripong , Thanakorn Phonchai

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Large Language Models (LLMs) have shown remarkable reasoning capabilities in mathematical and scientific tasks. To enhance complex reasoning, multi-agent systems have been proposed to harness the collective intelligence of LLM agents.…

人工智能 · 计算机科学 2025-10-22 Zhenyu Bi , Meng Lu , Yang Li , Swastik Roy , Weijie Guan , Morteza Ziyadi , Xuan Wang

Large Language Model (LLM)-based agents exhibit systemic failures in compositional generalization, limiting their robustness in interactive environments. This work introduces AGEL-Comp, a neuro-symbolic AI agent architecture designed to…

人工智能 · 计算机科学 2026-04-30 Mahnoor Shahid , Hannes Rothe

Vision-Language Models (VLMs) exhibit remarkable common-sense and semantic reasoning capabilities. However, they lack a grounded understanding of physical dynamics. This limitation arises from training VLMs on static internet-scale…

机器人学 · 计算机科学 2026-04-01 Haowen Liu , Shaoxiong Yao , Haonan Chen , Jiawei Gao , Jiayuan Mao , Jia-Bin Huang , Yilun Du

The quest for expert-level reasoning in Large Language Models (LLMs) has been hampered by a persistent \textit{reward bottleneck}: traditional reinforcement learning (RL) relies on scalar rewards that are \textbf{costly} to scale,…

人工智能 · 计算机科学 2026-05-25 Yiwen Duan , Jing Ye , Xinpei Zhao

Hallucination remains one of the key obstacles to the reliable deployment of large language models (LLMs), particularly in real-world applications. Among various mitigation strategies, Retrieval-Augmented Generation (RAG) and reasoning…

计算与语言 · 计算机科学 2025-10-29 Yihan Li , Xiyuan Fu , Ghanshyam Verma , Paul Buitelaar , Mingming Liu

This paper presents RAG-KG-IL, a novel multi-agent hybrid framework designed to enhance the reasoning capabilities of Large Language Models (LLMs) by integrating Retrieval-Augmented Generation (RAG) and Knowledge Graphs (KGs) with an…

计算与语言 · 计算机科学 2025-03-19 Hong Qing Yu , Frank McQuade

Visual grounding, the task of linking textual queries to specific regions within images, plays a pivotal role in vision-language integration. Existing methods typically rely on extensive task-specific annotations and fine-tuning, limiting…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Liqin Luo , Guangyao Chen , Xiawu Zheng , Yongxing Dai , Yixiong Zou , Yonghong Tian

Vision language models (VLMs) achieve strong performance on general image understanding but struggle to think with medical images, especially when performing multi-step reasoning through iterative visual interaction. Medical VLMs often rely…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Meng Lu , Yuxing Lu , Yuchen Zhuang , Megan Mullins , Yang Xie , Guanghua Xiao , Charles Fleming , Wenqi Shi , Xuan Wang