English
Related papers

Related papers: MATA: A Trainable Hierarchical Automaton System fo…

200 papers

Large language model (LLM) agents have demonstrated remarkable capabilities in tool use, reasoning, and code generation, yet single-agent systems exhibit fundamental limitations when confronted with complex research tasks demanding…

Artificial Intelligence · Computer Science 2026-03-17 Aaron Shen , Alfred Shen

Multimodal large language models (MLLMs) have shown strong capabilities but remain limited to fixed modality pairs and require costly fine-tuning with large aligned datasets. Building fully omni-capable models that can integrate text,…

Artificial Intelligence · Computer Science 2025-11-06 Huawei Lin , Yunzhi Shi , Tong Geng , Weijie Zhao , Wei Wang , Ravender Pal Singh

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We…

With recent advances in multi-modal foundation models, the previously text-only large language models (LLM) have evolved to incorporate visual input, opening up unprecedented opportunities for various applications in visualization. Our work…

Human-Computer Interaction · Computer Science 2023-12-08 Shusen Liu , Haichao Miao , Zhimin Li , Matthew Olson , Valerio Pascucci , Peer-Timo Bremer

Building agents that autonomously operate mobile devices has attracted increasing attention. While Vision-Language Models (VLMs) show promise, most existing approaches rely on direct state-to-action mappings, which lack structured reasoning…

Artificial Intelligence · Computer Science 2026-02-09 Zhe Wu , Hongjin Lu , Junliang Xing , Changhao Zhang , Yuxuan Li , Yin Zhu , Yuhao Yang , Yuheng Jing , Kai Li , Kun Shao , Jianye Hao , Jun Wang , Yuanchun Shi

While vision-language models (VLMs) have demonstrated remarkable performance across various tasks combining textual and visual information, they continue to struggle with fine-grained visual perception tasks that require detailed…

Computation and Language · Computer Science 2025-11-12 Zhehao Zhang , Ryan Rossi , Tong Yu , Franck Dernoncourt , Ruiyi Zhang , Jiuxiang Gu , Sungchul Kim , Xiang Chen , Zichao Wang , Nedim Lipka

Multi-agent systems (MAS) enable complex reasoning by coordinating multiple agents, but often incur high inference latency due to multi-step execution and repeated model invocations, severely limiting their scalability and usability in…

Multiagent Systems · Computer Science 2026-01-16 Xi Shi , Mengxin Zheng , Qian Lou

Meta-analysis is a systematic research methodology that synthesizes data from multiple existing studies to derive comprehensive conclusions. This approach not only mitigates limitations inherent in individual studies but also facilitates…

Artificial Intelligence · Computer Science 2026-01-22 Wanghan Xu , Wenlong Zhang , Fenghua Ling , Ben Fei , Yusong Hu , Runmin Ma , Bo Zhang , Fangxuan Ren , Jintai Lin , Wanli Ouyang , Lei Bai

Specialized visual tools can augment large language models or vision language models with expert knowledge (e.g., grounding, spatial reasoning, medical knowledge, etc.), but knowing which tools to call (and when to call them) can be…

Computation and Language · Computer Science 2025-12-09 Nithin Sivakumaran , Justin Chih-Yao Chen , David Wan , Yue Zhang , Jaehong Yoon , Elias Stengel-Eskin , Mohit Bansal

Procedural activity assistants potentially support humans in a variety of settings, from our daily lives, e.g., cooking or assembling flat-pack furniture, to professional situations, e.g., manufacturing or biological experiments. Despite…

Computation and Language · Computer Science 2025-10-02 Kimihiro Hasegawa , Wiradee Imrattanatrai , Masaki Asada , Ken Fukuda , Teruko Mitamura

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

Agentic AI represents a major shift in how autonomous systems reason, plan, and execute multi-step tasks through the coordination of Large Language Models (LLMs), Vision Language Models (VLMs), tools, and external services. While these…

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

Artificial Intelligence · Computer Science 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

Effectively processing long contexts remains a fundamental yet unsolved challenge for large language models (LLMs). Existing single-LLM-based methods primarily reduce the context window or optimize the attention mechanism, but they often…

Computation and Language · Computer Science 2026-04-22 Yichen Jiang , Jiakang Yuan , Chongjun Tu , Peng Ye , Tao Chen

Visual Language Models (VLMs) achieve promising results in medical reasoning but struggle with hallucinations, vague descriptions, inconsistent logic and poor localization. To address this, we propose a agent framework named Medical Visual…

Artificial Intelligence · Computer Science 2025-10-22 Guangfu Guo , Xiaoqian Lu , Yue Feng

Process models are frequently used in software engineering to describe business requirements, guide software testing and control system improvement. However, traditional process modeling methods often require the participation of numerous…

Artificial Intelligence · Computer Science 2024-08-08 Leilei Lin , Yumeng Jin , Yingming Zhou , Wenlong Chen , Chen Qian

We present MA-RAG, a Multi-Agent framework for Retrieval-Augmented Generation (RAG) that addresses the inherent ambiguities and reasoning challenges in complex information-seeking tasks. Unlike conventional RAG methods that rely on…

Computation and Language · Computer Science 2025-10-14 Thang Nguyen , Peter Chin , Yu-Wing Tai

Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental…

Computation and Language · Computer Science 2026-01-27 Jinwei Lu , Yuanfeng Song , Chen Zhang , Raymond Chi-Wing Wong