English
Related papers

Related papers: A Unified Multi-Agent Framework for Universal Mult…

200 papers

Robotic platforms have become essential for marine operations by providing regular and continuous access to offshore assets, such as underwater infrastructure inspection, environmental monitoring, and resource exploration. However, the…

The rapid progress of large multimodal models has inspired efforts toward unified frameworks that couple understanding and generation. While such paradigms have shown remarkable success in 2D, extending them to 3D remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yongwei Chen , Tianyi Wei , Yushi Lan , Zhaoyang Lyu , Shangchen Zhou , Xudong Xu , Xingang Pan

Existing 3D human motion generation and understanding methods often exhibit limited interpretability, restricting effective mutual enhancement between these inherently related tasks. While current unified frameworks based on large language…

Artificial Intelligence · Computer Science 2026-01-21 Guocun Wang , Kenkun Liu , Jing Lin , Guorui Song , Jian Li , Xiaoguang Han

The bifurcation of generative modeling into autoregressive approaches for discrete data (text) and diffusion approaches for continuous data (images) hinders the development of truly unified multimodal systems. While Masked Language Models…

Computation and Language · Computer Science 2026-01-08 Yuanfeng Xu , Yuhao Chen , Liang Lin , Guangrun Wang

Automatically evaluating multimodal generation presents a significant challenge, as automated metrics often struggle to align reliably with human evaluation, especially for complex tasks that involve multiple modalities. To address this, we…

Artificial Intelligence · Computer Science 2025-05-26 Jihan Yao , Yushi Hu , Yujie Yi , Bin Han , Shangbin Feng , Guang Yang , Bingbing Wen , Ranjay Krishna , Lucy Lu Wang , Yulia Tsvetkov , Noah A. Smith , Banghua Zhu

Recent text-to-image (T2I) models have made remarkable progress in generating visually realistic and semantically coherent images. However, they still suffer from randomness and inconsistency with the given prompts, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Kaishen Wang , Ruibo Chen , Tong Zheng , Heng Huang

Developing intelligent agents for long-term cooperation in dynamic open-world scenarios is a major challenge in multi-agent systems. Traditional Multi-agent Reinforcement Learning (MARL) frameworks like centralized training decentralized…

Artificial Intelligence · Computer Science 2025-02-11 Hanqing Yang , Jingdi Chen , Marie Siew , Tania Lorido-Botran , Carlee Joe-Wong

Autonomous driving (AD) systems struggle in long-tail scenarios due to limited world knowledge and weak visual dynamic modeling. Existing vision-language-action (VLA)-based methods cannot leverage unlabeled videos for visual causal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hao Lu , Ziyang Liu , Guangfeng Jiang , Yuanfei Luo , Sheng Chen , Yangang Zhang , Ying-Cong Chen

Audiobook generation aims to create rich, immersive listening experiences from multimodal inputs, but current approaches face three critical challenges: (1) the lack of synergistic generation of diverse audio types (e.g., speech, sound…

Sound · Computer Science 2025-08-13 Yan Rong , Shan Yang , Chenxing Li , Dong Yu , Li Liu

Recent advances in large language models (LLMs) have made automated multiple-choice question (MCQ) generation increasingly feasible; however, reliably producing items that satisfy controlled cognitive demands remains a challenge. To address…

Computation and Language · Computer Science 2026-02-04 Yu Tian , Linh Huynh , Katerina Christhilf , Shubham Chakraborty , Micah Watanabe , Tracy Arner , Danielle McNamara

Sign language generation (SLG) aims to translate written texts into expressive sign motions, bridging communication barriers for the Deaf and Hard-of-Hearing communities. Recent studies formulate SLG within the language modeling framework…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Ronglai Zuo , Rolandos Alexandros Potamias , Qi Sun , Evangelos Ververas , Jiankang Deng , Stefanos Zafeiriou

The advancement of large language models (LLMs) has enabled the construction of multi-agent systems to solve complex tasks by dividing responsibilities among specialized agents, such as a planning agent for subgoal generation and a…

Computation and Language · Computer Science 2025-09-12 Minghang Zhu , Zhengliang Shi , Zhiwei Xu , Shiguang Wu , Lingjie Wang , Pengjie Ren , Zhaochun Ren , Zhumin Chen

Multi-agent debate (MAD) is an emerging approach to improving the reasoning capabilities of large language models (LLMs). Existing MAD methods rely on multiple rounds of interaction among agents to reach consensus, and the final output is…

Artificial Intelligence · Computer Science 2025-09-16 Yu Cui , Hang Fu , Haibin Zhang , Licheng Wang , Cong Zuo

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

Understanding the decision-making process of Deep Reinforcement Learning agents remains a key challenge for deploying these systems in safety-critical and multi-agent environments. While prior explainability methods like StateMask, have…

Artificial Intelligence · Computer Science 2025-10-02 Maisha Maliha , Dean Hougen

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

Most multi-agent systems rely exclusively on autoregressive language models (ARMs) that are based on sequential generation. Although effective for fluent text, ARMs limit global reasoning and plan revision. On the other hand, Discrete…

Machine Learning · Computer Science 2026-03-11 Lina Berrayana , Ahmed Heakl , Abdullah Sohail , Thomas Hofmann , Salman Khan , Wei Chen

Fine-grained entity recognition is crucial for reasoning and decision-making in task-oriented dialogues, yet current large language models (LLMs) continue to face challenges in domain adaptation and retrieval controllability. We introduce…

Computation and Language · Computer Science 2025-11-18 Liang Xue , Haoyu Liu , Yajun Tian , Xinyu Zhong , Yang Liu