English
Related papers

Related papers: AMUSE: Audio-Visual Benchmark and Alignment Framew…

200 papers

Recently, Large Audio Language Models (LALMs) have progressed rapidly, demonstrating their strong efficacy in universal audio understanding through cross-modal integration. To evaluate LALMs' audio understanding performance, researchers…

Sound · Computer Science 2026-02-16 Han Yin , Jung-Woo Choi

As LLMs are increasingly deployed as agents, agentic reasoning - the ability to combine tool use, especially search, and reasoning - becomes a critical skill. However, it is hard to disentangle agentic reasoning when evaluated in complex…

Artificial Intelligence · Computer Science 2025-10-03 Hanlin Zhu , Tianyu Guo , Song Mei , Stuart Russell , Nikhil Ghosh , Alberto Bietti , Jiantao Jiao

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Multilingual capability is an essential aspect for large multimodal models, since they are usually deployed across various countries and languages. However, most existing benchmarks for multilingual multimodal reasoning struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Hongyu Wang , Jiayu Xu , Senwei Xie , Ruiping Wang , Jialin Li , Zhaojie Xie , Bin Zhang , Chuyan Xiong , Xilin Chen

Recent advances in task-oriented dialogue (TOD) systems, driven by large language models (LLMs) with extensive API and tool integration, have enabled conversational agents to coordinate interleaved goals, maintain long-horizon context, and…

Computation and Language · Computer Science 2026-02-02 Yifei Zhang , Hooshang Nayyeri , Rinat Khaziev , Emine Yilmaz , Gokhan Tur , Dilek Hakkani-Tür , Hari Thadakamalla

We investigated visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Aahana Basappa , Pranay Goel , Anusri Karra , Anish Karra , Asa Gilmore , Kevin Zhu

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Despite the growing use of large language models (LLMs) in clinical dialogue systems, existing evaluations focus on task completion or fluency, offering little insight into the behavioral and risk management requirements essential for…

Recent advances in large language models (LLMs) have facilitated the widespread deployment of LLMs as interactive agents capable of reasoning, planning, and tool use. Despite strong performance on existing benchmarks, such agents often…

Artificial Intelligence · Computer Science 2026-05-27 Yuxin Chen , Xiaodong Cai , Junfeng Fang , Zhuowen Han , Yu Wang , Yaorui Shi , Yi Zhang , Qi Gu , Xunliang Cai , Xiang Wang , An Zhang , Tat-Seng Chua

Large Language Model (LLM)-powered multi-agent systems (MAS) have rapidly advanced collaborative reasoning, tool use, and role-specialized coordination in complex tasks. However, reliability-critical deployment remains hindered by a…

Large Language Model (LLM) agents increasingly serve as personal assistants and workplace collaborators, where their utility depends on memory systems that extract, retrieve, and apply information across long-running conversations. However,…

Computation and Language · Computer Science 2026-05-19 Jingbo Yang , Kwei-Herng Lai , Xiaowen Wang , Shiyu Chang , Yaar Harari , Evgeniy Gabrilovich

Multi-agent debate (MAD) systems leverage collective intelligence to enhance reasoning capabilities, yet existing approaches struggle to simultaneously optimize accuracy, consensus formation, and computational efficiency. Static topology…

Artificial Intelligence · Computer Science 2026-03-02 Chao Wang , Han Lin , Huaze Tang , Huijing Lin , Wenbo Ding

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Vision language models (VLMs) are increasingly deployed as controllers with access to external tools for complex reasoning and decision-making, yet their effectiveness remains limited by the scarcity of high-quality multimodal trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tajamul Ashraf , Umair Nawaz , Abdelrahman M. Shaker , Rao Anwer , Philip Torr , Fahad Shahbaz Khan , Salman Khan

Large language model (LLM)-based Multi-agent systems (MAS) have shown promise in tackling complex collaborative tasks, where agents are typically orchestrated via role-specific prompts. While the quality of these prompts is pivotal, jointly…

Artificial Intelligence · Computer Science 2026-05-11 Zhexuan Wang , Xuebo Liu , Li Wang , Zifei Shan , Yutong Wang , Zhenxi Song , Min Zhang

Decision conferences are structured, collaborative meetings that bring together experts from various fields to address complex issues and reach a consensus on recommendations for future actions or policies. These conferences often rely on…

Computation and Language · Computer Science 2025-07-14 Selina Heller , Mohamed Ibrahim , David Antony Selby , Sebastian Vollmer

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

Artificial Intelligence · Computer Science 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

Recent advancements in large language models (LLMs) have given rise to the LLM-as-a-judge paradigm, showcasing their potential to deliver human-like judgments. However, in the field of machine translation (MT) evaluation, current…

Computation and Language · Computer Science 2025-02-21 Zhaopeng Feng , Jiayuan Su , Jiamei Zheng , Jiahan Ren , Yan Zhang , Jian Wu , Hongwei Wang , Zuozhu Liu

Generative agent models specifically tailored for smart education are critical, yet remain relatively underdeveloped. A key challenge stems from the inherent complexity of educational contexts: learners are human beings with various…

Artificial Intelligence · Computer Science 2025-08-06 Wen-Xi Yang , Tian-Fang Zhao

Traditional augmented reality (AR) systems predominantly rely on fixed class detectors or fiducial markers, limiting their ability to interpret complex, open-vocabulary natural language queries. We present a modular AR agent system that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Lixing Guo , Tobias Höllerer