English
Related papers

Related papers: VoiceAgentBench: Are Voice Assistants ready for ag…

200 papers

Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks…

Computation and Language · Computer Science 2026-03-23 Jianan Chen , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

Video production workflows offer a rich and demanding arena for evaluating multimodal AI agents: they require composite capabilities across text, image, audio, and video understanding, along with long-horizon planning, and tool use. To this…

Cryptography and Security · Computer Science 2026-05-28 Zongheng Cao , Yi Zheng , Rui Song , Xinyu Hu

We introduce AudioBench, a universal benchmark designed to evaluate Audio Large Language Models (AudioLLMs). It encompasses 8 distinct tasks and 26 datasets, among which, 7 are newly proposed datasets. The evaluation targets three main…

Sound · Computer Science 2025-05-07 Bin Wang , Xunlong Zou , Geyu Lin , Shuo Sun , Zhuohan Liu , Wenyu Zhang , Zhengyuan Liu , AiTi Aw , Nancy F. Chen

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Large language models (LLMs) have advanced the development of various AI conversational agents, including role-playing conversational agents that mimic diverse characters and human behaviors. While prior research has predominantly focused…

Computation and Language · Computer Science 2024-08-06 Hongzhan Chen , Hehong Chen , Ming Yan , Wenshen Xu , Xing Gao , Weizhou Shen , Xiaojun Quan , Chenliang Li , Ji Zhang , Fei Huang , Jingren Zhou

With the rapid advancement of Multi-modal Large Language Models (MLLMs), several diagnostic benchmarks have recently been developed to assess these models' multi-modal reasoning proficiency. However, these benchmarks are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Sanjoy Chowdhury , Sayan Nag , Subhrajyoti Dasgupta , Yaoting Wang , Mohamed Elhoseiny , Ruohan Gao , Dinesh Manocha

As large language models (LLMs) evolve from conversational assistants into autonomous agents, evaluating the safety of their actions becomes critical. Prior safety benchmarks have primarily focused on preventing generation of harmful…

Computation and Language · Computer Science 2026-03-04 Adi Simhi , Jonathan Herzig , Martin Tutek , Itay Itzhak , Idan Szpektor , Yonatan Belinkov

Autonomous agents powered by large language models (LLMs) show promising potential in assistive tasks across various domains, including mobile device control. As these agents interact directly with personal information and device settings,…

Machine Learning · Computer Science 2026-01-28 Juyong Lee , Dongyoon Hahm , June Suk Choi , W. Bradley Knox , Kimin Lee

The Model Context Protocol (MCP) is rapidly emerging as a pivotal open standard, designed to enhance agent-tool integration and interoperability, and is positioned to unlock a new era of powerful, interconnected, and genuinely utilitarian…

Computation and Language · Computer Science 2025-09-15 Zikang Guo , Benfeng Xu , Chiwei Zhu , Wentao Hong , Xiaorui Wang , Zhendong Mao

There is widespread optimism that frontier Large Language Models (LLMs) and LLM-augmented systems have the potential to rapidly accelerate scientific discovery across disciplines. Today, many benchmarks exist to measure LLM knowledge and…

Evaluating large language models (LLM) in clinical scenarios is crucial to assessing their potential clinical utility. Existing benchmarks rely heavily on static question-answering, which does not accurately depict the complex, sequential…

Human-Computer Interaction · Computer Science 2025-05-27 Samuel Schmidgall , Rojin Ziaei , Carl Harris , Eduardo Reis , Jeffrey Jopling , Michael Moor

The rapid growth of AI agent ecosystems is transforming how complex tasks are delegated and executed, creating a new challenge of identifying suitable agents for a given task. Unlike traditional tools, agent capabilities are often…

Artificial Intelligence · Computer Science 2026-04-27 Bin Wu , Arastun Mammadli , Xiaoyu Zhang , Emine Yilmaz

Language agents, built on top of language models (LMs), are systems that can interact with complex environments, such as the open web. In this work, we examine whether such agents can perform realistic and time-consuming tasks on the web,…

Computation and Language · Computer Science 2024-10-22 Ori Yoran , Samuel Joseph Amouyal , Chaitanya Malaviya , Ben Bogin , Ofir Press , Jonathan Berant

Agents powered by large language models (LLMs) are increasingly adopted in the software industry, contributing code as collaborators or even autonomous developers. As their presence grows, it becomes important to assess the current…

Software Engineering · Computer Science 2026-02-12 Qixing Zhou , Jiacheng Zhang , Haiyang Wang , Rui Hao , Jiahe Wang , Minghao Han , Yuxue Yang , Shuzhe Wu , Feiyang Pan , Lue Fan , Dandan Tu , Zhaoxiang Zhang

Recent advancements in Vision Language Models (VLMs) have expanded their capabilities to interactive agent tasks, yet existing benchmarks remain limited to single-agent or text-only environments. In contrast, real-world scenarios often…

Artificial Intelligence · Computer Science 2026-04-14 Zelai Xu , Zhexuan Xu , Xiangmin Yi , Huining Yuan , Mo Guang , Kaiwen Long , Xinlei Chen , Yi Wu , Chao Yu , Yu Wang

Personalized digital health support requires long-horizon, cross-dimensional reasoning over heterogeneous lifestyle signals, and recent advances in mobile sensing and large language models (LLMs) make such support increasingly feasible.…

Artificial Intelligence · Computer Science 2026-01-21 Ye Tian , Zihao Wang , Onat Gungor , Xiaoran Fan , Tajana Rosing

Recent advances in large language models (LLMs) have enabled the emergence of general-purpose agents for automating end-to-end machine learning (ML) workflows, including data analysis, feature engineering, model training, and competition…

Artificial Intelligence · Computer Science 2025-09-12 Hangyi Jia , Yuxi Qian , Hanwen Tong , Xinhui Wu , Lin Chen , Feng Wei

Language agents are increasingly deployed in complex professional workflows, with tutoring emerging as a particularly high-stakes capability that remains largely unmeasured in existing benchmarks. Effective tutor agents require more than…

Artificial Intelligence · Computer Science 2026-05-22 Zixin Chen , Peng Liu , Rui Sheng , Haobo Li , Jianhong Tu , Xiaodong Deng , Kashun Shum , Dayiheng Liu , Huamin Qu

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

Recent multi-modal Large Language Models (LLMs) such as GPT-4o have demonstrated strong capabilities of direct speech interaction. However, the lack of specialized and comprehensive benchmarks for end-to-end speech LLM evaluation hinders…

Computation and Language · Computer Science 2025-09-29 Linhao Zhang , Jian Zhang , Bokai Lei , Chuhan Wu , Aiwei Liu , Wei Jia , Xiao Zhou