English
Related papers

Related papers: EVA-Bench: A New End-to-end Framework for Evaluati…

200 papers

Small language models are attractive for production deployment due to their low cost, fast inference, and ease of specialization. However, adapting them to a specific task remains a challenging engineering loop, driven not by training…

Artificial Intelligence · Computer Science 2026-04-14 Dhruv Atreja , Julia White , Nikhil Nayak , Kelton Zhang , Henrijs Princis , George Hurn-Maloney , Ash Lewis , Urchade Zaratiana

In recent years, Multi-Talker Audio-Video Generation (MTAVG) models have shown promising performance on fundamental metrics such as lip-sync and audio-visual alignment. However, these metrics remain insufficient for assessing cinematic…

Sustaining coherent, role-aware communication across multi-agent systems remains a foundational challenge in AI. Current frameworks often lack explicit mechanisms for speaker responsibility, leading to context drift, alignment instability,…

Artificial Intelligence · Computer Science 2025-06-03 Khe-Han Toh , Hong-Kuan Teo

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

Recent advances in large language models (LLMs) have driven significant progress in end-to-end spoken dialogue models (SDMs). In contrast to text-based LLMs, the evaluation framework for SDMs should encompass both cognitive dimensions…

Computation and Language · Computer Science 2025-08-12 Ruiqi Yan , Xiquan Li , Wenxi Chen , Zhikang Niu , Chen Yang , Ziyang Ma , Kai Yu , Xie Chen

Embodied agents exhibit immense potential across a multitude of domains, making the assurance of their behavioral safety a fundamental prerequisite for their widespread deployment. However, existing research predominantly concentrates on…

Artificial Intelligence · Computer Science 2025-06-23 Ning Wang , Zihan Yan , Weiyang Li , Chuan Ma , He Chen , Tao Xiang

The challenge of low-latency speech translation has recently draw significant interest in the research community as shown by several publications and shared tasks. Therefore, it is essential to evaluate these different approaches in…

This paper introduces FastVC, an end-to-end model for fast Voice Conversion (VC). The proposed model can convert speech of arbitrary length from multiple source speakers to multiple target speakers. FastVC is based on a conditional…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-07 Oriol Barbany Mayor , Milos Cernak

On the way towards general Visual Question Answering (VQA) systems that are able to answer arbitrary questions, the need arises for evaluation beyond single-metric leaderboards for specific datasets. To this end, we propose a browser-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Dirk Väth , Pascal Tilli , Ngoc Thang Vu

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du

As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks remain largely confined to structured or exam-style tasks that fall short of real-world…

As autonomous coding agents become capable of handling increasingly long-horizon tasks, they have gradually demonstrated the potential to complete end-to-end software development. Although existing benchmarks have recently evolved from…

Software Engineering · Computer Science 2026-05-19 Qingnan Ren , Shun Zou , Shiting Huang , Ziao Zhang , Kou Shi , Zhen Fang , Yiming Zhao , Yu Zeng , Qisheng Su , Lin Chen , Yong Wang , Zehui Chen , Xiangxiang Chu , Feng Zhao

The Model Context Protocol (MCP) is rapidly emerging as a pivotal open standard, designed to enhance agent-tool integration and interoperability, and is positioned to unlock a new era of powerful, interconnected, and genuinely utilitarian…

Computation and Language · Computer Science 2025-09-15 Zikang Guo , Benfeng Xu , Chiwei Zhu , Wentao Hong , Xiaorui Wang , Zhendong Mao

The rapid advancement of Large Language Models (LLMs) has outpaced the scalability of traditional evaluation benchmarks, which remain heavily dependent on labor-intensive expert curation. We address this bottleneck with Conv-to-Bench, a…

Automating AI research holds immense potential for accelerating scientific progress, yet current AI agents struggle with the complexities of rigorous, end-to-end experimentation. We introduce EXP-Bench, a novel benchmark designed to…

We present Doctorina MedBench, a comprehensive evaluation framework for agent-based medical AI based on the simulation of realistic physician-patient interactions. Unlike traditional medical benchmarks that rely on solving standardized test…

Computation and Language · Computer Science 2026-03-30 Anna Kozlova , Stanislau Salavei , Pavel Satalkin , Hanna Plotnitskaya , Sergey Parfenyuk

Current LLM agent benchmarks, which predominantly focus on binary pass/fail tasks such as code generation or search-based question answering, often neglect the value of real-world engineering that is often captured through the iterative…

In this paper, we present a novel framework that jointly performs three tasks: speaker diarization, speech separation, and speaker counting. Our proposed framework integrates speaker diarization based on end-to-end neural diarization (EEND)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-19 Soumi Maiti , Yushi Ueda , Shinji Watanabe , Chunlei Zhang , Meng Yu , Shi-Xiong Zhang , Yong Xu

Speaker verification (SV) models are increasingly integrated into security, personalization, and access control systems, yet their robustness to many real-world challenges remains inadequately benchmarked. These include a variety of natural…

AI agents hold the potential to revolutionize scientific productivity by automating literature reviews, replicating experiments, analyzing data, and even proposing new directions of inquiry; indeed, there are now many such agents, ranging…