English
Related papers

Related papers: Voice Evaluation of Reasoning Ability: Diagnosing …

200 papers

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

Confidence estimation (CE) indicates how reliable the answers of large language models are and impacts user trust and decision-making. Existing evaluations mainly concern the alignment between confidence and correctness, but ignore the…

Computation and Language · Computer Science 2026-05-29 Yuxi Xia , Dennis Ulmer , Terra Blevins , Yihong Liu , Hinrich Schütze , Benjamin Roth

Personal voice activity detection has received increased attention due to the growing popularity of personal mobile devices and smart speakers. PVAD is often an integral element to speech enhancement and recognition for these applications…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Yicheng Hsu , Mingsian R. Bai

Effective abstention (EA), recognizing evidence insufficiency and refraining from answering, is critical for reliable multimodal systems. Yet existing evaluation paradigms for vision-language models (VLMs) and multi-agent systems (MAS)…

Computation and Language · Computer Science 2026-04-17 Nishanth Madhusudhan , Vikas Yadav , Alexandre Lacoste

Speaker verification (SV) models are increasingly integrated into security, personalization, and access control systems, yet their robustness to many real-world challenges remains inadequately benchmarked. These include a variety of natural…

Large Language Models are increasingly used in robotics for task planning, but their reliance on textual inputs limits their adaptability to real-world changes and failures. To address these challenges, we propose LERa - Look, Explain,…

Numerous tools for neural network inference are currently available, yet many do not meet the requirements of real-time audio applications. In response, we introduce anira, an efficient cross-platform library. To ensure compatibility with a…

Sound · Computer Science 2025-06-17 Valentin Ackva , Fares Schulz

Root cause analysis (RCA) is essential for diagnosing failures within complex software systems to ensure system reliability. The highly distributed and interdependent nature of modern cloud-based systems often complicates RCA efforts,…

Software Engineering · Computer Science 2026-02-02 Evelien Riddell , James Riddell , Gengyi Sun , Michał Antkiewicz , Krzysztof Czarnecki

Reinforcement Learning with Verifiable Rewards (RLVR) is widely used to improve reasoning in large language models, but rewards only final-answer correctness with no supervision over intermediate steps. Rubric-based methods such as Rubrics…

Data augmentation is vital to the generalization ability and robustness of deep neural networks (DNNs) models. Existing augmentation methods for speaker verification manipulate the raw signal, which are time-consuming and the augmented…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-19 Yuanyuan Wang , Yang Zhang , Zhiyong Wu , Zhihan Yang , Tao Wei , Kun Zou , Helen Meng

Multi-modal generative document parsing systems challenge traditional evaluation: unlike deterministic OCR or layout models, they often produce semantically correct yet structurally divergent outputs. Conventional metrics-CER, WER, IoU, or…

Computation and Language · Computer Science 2025-09-25 Renyu Li , Antonio Jimeno Yepes , Yao You , Kamil Pluciński , Maximilian Operlejn , Crag Wolfe

There are various factors that can influence the performance of speaker recognition systems, such as emotion, language and other speaker-related or context-related variations. Since individual speech frames do not contribute equally to the…

Sound · Computer Science 2026-01-23 Junjie Li , Kong Aik Lee , Duc-Tuan Truong , Tianchi Liu , Man-Wai Mak

Text-to-audio models are a type of generative model that produces audio output in response to a given textual prompt. Although level generators and the properties of the functional content that they create (e.g., playability) dominate most…

Sound · Computer Science 2025-11-17 Jonathan Morse , Azadeh Naderi , Swen Gaudl , Mark Cartwright , Amy K. Hoover , Mark J. Nelson

This paper proposes VARA-TTS, a non-autoregressive (non-AR) text-to-speech (TTS) model using a very deep Variational Autoencoder (VDVAE) with Residual Attention mechanism, which refines the textual-to-acoustic alignment layer-wisely.…

Sound · Computer Science 2021-02-15 Peng Liu , Yuewen Cao , Songxiang Liu , Na Hu , Guangzhi Li , Chao Weng , Dan Su

Referring Expression Comprehension (REC) aims to localize the image region corresponding to a natural language query. Recent neuro-symbolic REC approaches leverage large language models (LLMs) and vision-language models (VLMs) to perform…

Artificial Intelligence · Computer Science 2026-03-23 Hyejin Park , Junhyuk Kwon , Suha Kwak , Jungseul Ok

Voice disorders affect a large portion of the population, especially heavy voice users such as teachers or call-center workers. Most voice disorders can be treated effectively with behavioral voice therapy, which teaches patients to replace…

Sound · Computer Science 2021-02-16 Chuyao Feng , Eva van Leer , Mackenzie Lee Curtis , David V. Anderson

Recent advancements in Generative AI have significantly improved the efficiency and adaptability of natural language processing (NLP) systems, particularly through Retrieval-Augmented Generation (RAG), Low-Rank Adaptation (LoRA), and…

Computation and Language · Computer Science 2025-02-18 Mohammad Baqar , Rajat Khanda

We present an architecture for voice trigger detection for virtual assistants. The main idea in this work is to exploit information in words that immediately follow the trigger phrase. We first demonstrate that by including more audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-03 Siddharth Sigtia , John Bridle , Hywel Richards , Pascal Clark , Erik Marchi , Vineet Garg

With the release of OpenAI's o1 model, reasoning models that adopt slow-thinking strategies have become increasingly common. Their outputs often contain complex reasoning, intermediate steps, and self-reflection, making existing evaluation…

Computation and Language · Computer Science 2026-01-01 Ding Chen , Qingchen Yu , Pengyuan Wang , Mengting Hu , Wentao Zhang , Zhengren Wang , Bo Tang , Feiyu Xiong , Xinchi Li , Chao Wang , Minchuan Yang , Zhiyu Li

Recent progress in multimodal large language models (MLLMs) has led to a surge of benchmarks for long-video reasoning. However, most existing benchmarks rely on localized cues and fail to capture narrative reasoning, the ability to track…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Rahul Jain , Keval Doshi , Burak Uzkent , Garin Kessler