English
Related papers

Related papers: Evaluating Speech-to-Text x LLM x Text-to-Speech C…

200 papers

There has been limited evaluation of advanced Text-to-Speech (TTS) models with Mathematical eXpressions (MX) as inputs. In this work, we design experiments to evaluate quality and intelligibility of five TTS models through listening and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Sujoy Roychowdhury , H. G. Ranjani , Sumit Soman , Nishtha Paul , Subhadip Bandyopadhyay , Siddhanth Iyengar

The rapid advancement of large language models (LLMs) has significantly propelled the development of text-based chatbots, demonstrating their capability to engage in coherent and contextually relevant dialogues. However, extending these…

Computation and Language · Computer Science 2024-08-23 Yinghao Aaron Li , Xilin Jiang , Jordan Darefsky , Ge Zhu , Nima Mesgarani

As large language models (LLMs) develop anthropomorphic abilities, they are increasingly being deployed as autonomous agents to interact with humans. However, evaluating their performance in realistic and complex social interactions remains…

Computation and Language · Computer Science 2025-10-28 Shuai Huang , Wenxuan Zhao , Jun Gao

Recently, large language model (LLM) based text-to-speech (TTS) systems have gradually become the mainstream in the industry due to their high naturalness and powerful zero-shot voice cloning capabilities.Here, we introduce the IndexTTS…

Sound · Computer Science 2025-02-11 Wei Deng , Siyi Zhou , Jingchen Shu , Jinchao Wang , Lu Wang

AI-assisted decision making becomes increasingly prevalent, yet individuals often fail to utilize AI-based decision aids appropriately especially when the AI explanations are absent, potentially as they do not %understand reflect on AI's…

Human-Computer Interaction · Computer Science 2025-02-18 Zhuoyan Li , Hangxiao Zhu , Zhuoran Lu , Ziang Xiao , Ming Yin

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Text-to-Speech (TTS) benchmarks often fail to capture how well models handle nuanced and semantically complex text. Building on $\textit{EmergentTTS}$, we introduce $\textit{EmergentTTS-Eval}$, a comprehensive benchmark covering six…

Machine Learning · Computer Science 2025-05-30 Ruskin Raj Manku , Yuzhi Tang , Xingjian Shi , Mu Li , Alex Smola

In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via real-time video communication (RTC), just like chatting with real people. Despite its significance,…

Networking and Internet Architecture · Computer Science 2025-10-02 Jiayang Xu , Xiangjie Huang , Zijie Li , Zili Meng

Large Language Models (LLMs) are increasingly being used to autonomously evaluate the quality of content in communication systems, e.g., to assess responses in telecom customer support chatbots. However, the impartiality of these AI…

Artificial Intelligence · Computer Science 2026-03-03 Jiaxin Gao , Chen Chen , Yanwen Jia , Xueluan Gong , Kwok-Yan Lam , Qian Wang

Obtaining stakeholders' diverse experiences and opinions about current policy in a timely manner is crucial for policymakers to identify strengths and gaps in resource allocation, thereby supporting effective policy design and…

Human-Computer Interaction · Computer Science 2025-10-06 Alex Liu , Min Sun

Given the advancements in conversational artificial intelligence, the evaluation and assessment of Large Language Models (LLMs) play a crucial role in ensuring optimal performance across various conversational tasks. In this paper, we…

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

Computation and Language · Computer Science 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

Recent Text-to-Speech (TTS) systems trained on reading or acted corpora have achieved near human-level naturalness. The diversity of human speech, however, often goes beyond the coverage of these corpora. We believe the ability to handle…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-09 Li-Wei Chen , Shinji Watanabe , Alexander Rudnicky

Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnostic interviews and assessments. This study aims to bridge the…

Computation and Language · Computer Science 2025-05-01 Sichang Tu , Abigail Powers , Stephen Doogan , Jinho D. Choi

Spoken conversational agents are converging toward voice-native LLMs. This tutorial distills the path from cascaded ASR/NLU to end-to-end, retrieval-and vision-grounded systems. We frame adaptation of text LLMs to audio, cross-modal…

Computation and Language · Computer Science 2026-03-10 Chao-Han Huck Yang , Andreas Stolcke , Larry Heck

While textless Spoken Language Models (SLMs) have shown potential in end-to-end speech-to-speech modeling, they still lag behind text-based Large Language Models (LLMs) in terms of semantic coherence and relevance. This work introduces the…

Computation and Language · Computer Science 2025-05-28 Guan-Ting Lin , Prashanth Gurunath Shivakumar , Aditya Gourav , Yile Gu , Ankur Gandhe , Hung-yi Lee , Ivan Bulyko

Conversational AI systems combine AI-based solutions with the flexibility of conversational interfaces. However, most existing testing solutions do not straightforwardly adapt to the characteristics of conversational interaction or to the…

Software Engineering · Computer Science 2026-02-04 Elena Masserini

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption remains largely untested. Existing…

Computation and Language · Computer Science 2025-11-26 Nicolò Pagan , Petter Törnberg , Christopher A. Bail , Anikó Hannák , Christopher Barrie

Recent advances in large language models (LLMs) have significantly improved text-to-speech (TTS) systems, enhancing control over speech style, naturalness, and emotional expression, which brings TTS Systems closer to human-level…