English
Related papers

Related papers: Sommelier: Scalable Open Multi-turn Audio Pre-proc…

200 papers

The continued improvements in language model capability have unlocked their widespread use as drivers of autonomous agents, for example in coding or computer use applications. However, the core of these systems has not changed much since…

Machine Learning · Computer Science 2026-05-13 Guinan Su , Yanwu Yang , Xueyan Li , Jonas Geiping

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

The advent of large language models marks a revolutionary breakthrough in artificial intelligence. With the unprecedented scale of training and model parameters, the capability of large language models has been dramatically improved,…

Information Retrieval · Computer Science 2025-01-16 Jin Chen , Zheng Liu , Xu Huang , Chenwang Wu , Qi Liu , Gangwei Jiang , Yuanhao Pu , Yuxuan Lei , Xiaolong Chen , Xingmei Wang , Defu Lian , Enhong Chen

Large language models (LLMs) have revolutionized the landscape of Natural Language Processing systems, but are computationally expensive. To reduce the cost without sacrificing performance, previous studies have explored various approaches…

Computation and Language · Computer Science 2024-10-01 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

Computation and Language · Computer Science 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Assessing ways in which Language Models can reduce their hallucinations and improve the outputs' quality is crucial to ensure their large-scale use. However, methods such as fine-tuning on domain-specific data or the training of a separate…

Computation and Language · Computer Science 2026-01-29 Sara Candussio

Audio-Language Models (ALMs), trained on paired audio-text data, are designed to process, understand, and reason about audio-centric multimodal content. Unlike traditional supervised approaches that use predefined labels, ALMs leverage…

Sound · Computer Science 2026-03-13 Yi Su , Jisheng Bai , Qisheng Xu , Kele Xu , Yong Dou

Language models (LMs) are machine learning models designed to predict linguistic patterns by estimating the probability of word sequences based on large-scale datasets, such as text. LMs have a wide range of applications in natural language…

With the recent success of large language models (LLMs), the idea of AI-augmented Business Process Management systems is becoming more feasible. One of their essential characteristics is the ability to be conversationally actionable,…

Artificial Intelligence · Computer Science 2026-04-21 Nataliia Klievtsova , Timotheus Kampik , Juergen Mangler , Stefanie Rinderle-Ma

Multimodal systems, which process multiple input types such as text, audio, and images, are becoming increasingly prevalent in software systems, enabled by the huge advancements in Machine Learning. This triggers the need to easily define…

Software Engineering · Computer Science 2025-08-21 Marcos Gomez-Vazquez , Jordi Cabot

Large Audio Language Models (LALMs) have emerged as powerful tools for speech-related tasks but remain underexplored for fine-tuning, especially with limited speech data. To bridge this gap, we systematically examine how different…

Sound · Computer Science 2026-01-22 Youngwon Choi , Jaeyoon Jung , Hyeonyu Kim , Huu-Kim Nguyen , Hwayeon Kim

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

While Large Language Models (LLMs) have shown potential in speech generation and recognition, their applications are mainly confined to monolingual scenarios, with limited explorations in code-switched (CS) contexts. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-25 Jing Xu , Daxin Tan , Jiaqi Wang , Xiao Chen

The rapid advancement of large language models (LLMs) has revolutionized artificial intelligence, introducing unprecedented capabilities in natural language processing and multimodal content generation. However, the increasing complexity…

Software Engineering · Computer Science 2024-11-27 Shenao Wang , Yanjie Zhao , Xinyi Hou , Haoyu Wang

This survey paper provides a comprehensive overview of the recent advancements and challenges in applying large language models to the field of audio signal processing. Audio processing, with its diverse signal representations and a wide…

Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they…

Sound · Computer Science 2024-08-30 Ke Chen , Jiaqi Su , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Zeyu Jin

The advent of Large Language Models (LLMs) has significantly transformed tasks across Software Engineering. In the context of Business Process Management, LLMs are now being explored as tools to derive process models directly from textual…

Software Engineering · Computer Science 2026-05-01 Pedro-Aarón Hernández-Ávalos , Luciano García-Bañuelos

LLM-based automatic speech recognition models demonstrate strong performance by connecting audio encoders and LLMs. However, data scarcity of paired speech and transcription often hinders their adaptation to new domains, making text-only…

Sound · Computer Science 2026-05-15 Ryo Magoshi , Takashi Maekaku , Yusuke Shinohara

Recent studies have demonstrated that prompting large language models (LLM) with audio encodings enables effective speech recognition capabilities. However, the ability of Speech LLMs to comprehend and process multi-channel audio with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-19 Jiamin Xie , Ju Lin , Yiteng Huang , Tyler Vuong , Zhaojiang Lin , Zhaojun Yang , Peng Su , Prashant Rawat , Sangeeta Srivastava , Ming Sun , Florian Metze