English
Related papers

Related papers: Qwen2-Audio Technical Report

200 papers

Multi-modal large language models are regarded as a crucial step towards Artificial General Intelligence (AGI) and have garnered significant interest with the emergence of ChatGPT. However, current speech-language models typically adopt the…

Computation and Language · Computer Science 2023-05-22 Dong Zhang , Shimin Li , Xin Zhang , Jun Zhan , Pengyu Wang , Yaqian Zhou , Xipeng Qiu

In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images. Starting from the Qwen-LM as a foundation, we endow it with visual capacity by the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Jinze Bai , Shuai Bai , Shusheng Yang , Shijie Wang , Sinan Tan , Peng Wang , Junyang Lin , Chang Zhou , Jingren Zhou

Voice plays an important role in our lives by facilitating communication, conveying emotions, and indicating health. Therefore, tracking vocal interactions can provide valuable insight into many aspects of our lives. This paper presents our…

Sound · Computer Science 2023-12-19 Sheen An Goh , Manoj Gulati , Ambuj Varshney

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

We introduce a new approach to generative data-driven dialogue systems (e.g. chatbots) called TransferTransfo which is a combination of a Transfer learning based training scheme and a high-capacity Transformer model. Fine-tuning is…

Computation and Language · Computer Science 2019-02-05 Thomas Wolf , Victor Sanh , Julien Chaumond , Clement Delangue

We introduce the latest series of TeleChat models: \textbf{TeleChat2}, \textbf{TeleChat2.5}, and \textbf{T1}, offering a significant upgrade over their predecessor, TeleChat. Despite minimal changes to the model architecture, the new series…

We propose Omni-R1 which fine-tunes a recent multi-modal LLM, Qwen2.5-Omni, on an audio question answering dataset with the reinforcement learning method GRPO. This leads to new State-of-the-Art performance on the recent MMAU and MMAR…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-24 Andrew Rouditchenko , Saurabhchand Bhati , Edson Araujo , Samuel Thomas , Hilde Kuehne , Rogerio Feris , James Glass

The recent revolutionary progress in text-based large language models (LLMs) has contributed to the growth of interest in extending capabilities of such models to multimodal perception and understanding tasks. Hearing is an essential…

A key component of dyadic spoken interactions is the contextually relevant non-verbal gestures, such as head movements that reflect a listener's response to the interlocutor's speech. Although significant progress has been made in the…

Robotics · Computer Science 2024-10-01 Bishal Ghosh , Emma Li , Tanaya Guha

We present Qwen-Image-2.0, an omni-capable image generation foundation model that unifies high-fidelity generation and precise image editing within a single framework. Despite recent progress, existing models still struggle with ultra-long…

Reasoning has become a defining capability of modern foundation models, yet its development in the audio modality remains limited. Audio poses challenges that are distinct from those of text and vision. It is continuous, temporally dense,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Zhihan Guo , Wenqian Cui , Guan-Ting Lin , Daxin Tan , Jingyao Li , Qiyong Zheng , Dingdong Wang , Jing Xiong , Han Shi , Jiaya Jia , Irwin King

This paper introduces V2A-DPO, a novel Direct Preference Optimization (DPO) framework tailored for flow-based video-to-audio generation (V2A) models, incorporating key adaptations to effectively align generated audio with human preferences.…

Sound · Computer Science 2026-03-13 Nolan Chan , Timmy Gang , Yongqian Wang , Yuzhe Liang , Dingdong Wang

Voice agents, artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applications. However, no existing benchmark jointly addresses two core evaluation challenges:…

In this paper, we present a novel approach for text independent phone-to-audio alignment based on phoneme recognition, representation learning and knowledge transfer. Our method leverages a self-supervised model (wav2vec2) fine-tuned for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-06 Noé Tits , Prernna Bhatnagar , Thierry Dutoit

The DIAlogue MOdel Learning Environment supports an engineering-oriented approach towards dialogue modelling for a spoken-language interface. Major steps towards dialogue models is to know about the basic units that are used to construct a…

cmp-lg · Computer Science 2008-02-03 Jens-Uwe Moeller

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

Computation and Language · Computer Science 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Conversational text-to-speech (TTS) aims to synthesize speech with proper prosody of reply based on the historical conversation. However, it is still a challenge to comprehensively model the conversation, and a majority of conversational…

Sound · Computer Science 2023-05-04 Jinlong Xue , Yayue Deng , Fengping Wang , Ya Li , Yingming Gao , Jianhua Tao , Jianqing Sun , Jiaen Liang

While recent work in controllable text-to-audio (TTA) generation has achieved fine-grained control through timestamp conditioning, its scope remains limited by audio quality and input format. These models often suffer from poor audio…

Sound · Computer Science 2025-10-14 Zihao Zheng , Zeyu Xie , Xuenan Xu , Wen Wu , Chao Zhang , Mengyue Wu

Large-scale pre-training has shown remarkable performance in building open-domain dialogue systems. However, previous works mainly focus on showing and evaluating the conversational performance of the released dialogue model, ignoring the…

Computation and Language · Computer Science 2023-10-24 Yuxian Gu , Jiaxin Wen , Hao Sun , Yi Song , Pei Ke , Chujie Zheng , Zheng Zhang , Jianzhu Yao , Lei Liu , Xiaoyan Zhu , Minlie Huang

While full-duplex speech agents enable natural, low-latency interaction by speaking and listening simultaneously, their consistency and task performance in multi-turn settings remain underexplored. We introduce Full-Duplex-Bench-v2…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Guan-Ting Lin , Shih-Yun Shan Kuan , Jiatong Shi , Kai-Wei Chang , Siddhant Arora , Shinji Watanabe , Hung-yi Lee