English
Related papers

Related papers: Separating Long-Form Speech with Group-Wise Permut…

200 papers

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

Lipreading has a lot of potential applications such as in the domain of surveillance and video conferencing. Despite this, most of the work in building lipreading systems has been limited to classifying silent videos into classes…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-03 Yaman Kumar , Rohit Jain , Khwaja Mohd. Salik , Rajiv Ratn Shah , Yifang yin , Roger Zimmermann

Speech or text representation generated by pre-trained models contains modal-specific information that could be combined for benefiting spoken language understanding (SLU) tasks. In this work, we propose a novel pre-training paradigm termed…

Computation and Language · Computer Science 2023-05-30 Linhao Dong , Zhecheng An , Peihao Wu , Jun Zhang , Lu Lu , Zejun Ma

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech. This is a challenging task because face appearance variation and semantics of speech are coupled together in the subtle movements of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Hang Zhou , Yu Liu , Ziwei Liu , Ping Luo , Xiaogang Wang

Language Model pre-training uses broad data mixtures to enhance performance across domains and languages. However, training on such heterogeneous text corpora requires extensive and expensive efforts. Since these data sources vary…

Machine Learning · Computer Science 2025-04-08 Alex Iacob , Lorenzo Sani , Meghdad Kurmanji , William F. Shen , Xinchi Qiu , Dongqi Cai , Yan Gao , Nicholas D. Lane

In this work, we introduce Speech-Copilot, a modular framework for instruction-oriented speech-processing tasks that minimizes human effort in toolset construction. Unlike end-to-end methods using large audio-language models, Speech-Copilot…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-24 Chun-Yi Kuan , Chih-Kai Yang , Wei-Ping Huang , Ke-Han Lu , Hung-yi Lee

The fusion of speech and language in the era of large language models has garnered significant attention. Discrete speech token is often utilized in text-to-speech tasks for speech compression and portability, which is convenient for joint…

Sound · Computer Science 2025-04-01 Yixing Li , Ruobing Xie , Xingwu Sun , Yu Cheng , Zhanhui Kang

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Norman Mu , Alexander Kirillov , David Wagner , Saining Xie

Our objective is an audio-visual model for separating a single speaker from a mixture of sounds such as other speakers and background noise. Moreover, we wish to hear the speaker even when the visual cues are temporarily absent due to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

In noisy and reverberant environments, the performance of deep learning-based speech separation methods drops dramatically because previous methods are not designed and optimized for such situations. To address this issue, we propose a…

Sound · Computer Science 2023-03-08 Zhaoxi Mu , Xinyu Yang , Xiangyuan Yang , Wenjing Zhu

End-to-end multi-talker speech recognition has garnered great interest as an effective approach to directly transcribe overlapped speech from multiple speakers. Current methods typically adopt either 1) single-input multiple-output (SIMO)…

Sound · Computer Science 2024-07-23 Jiawen Kang , Lingwei Meng , Mingyu Cui , Haohan Guo , Xixin Wu , Xunying Liu , Helen Meng

Deep neural network with dual-path bi-directional long short-term memory (BiLSTM) block has been proved to be very effective in sequence modeling, especially in speech separation. This work investigates how to extend dual-path BiLSTM to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Ziqiang Shi , Rujie Liu , Jiqing Han

Speech data has rich acoustic and paralinguistic information with important cues for understanding a speaker's tone, emotion, and intent, yet traditional large language models such as BERT do not incorporate this information. There has been…

Computation and Language · Computer Science 2023-11-14 Fatema Hasan , Yulong Li , James Foulds , Shimei Pan , Bishwaranjan Bhattacharjee

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

Recent advances in Natural Language Processing, and in particular on the construction of very large pre-trained language representation models, is opening up new perspectives on the construction of conversational information seeking (CIS)…

Computation and Language · Computer Science 2022-04-08 Patrizio Bellan , Mauro Dragoni , Chiara Ghidini

Open-vocabulary panoptic segmentation remains a challenging problem. One of the biggest difficulties lies in training models to generalize to an unlimited number of classes using limited categorized training data. Recent popular methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yi-Chia Chen , Wei-Hua Li , Chu-Song Chen

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

Despite imperfect score-matching causing drift in training and sampling distributions of diffusion models, recent advances in diffusion-based acoustic models have revolutionized data-sufficient single-speaker Text-to-Speech (TTS)…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Heyang Xue , Shuai Guo , Pengcheng Zhu , Mengxiao Bi

Interruption plays a crucial role in collaborative learning, shaping group interactions and influencing knowledge construction. AI-driven support can assist teachers in monitoring these interactions. However, most previous work on…

Computation and Language · Computer Science 2025-07-11 Mariah Bradford , Nikhil Krishnaswamy , Nathaniel Blanchard

We present a speaker-aware approach for simulating multi-speaker conversations that captures temporal consistency and realistic turn-taking dynamics. Prior work typically models aggregate conversational statistics under an independence…

Sound · Computer Science 2026-05-25 Máté Gedeon , Péter Mihajlik