English
Related papers

Related papers: Qwen vs. Gemma Integration with Whisper: A Compara…

200 papers

Speech emotion recognition (SER) systems can exhibit gender-related performance disparities, but how such bias manifests in multilingual speech LLMs across languages and modalities is unclear. We introduce a novel multilingual, multimodal…

Sound · Computer Science 2026-03-24 Zi Haur Pang , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

We present a multimodal fusion framework that bridges pre-trained decoder-based large language models (LLM) and acoustic encoder-decoder architectures such as Whisper, with the aim of building speech-enabled LLMs. Instead of directly using…

Computation and Language · Computer Science 2025-09-22 Dimitrios Damianos , Leon Voukoutis , Georgios Paraskevopoulos , Vassilis Katsouros

Large Language Models (LLMs) exhibit strong linguistic capabilities, but little is known about how they encode psycholinguistic knowledge across languages. We investigate whether and how LLMs exhibit human-like psycholinguistic responses…

Computation and Language · Computer Science 2025-08-05 Shuzhou Yuan , Zhan Qu , Mario Tawfelis , Michael Färber

Foundation models based on large language models (LLMs) have shown great success in handling various tasks and modalities. However, adapting these models for general-purpose audio-language tasks is challenging due to differences in acoustic…

Artificial Intelligence · Computer Science 2025-05-27 Pooneh Mousavi , Shubham Gupta , Cem Subakan , Mirco Ravanelli

Large language models (LLMs) exhibit cultural bias from overrepresented viewpoints in training data, yet cultural alignment remains a challenge due to limited cultural knowledge and a lack of exploration into effective learning approaches.…

Computation and Language · Computer Science 2025-12-16 Chunhua Liu , Kabir Manandhar Shrestha , Sukai Huang

We present Llama-GENBA-10B, a trilingual foundation model addressing English-centric bias in large language models. Built on Llama 3.1-8B and scaled to 10B parameters, Llama-GENBA-10B is continuously pretrained on 164B tokens (82B English,…

Computation and Language · Computer Science 2025-09-09 Michael Hoffmann , Jophin John , Stefan Schweter , Gokul Ramakrishnan , Hoi-Fong Mak , Alice Zhang , Dmitry Gaynullin , Nicolay J. Hammer

Large Language Models (LLMs) have achieved remarkable success in Natural Language Processing (NLP), yet their cross-lingual performance consistency remains a significant challenge. This paper introduces a novel methodology for efficiently…

Computation and Language · Computer Science 2025-05-27 Zixiang Xu , Yanbo Wang , Yue Huang , Xiuying Chen , Jieyu Zhao , Meng Jiang , Xiangliang Zhang

Perception and understanding are two pillars of computer vision. While multimodal large language models (MLLM) have demonstrated remarkable visual understanding capabilities, they arguably lack accurate perception abilities, e.g. the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Qing Jiang , Gen Luo , Yuqin Yang , Yuda Xiong , Yihao Chen , Zhaoyang Zeng , Tianhe Ren , Lei Zhang

This paper summarizes the Interspeech2025 Multilingual Conversational Speech Language Model (MLC-SLM) challenge, which aims to advance the exploration of building effective multilingual conversational speech LLMs (SLLMs). We provide a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Bingshen Mu , Pengcheng Guo , Zhaokai Sun , Shuai Wang , Hexin Liu , Mingchen Shao , Lei Xie , Eng Siong Chng , Longshuai Xiao , Qiangze Feng , Daliang Wang

This paper describes our system submission to the International Conference on Spoken Language Translation (IWSLT 2025), low-resource languages track, namely for Bemba-to-English speech translation. We built cascaded speech translation…

Computation and Language · Computer Science 2025-08-14 Muhammad Hazim Al Farouq , Aman Kassahun Wassie , Yasmin Moslem

This article presents a whisper speech detector in the far-field domain. The proposed system consists of a long-short term memory (LSTM) neural network trained on log-filterbank energy (LFBE) acoustic features. This model is trained and…

Computation and Language · Computer Science 2020-04-07 Zeynab Raeesy , Kellen Gillespie , Zhenpei Yang , Chengyuan Ma , Thomas Drugman , Jiacheng Gu , Roland Maas , Ariya Rastrow , Björn Hoffmeister

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

This paper presents a simple yet effective regularization for the internal language model induced by the decoder in encoder-decoder ASR models, thereby improving robustness and generalization in both in- and out-of-domain settings. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Alexander Polok , Santosh Kesiraju , Karel Beneš , Bolaji Yusuf , Lukáš Burget , Jan Černocký

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

Computation and Language · Computer Science 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

Business interview preparation demands both solid theoretical grounding and refined soft skills, yet conventional classroom methods rarely deliver the individualized, culturally aware practice employers currently expect. This paper…

Computers and Society · Computer Science 2025-08-19 Truong Thanh Hung Nguyen , Tran Diem Quynh Nguyen , Hoang Loc Cao , Thi Cam Thanh Tran , Thi Cam Mai Truong , Hung Cao

Emerging AI accelerators increasingly adopt wafer-scale manufacturing technologies, integrating hundreds of thousands of AI cores in a mesh architecture with large distributed on-chip memory (tens of GB in total) and ultra-high on-chip…

Machine Learning · Computer Science 2025-06-02 Congjie He , Yeqi Huang , Pei Mu , Ziming Miao , Jilong Xue , Lingxiao Ma , Fan Yang , Luo Mai

This study focuses on improving the performance of lightweight Large Language Models (LLMs) in mathematical reasoning tasks. We introduce a novel method for measuring mathematical logic similarity and design an automatic screening mechanism…

Computation and Language · Computer Science 2024-09-04 Ding Kai , Ma Zhenguo , Yan Xiaoran

Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and available large-scale multilingual datasets. Despite that,…

Computation and Language · Computer Science 2025-06-30 Jiahong Li , Yiwen Shao , Jianheng Zhuo , Chenda Li , Liliang Tang , Dong Yu , Yanmin Qian

In this report, we introduce Qwen2.5, a comprehensive series of large language models (LLMs) designed to meet diverse needs. Compared to previous iterations, Qwen 2.5 has been significantly improved during both the pre-training and…

Large Language Model (LLM) pretraining, finetuning, and evaluation rely on input-space reconstruction and generative capabilities. Yet, it has been observed in vision that embedding-space training objectives, e.g., with Joint Embedding…

Computation and Language · Computer Science 2025-10-08 Hai Huang , Yann LeCun , Randall Balestriero
‹ Prev 1 8 9 10 Next ›