中文
相关论文

相关论文: Using Large Language Model for End-to-End Chinese …

200 篇论文

Recent techniques such as retrieval-augmented generation or chain-of-thought reasoning have led to longer contexts and increased inference costs. Context compression techniques can reduce these costs, but the most effective approaches…

计算与语言 · 计算机科学 2025-10-24 Hippolyte Pilchen , Edouard Grave , Patrick Pérez

End-to-end models have been showing superiority in Automatic Speech Recognition (ASR). At the same time, the capacity of streaming recognition has become a growing requirement for end-to-end models. Following these trends, an…

声音 · 计算机科学 2019-02-27 Linhao Dong , Shiyu Zhou , Wei Chen , Bo Xu

Advances in self-supervised encoders have improved Visual Speech Recognition (VSR). Recent approaches integrating these encoders with LLM decoders improves transcription accuracy; however, it remains unclear whether these gains stem from…

声音 · 计算机科学 2026-01-21 Rishabh Jain , Naomi Harte

Integrating large language models (LLMs) into automatic speech recognition (ASR) has become a mainstream paradigm in recent years. Although existing LLM-based ASR models demonstrate impressive performance on public benchmarks, their…

音频与语音处理 · 电气工程与系统科学 2026-04-21 Yuan Xie , Jiaqi Song , Guang Qiu , Xianliang Wang , Kai Qiao , Junfeng Yuan , Shengqing Liu , Yi Zhang , Bowen Chen , Ming Lei , Jie Gao , Jie Wu

The streaming automatic speech recognition (ASR) models are more popular and suitable for voice-based applications. However, non-streaming models provide better performance as they look at the entire audio context. To leverage the benefits…

声音 · 计算机科学 2022-08-26 Raviraj Joshi , Subodh Kumar

We present the Open ASR Leaderboard, a reproducible benchmarking platform with community contributions from academia and industry. It compares 86 open-source and proprietary systems across 12 datasets, with English short- and long-form and…

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B…

We present FireRedASR, a family of large-scale automatic speech recognition (ASR) models for Mandarin, designed to meet diverse requirements in superior performance and optimal efficiency across various applications. FireRedASR comprises…

音频与语音处理 · 电气工程与系统科学 2025-01-27 Kai-Tuo Xu , Feng-Long Xie , Xu Tang , Yao Hu

In this paper, we present MooER, a LLM-based large-scale automatic speech recognition (ASR) / automatic speech translation (AST) model of Moore Threads. A 5000h pseudo labeled dataset containing open source and self collected speech data is…

计算与语言 · 计算机科学 2024-08-12 Junhao Xu , Zhenlin Liang , Yi Liu , Yichao Hu , Jian Li , Yajun Zheng , Meng Cai , Hua Wang

Conversational automatic speech recognition remains challenging due to overlapping speech, far-field noise, and varying speaker counts. While recent LLM-based systems perform well on single-speaker benchmarks, their robustness in…

计算与语言 · 计算机科学 2026-03-25 Naohiro Tawara , Samuele Cornell , Alexander Polok , Marc Delcroix , Lukáš Burget , Shinji Watanabe

Patent classification into CPC codes underpins large scale analyses of technological change but remains challenging due to its hierarchical, multi label, and highly imbalanced structure. While pre Generative AI supervised encoder based…

计算工程、金融与科学 · 计算机科学 2026-02-02 Lorenzo Emer , Marco Lippi , Andrea Mina , Andrea Vandin

Attention-based methods and Connectionist Temporal Classification (CTC) network have been promising research directions for end-to-end Automatic Speech Recognition (ASR). The joint CTC/Attention model has achieved great success by utilizing…

计算与语言 · 计算机科学 2018-11-13 Ruizhi Li , Xiaofei Wang , Sri Harish Mallidi , Takaaki Hori , Shinji Watanabe , Hynek Hermansky

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in end-to-end speaker diarization and recognition. However, their speaker discriminability remains limited due to the scarcity of large-scale conversational data…

Sequence-to-sequence attention-based models integrate an acoustic, pronunciation and language model into a single neural network, which make them very suitable for multilingual automatic speech recognition (ASR). In this paper, we are…

音频与语音处理 · 电气工程与系统科学 2018-06-15 Shiyu Zhou , Shuang Xu , Bo Xu

Recently, many works have tried to augment the performance of Chinese named entity recognition (NER) using word lexicons. As a representative, Lattice-LSTM (Zhang and Yang, 2018) has achieved new benchmark results on several public Chinese…

计算与语言 · 计算机科学 2020-10-15 Ruotian Ma , Minlong Peng , Qi Zhang , Xuanjing Huang

Connecting audio encoders with large language models (LLMs) allows the LLM to perform various audio understanding tasks, such as automatic speech recognition (ASR) and audio captioning (AC). Most research focuses on training an adapter…

音频与语音处理 · 电气工程与系统科学 2025-09-22 Weiqiao Shan , Yuang Li , Yuhao Zhang , Yingfeng Luo , Chen Xu , Xiaofeng Zhao , Long Meng , Yunfei Lu , Min Zhang , Hao Yang , Tong Xiao , Jingbo Zhu

SLU combines ASR and NLU capabilities to accomplish speech-to-intent understanding. In this paper, we compare different ways to combine ASR and NLU, in particular using a single Conformer model with different ways to use its components, to…

计算与语言 · 计算机科学 2022-04-11 Nick J. C. Wang , Shaojun Wang , Jing Xiao

Recent advances in deep learning and automatic speech recognition (ASR) have enabled the end-to-end (E2E) ASR system and boosted the accuracy to a new level. The E2E systems implicitly model all conventional ASR components, such as the…

The rapid growth of large-language models (LLMs) is driving a new wave of specialized hardware for inference. This paper presents the first workload-centric, cross-architectural performance study of commercial AI accelerators, spanning…

硬件体系结构 · 计算机科学 2025-06-10 Amit Sharma

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

音频与语音处理 · 电气工程与系统科学 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu