English
Related papers

Related papers: Tiny Transducer: A Highly-efficient Speech Recogni…

200 papers

Few-Shot Sequence Labeling (FSSL) is a canonical paradigm for the tagging models, e.g., named entity recognition and slot filling, to generalize on an emerging, resource-scarce domain. Recently, the metric-based meta-learning framework has…

Computation and Language · Computer Science 2022-05-09 Peiyi Wang , Runxin Xu , Tianyu Liu , Qingyu Zhou , Yunbo Cao , Baobao Chang , Zhifang Sui

Automatic detection of speech dysfluency aids speech-language pathologists in efficient transcription of disordered speech, enhancing diagnostics and treatment planning. Traditional methods, often limited to classification, provide…

In recent years, a great deal of attention has been paid to the Transformer network for speech recognition tasks due to its excellent model performance. However, the Transformer network always involves heavy computation and large number of…

Sound · Computer Science 2023-04-12 Guangyong Wei , Zhikui Duan , Shiren Li , Guangguang Yang , Xinmei Yu , Junhua Li

Recent TTS models with decoder-only Transformer architecture, such as SPEAR-TTS and VALL-E, achieve impressive naturalness and demonstrate the ability for zero-shot adaptation given a speech prompt. However, such decoder-only TTS models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-17 Chenpeng Du , Yiwei Guo , Hankun Wang , Yifan Yang , Zhikang Niu , Shuai Wang , Hui Zhang , Xie Chen , Kai Yu

Anomaly detection is widely used in a broad range of domains from cybersecurity to manufacturing, finance, and so on. Deep learning based anomaly detection has recently drawn much attention because of its superior capability of recognizing…

Machine Learning · Computer Science 2023-05-23 Ronit Das , Tie Luo

Models based on attention mechanisms have shown unprecedented speech recognition performance. However, they are computationally expensive and unnecessarily complex for keyword spotting, a task targeted to small-footprint devices. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-02 Biel Tura , Santiago Escuder , Ferran Diego , Carlos Segura , Jordi Luque

Guessing random additive noise decoding (GRAND) is a noise-centric decoding method, which is suitable for ultra-reliable low-latency communications, as it supports high-rate error correction codes that generate short-length codewords. GRAND…

Information Theory · Computer Science 2022-12-12 Ioannis Chatzigeorgiou , Francisco A. Monteiro

Ultrasound is a key technology in healthcare, and it is being explored for non-invasive, wearable, continuous monitoring of vital signs. However, its widespread adoption in this scenario is still hindered by the size, complexity, and power…

Recent work in multilingual translation advances translation quality surpassing bilingual baselines using deep transformer models with increased capacity. However, the extra latency and memory costs introduced by this approach may make it…

Computation and Language · Computer Science 2022-06-07 Xiang Kong , Adithya Renduchintala , James Cross , Yuqing Tang , Jiatao Gu , Xian Li

Semantic information has been proved effective in scene text recognition. Most existing methods tend to couple both visual and semantic information in an attention-based decoder. As a result, the learning of semantic features is prone to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Changxu Cheng , Bohan Li , Qi Zheng , Yongpan Wang , Wenyu Liu

Nowadays more and more applications can benefit from edge-based text-to-speech (TTS). However, most existing TTS models are too computationally expensive and are not flexible enough to be deployed on the diverse variety of edge devices with…

Sound · Computer Science 2020-11-30 Bichen Wu , Qing He , Peizhao Zhang , Thilo Koehler , Kurt Keutzer , Peter Vajda

Ear recognition is a contactless and unobtrusive biometric technique with applications across various domains. However, deploying high-performing ear recognition models on resource-constrained devices is challenging, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Camile Lendering , Bernardo Perrone Ribeiro , Žiga Emeršič , Peter Peer

The advent of Transformer-based models has surpassed the barriers of text. When working with speech, we must face a problem: the sequence length of an audio input is not suitable for the Transformer. To bypass this problem, a usual approach…

Computation and Language · Computer Science 2021-07-08 Belen Alastruey , Gerard I. Gállego , Marta R. Costa-jussà

There has been immense progress recently in the visual quality of Stable Diffusion-based Super Resolution (SD-SR). However, deploying large diffusion models on computationally restricted devices such as mobile phones remains impractical due…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Mehdi Noroozi , Isma Hadji , Victor Escorcia , Anestis Zaganidis , Brais Martinez , Georgios Tzimiropoulos

Speech enhancement is critical for improving speech intelligibility and quality in various audio devices. In recent years, deep learning-based methods have significantly improved speech enhancement performance, but they often come with a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Xiang Hao , Chenxiang Ma , Qu Yang , Jibin Wu , Kay Chen Tan

People with visual impairments have difficulty accessing touchscreen-enabled personal computing devices like mobile phones and laptops. The image-to-speech (ITS) systems can assist them in mitigating this problem, but their huge model size…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-04 Gokul Srinivasagan , Michael Deisher , Munir Georges

Recent advancements in text-to-speech (TTS) powered by language models have showcased remarkable capabilities in achieving naturalness and zero-shot voice cloning. Notably, the decoder-only transformer is the prominent architecture in this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Théodor Lemerle , Nicolas Obin , Axel Roebel

Image edge detection (ED) requires specialized architectures, reliable supervision, and rigorous evaluation criteria to ensure accurate localization. In this work, we present a framework for high-precision ED that jointly addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Hao Shu

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force…

Machine Learning · Computer Science 2016-09-14 Ronan Collobert , Christian Puhrsch , Gabriel Synnaeve