English
Related papers

Related papers: Composing Finite State Transducers on GPUs

200 papers

Finite-state transducers (FSTs) are frequently used in speech recognition. Transducer composition is an essential operation for combining different sources of information at different granularities. However, composition is also one of the…

Computation and Language · Computer Science 2021-10-07 Shubho Sengupta , Vineel Pratap , Awni Hannun

Weighted finite automata and transducers (including hidden Markov models and conditional random fields) are widely used in natural language processing (NLP) to perform tasks such as morphological analysis, part-of-speech tagging, chunking,…

Computation and Language · Computer Science 2017-01-18 Arturo Argueta , David Chiang

Finite-State Transducers (FSTs) are effective models for string-to-string rewriting tasks, often providing the efficiency necessary for high-performance applications, but constructing transducers by hand is difficult. In this work, we…

Computation and Language · Computer Science 2026-01-21 Michael Ginn , Alexis Palmer , Mans Hulden

Context-dependent rewrite rules are used in many areas of natural language and speech processing. Work in computational phonology has demonstrated that, given certain conditions, such rewrite rules can be represented as finite-state…

cmp-lg · Computer Science 2008-02-03 Mehryar Mohri , Richard Sproat

We present an optimized weighted finite-state transducer (WFST) decoder capable of online streaming and offline batch processing of audio using Graphics Processing Units (GPUs). The decoder is efficient in memory utilization, input/output…

Computation and Language · Computer Science 2020-02-17 Hugo Braun , Justin Luitjens , Ryan Leary , Tim Kaldewey , Daniel Povey

While Connectionist Temporal Classification (CTC) models deliver state-of-the-art accuracy in automated speech recognition (ASR) pipelines, their performance has been limited by CPU-based beam search decoding. We introduce a GPU-accelerated…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-10 Daniel Galvez , Tim Kaldewey

We introduce a framework for automatic differentiation with weighted finite-state transducers (WFSTs) allowing them to be used dynamically at training time. Through the separation of graphs from operations on graphs, this framework enables…

Machine Learning · Computer Science 2020-10-05 Awni Hannun , Vineel Pratap , Jacob Kahn , Wei-Ning Hsu

We propose a finite-state transducer (FST) representation for the models used to decode keyboard inputs on mobile devices. Drawing from learnings from the field of speech recognition, we describe a decoding framework that can satisfy the…

Computation and Language · Computer Science 2017-04-14 Tom Ouyang , David Rybach , Françoise Beaufays , Michael Riley

Finite-state automata are a very effective tool in natural language processing. However, in a variety of applications and especially in speech precessing, it is necessary to consider more general machines in which arcs are assigned weights…

Computation and Language · Computer Science 2007-05-23 Mehryar Mohri , Fernando Pereira , Michael Riley

Composition of weighted transducers is a fundamental algorithm used in many applications, including for computing complex edit-distances between automata, or string kernels in machine learning, or to combine different components of a speech…

Computational Complexity · Computer Science 2008-02-22 Cyril Allauzen , Mehryar Mohri

We describe initial work on an extension of the Kaldi toolkit that supports weighted finite-state transducer (WFST) decoding on Graphics Processing Units (GPUs). We implement token recombination as an atomic GPU operation in order to fully…

Computation and Language · Computer Science 2018-07-30 Zhehuai Chen , Justin Luitjens , Hainan Xu , Yiming Wang , Daniel Povey , Sanjeev Khudanpur

Incremental text-to-speech, also known as streaming TTS, has been increasingly applied to online speech applications that require ultra-low response latency to provide an optimal user experience. However, most of the existing speech…

Sound · Computer Science 2022-12-06 Muyang Du , Chuan Liu , Jiaxing Qi , Junjie Lai

Weighted Finite State Transducers (WFSTs) are versatile data structures that can model a great number of problems, ranging from Automatic Speech Recognition to DNA sequencing. Traditional computer science algorithms are employed when…

Rings and Algebras · Mathematics 2018-11-05 Emmanouil Theodosis , Petros Maragos

Speech processing requires very efficient methods and algorithms. Finite-state transducers have been shown recently both to constitute a very useful abstract model and to lead to highly efficient time and space algorithms in this field. We…

cmp-lg · Computer Science 2008-02-03 Mehryar Mohri , Michael Riley , Richard Sproat

This paper addresses issues in part of speech disambiguation using finite-state transducers and presents two main contributions to the field. One of them is the use of finite-state machines for part of speech tagging. Linguistic and…

cmp-lg · Computer Science 2007-05-23 Evelyne Tzoukermann , Dragomir R. Radev

Recently, end-to-end automatic speech recognition has become the mainstream approach in both industry and academia. To optimize system performance in specific scenarios, the Weighted Finite-State Transducer (WFST) is extensively used to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Wei Zhang , Tian-Hao Zhang , Chao Luo , Hui Zhou , Chao Yang , Xinyuan Qian , Xu-Cheng Yin

This article describes an algorithm for reducing the intermediate alphabets in cascades of finite-state transducers (FSTs). Although the method modifies the component FSTs, there is no change in the overall relation described by the whole…

Computation and Language · Computer Science 2007-05-23 Andre Kempe

FFT (fast Fourier transform) plays a very important role in many fields, such as digital signal processing, digital image processing and so on. However, in application, FFT becomes a factor of affecting the processing efficiency, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-25 Fan Zhang , Chen Hu , Qiang Yin , Wei Hu

In recent years, high performance scientific computing on graphics processing units (GPUs) have gained widespread acceptance. These devices are designed to offer massively parallel threads for running code with general purpose. There are…

Mathematical Software · Computer Science 2018-02-13 Tao Cui , Xiaohu Guo , Hui Liu

This paper explores practical aspects of using a high-level functional language for GPU-based arithmetic on ``midsize'' integers. By this we mean integers of up to about a quarter million bits, which is sufficient for most practical…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Cosmin E. Oancea , Stephen M. Watt
‹ Prev 1 2 3 10 Next ›