English
Related papers

Related papers: Language Modeling with Highway LSTM

200 papers

Lipreading, i.e. speech recognition from visual-only recordings of a speaker's face, can be achieved with a processing pipeline based solely on neural networks, yielding significantly better accuracy than conventional methods. Feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2016-02-01 Michael Wand , Jan Koutník , Jürgen Schmidhuber

We describe a collection of acoustic and language modeling techniques that lowered the word error rate of our English conversational telephone LVCSR system to a record 6.6% on the Switchboard subset of the Hub5 2000 evaluation testset. On…

Computation and Language · Computer Science 2016-06-23 George Saon , Tom Sercu , Steven Rennie , Hong-Kwang J. Kuo

This paper examines memory mechanisms in Large Language Models (LLMs), emphasizing their importance for context-rich responses, reduced hallucinations, and improved efficiency. It categorizes memory into sensory, short-term, and long-term,…

Computation and Language · Computer Science 2025-04-25 Lianlei Shan , Shixian Luo , Zezhou Zhu , Yu Yuan , Yong Wu

We explore deep autoregressive Transformer models in language modeling for speech recognition. We focus on two aspects. First, we revisit Transformer model configurations specifically for language modeling. We show that well configured…

Computation and Language · Computer Science 2019-09-25 Kazuki Irie , Albert Zeyer , Ralf Schlüter , Hermann Ney

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

Machine Learning · Computer Science 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen

We describe a large vocabulary speech recognition system that is accurate, has low latency, and yet has a small enough memory and computational footprint to run faster than real-time on a Nexus 5 Android smartphone. We employ a quantized…

We introduce multiplicative LSTM (mLSTM), a recurrent neural network architecture for sequence modelling that combines the long short-term memory (LSTM) and multiplicative recurrent neural network architectures. mLSTM is characterised by…

Neural and Evolutionary Computing · Computer Science 2017-10-13 Ben Krause , Liang Lu , Iain Murray , Steve Renals

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

Large language models (LLM) have demonstrated the ability to understand human language by leveraging large amount of text data. Automatic speech recognition (ASR) systems are often limited by available transcribed speech data and benefit…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Aditya Gourav , Yi Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

Using translation memories (TMs) as prompts is a promising approach to in-context learning of machine translation models. In this work, we take a step towards prompting large language models (LLMs) with TMs and making them better…

Computation and Language · Computer Science 2023-05-30 Yongyu Mu , Abudurexiti Reheman , Zhiquan Cao , Yuchun Fan , Bei Li , Yinqiao Li , Tong Xiao , Chunliang Zhang , Jingbo Zhu

This paper addresses the robust speech recognition problem as an adaptation task. Specifically, we investigate the cumulative application of adaptation methods. A bidirectional Long Short-Term Memory (BLSTM) based neural network, capable of…

Computation and Language · Computer Science 2019-06-17 Markus Kitza , Pavel Golik , Ralf Schlüter , Hermann Ney

Traffic prediction plays an important role in evaluating the performance of telecommunication networks and attracts intense research interests. A significant number of algorithms and models have been put forward to analyse traffic data and…

Networking and Internet Architecture · Computer Science 2018-04-04 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Automated detection of voice disorders with computational methods is a recent research area in the medical domain since it requires a rigorous endoscopy for the accurate diagnosis. Efficient screening methods are required for the diagnosis…

Quantitative Methods · Quantitative Biology 2018-12-06 Vibhuti Gupta

Most current long-context language models still rely on attention to handle both local interaction and long-range state, which leaves relatively little room to test alternative decompositions of sequence modeling. We propose LPC-SM, a…

Computation and Language · Computer Science 2026-04-11 Keqin Xie

The rapid advancement of Large Language Models (LLMs) has spurred significant progress in Large Speech-Language Models (LSLMs), enhancing their capabilities in both speech understanding and generation. While existing LSLMs often concentrate…

Computation and Language · Computer Science 2025-11-03 Shoutao Guo , Shaolei Zhang , Qingkai Fang , Zhengrui Ma , Min Zhang , Yang Feng

In this paper, we investigate the usage of large language models (LLMs) to improve the performance of competitive speech recognition systems. Different from previous LLM-based ASR error correction methods, we propose a novel multi-stage…

Computation and Language · Computer Science 2024-06-18 Jie Pu , Thai-Son Nguyen , Sebastian Stüker

Documents exhibit sequential structure at multiple levels of abstraction (e.g., sentences, paragraphs, sections). These abstractions constitute a natural hierarchy for representing the context in which to infer the meaning of words and…

Computation and Language · Computer Science 2016-06-01 Shalini Ghosh , Oriol Vinyals , Brian Strope , Scott Roy , Tom Dean , Larry Heck

In this work, we apply word embeddings and neural networks with Long Short-Term Memory (LSTM) to text classification problems, where the classification criteria are decided by the context of the application. We examine two applications in…

Computation and Language · Computer Science 2016-07-15 Adithya Rao , Nemanja Spasojevic

Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have been successfully applied to a variety of sequence modeling tasks. In this paper we develop Tree Long Short-Term Memory…

Computation and Language · Computer Science 2016-04-05 Xingxing Zhang , Liang Lu , Mirella Lapata

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM)…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Xinnian Liang , Jian Yang , Hui Huang , Shuangzhi Wu , Peihao Wu , Lu Lu , Zejun Ma , Zhoujun Li