English
Related papers

Related papers: Training dynamic models using early exits for auto…

200 papers

Modern predictive models are often deployed to environments in which computational budgets are dynamic. Anytime algorithms are well-suited to such environments as, at any point during computation, they can output a prediction whose quality…

Machine Learning · Computer Science 2023-10-31 Metod Jazbec , James Urquhart Allingham , Dan Zhang , Eric Nalisnick

The inference of large language models imposes significant computational workloads, often requiring the processing of billions of parameters. Although early-exit strategies have proven effective in reducing computational demands by halting…

Computation and Language · Computer Science 2026-01-08 Sangmin Yoo , Srikanth Malla , Chiho Choi , Wei D. Lu , Joon Hee Choi

Deep neural networks have long training and processing times. Early exits added to neural networks allow the network to make early predictions using intermediate activations in the network in time-sensitive applications. However, early…

Machine Learning · Computer Science 2022-12-27 Devdhar Patel , Hava Siegelmann

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Deep Neural Networks (DNNs) have grown increasingly large in size to achieve state of the art performance across a wide range of tasks. However, their high computational requirements make them less suitable for resource-constrained…

Machine Learning · Computer Science 2025-01-15 Divya Jyoti Bajpai , Manjesh Kumar Hanawal

Automatic speech recognition (ASR) models are normally trained to operate over single utterances, with a short duration of less than 30 seconds. This choice has been made in part due to computational constraints, but also reflects a common,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Robert Flynn , Anton Ragni

Recently, Transformer based models have shown competitive automatic speech recognition (ASR) performance. One key factor in the success of these models is the multi-head attention mechanism. However, for trained models, we have previously…

Computation and Language · Computer Science 2021-04-07 Shucong Zhang , Erfan Loweimi , Peter Bell , Steve Renals

Although end-to-end (E2E) trainable automatic speech recognition (ASR) has shown great success by jointly learning acoustic and linguistic information, it still suffers from the effect of domain shifts, thus limiting potential applications.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Keqi Deng , Philip C. Woodland

Early-Exit (EE) is a Large Language Model (LLM) architecture that accelerates inference by allowing easier tokens to be generated using only a subset of the model's layers. However, traditional batching frameworks are ill-suited for EE…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-18 Xuting Liu , Daniel Alexander , Siva Kesava Reddy Kakarla , Behnaz Arzani , Vincent Liu

Automatic modulation classification (AMC) plays a critical role in wireless communications by autonomously classifying signals transmitted over the radio spectrum. Deep learning (DL) techniques are increasingly being used for AMC due to…

Networking and Internet Architecture · Computer Science 2023-11-10 Elsayed Mohammed , Omar Mashaal , Hatem Abou-Zeid

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

Advances in machine learning have made it possible to perform various text and speech processing tasks, such as automatic speech recognition (ASR), in an end-to-end (E2E) manner. E2E approaches utilizing pre-trained models are gaining…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Yukiya Hono , Koh Mitsuda , Tianyu Zhao , Kentaro Mitsui , Toshiaki Wakatsuki , Kei Sawada

The growing demand for intelligent applications beyond the network edge, coupled with the need for sustainable operation, are driving the seamless integration of deep learning (DL) algorithms into energy-limited, and even energy-harvesting…

Machine Learning · Computer Science 2024-11-08 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

Deep neural networks (DNNs) have been successfully applied in various fields. In DNNs, a large number of multiply-accumulate (MAC) operations are required to be performed, posing critical challenges in applying them in resource-constrained…

Machine Learning · Computer Science 2024-02-20 Jingcun Wang , Bing Li , Grace Li Zhang

Large reasoning models that use long chain-of-thought excel at problem-solving yet waste compute on redundant checks. Curbing this overthinking is hard: training-time length penalties can cripple ability, while inference-time early-exit…

Artificial Intelligence · Computer Science 2026-04-21 Benteng Chen , Weida Wang , Shufei Zhang , Mingbao Lin , Min Zhang

Automatic Speech Recognition (ASR) has increased in popularity in recent years. The evolution of processor and storage technologies has enabled more advanced ASR mechanisms, fueling the development of virtual assistants such as Amazon…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-04 Sebastian Baunsgaard , Sebastian B. Wrede , Pınar Tozun

Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs)…

Machine Learning · Computer Science 2021-09-20 Adarsh Kumar Kosta , Malik Aqeel Anwar , Priyadarshini Panda , Arijit Raychowdhury , Kaushik Roy

Large-scale Transformer models bring significant improvements for various downstream vision language tasks with a unified architecture. The performance improvements come with increasing model size, resulting in slow inference speed and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Shengkun Tang , Yaqing Wang , Zhenglun Kong , Tianchi Zhang , Yao Li , Caiwen Ding , Yanzhi Wang , Yi Liang , Dongkuan Xu

Self-supervised pre-training of a speech foundation model, followed by supervised fine-tuning, has shown impressive quality improvements on automatic speech recognition (ASR) tasks. Fine-tuning separate foundation models for many downstream…

Machine Learning · Computer Science 2022-11-08 Zhouyuan Huo , Khe Chai Sim , Bo Li , Dongseong Hwang , Tara N. Sainath , Trevor Strohman

Automatic speech recognition (ASR) is a capability which enables a program to process human speech into a written form. Recent developments in artificial intelligence (AI) have led to high-accuracy ASR systems based on deep neural networks,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-05 Thomas Bohnstingl , Ayush Garg , Stanisław Woźniak , George Saon , Evangelos Eleftheriou , Angeliki Pantazi