English
Related papers

Related papers: Neural Architecture Search For Keyword Spotting

200 papers

Deep learning has shown promising results on many machine learning tasks but DL models are often complex networks with large number of neurons and layers, and recently, complex layer structures known as building blocks. Finding the best…

Machine Learning · Computer Science 2018-01-29 Jayanta K Dutta , Jiayi Liu , Unmesh Kurup , Mohak Shah

The success of Machine Learning is increasingly tempered by its significant resource footprint, driving interest in efficient paradigms like TinyML. However, the inherent complexity of designing TinyML systems hampers their broad adoption.…

Machine Learning · Computer Science 2025-07-22 Yujia Shi , Emil Njor , Pablo Martínez-Nuevo , Sven Ewan Shepstone , Xenofon Fafoutis

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

Sound · Computer Science 2021-04-15 David Peter , Wolfgang Roth , Franz Pernkopf

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end…

Machine Learning · Computer Science 2021-08-05 Ibrahim Alshubaily

In this paper, we propose a Neural Architecture Search strategy based on self supervision and semi-supervised learning for the task of semantic segmentation. Our approach builds an optimized neural network (NN) model for this task by…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Loïc Pauletto , Massih-Reza Amini , Nicolas Winckler

Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face…

Machine Learning · Computer Science 2023-01-18 Anshumaan Chauhan , Siddhartha Bhattacharyya , S. Vadivel

The design of compact deep neural networks is a crucial task to enable widespread adoption of deep neural networks in the real-world, particularly for edge and mobile scenarios. Due to the time-consuming and challenging nature of manually…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Mohammad Javad Shafiee , Andrew Hryniowski , Francis Li , Zhong Qiu Lin , Alexander Wong

Automatic search of neural architectures for various vision and natural language tasks is becoming a prominent tool as it allows to discover high-performing structures on any dataset of interest. Nevertheless, on more difficult domains,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Vladimir Nekrasov , Chunhua Shen , Ian Reid

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

In recent years, deep convolutional neural networks have achieved state of the art performance in various computer vision task such as classification, detection or segmentation. Due to their outstanding performance, CNNs are more and more…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Sebastian Sudholt , Gernot A. Fink

We explore the application of deep residual learning and dilated convolutions to the keyword spotting task, using the recently-released Google Speech Commands Dataset as our benchmark. Our best residual network (ResNet) implementation…

Computation and Language · Computer Science 2018-09-24 Raphael Tang , Jimmy Lin

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Used for simple commands recognition on devices from smart routers to mobile phones, keyword spotting systems are everywhere. Ubiquitous as well are web applications, which have grown in popularity and complexity over the last decade with…

Computers and Society · Computer Science 2018-11-01 Jaejun Lee , Raphael Tang , Jimmy Lin

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

Sound · Computer Science 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

We present a cascade architecture for keyword spotting with speaker verification on mobile devices. By pairing a small computational footprint with specialized digital signal processing (DSP) chips, we are able to achieve low power…

Sound · Computer Science 2017-12-12 Alexander Gruenstein , Raziel Alvarez , Chris Thornton , Mohammadali Ghodrat

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

Neural and Evolutionary Computing · Computer Science 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

Deep convolutional neural networks demonstrate impressive results in the super-resolution domain. A series of studies concentrate on improving peak signal noise ratio (PSNR) by using much deeper layers, which are not friendly to constrained…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Xiangxiang Chu , Bo Zhang , Hailong Ma , Ruijun Xu , Qingyuan Li