中文
相关论文

相关论文: Neural Architecture Search For Keyword Spotting

200 篇论文

Neural Architecture Search (NAS) algorithms automate the task of finding optimal deep learning architectures given an initial search space of possible operations. Developing these search spaces is usually a manual affair with pre-optimized…

机器学习 · 计算机科学 2021-11-08 Robert Wu , Nayan Saxena , Rohan Jain

Neural Architecture Search is a costly practice. The fact that a search space can span a vast number of design choices with each architecture evaluation taking nontrivial overhead makes it hard for an algorithm to sufficiently explore…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Keith G. Mills , Fred X. Han , Mohammad Salameh , Shengyao Lu , Chunhua Zhou , Jiao He , Fengyu Sun , Di Niu

Much of the recent improvement in neural networks for computer vision has resulted from discovery of new networks architectures. Most prior work has used the performance of candidate models following limited training to automatically guide…

计算机视觉与模式识别 · 计算机科学 2019-09-09 Pouya Bashivan , Mark Tensen , James J DiCarlo

With neural architecture search methods gaining ground on manually designed deep neural networks -even more rapidly as model sophistication escalates-, the research trend shifts towards arranging different and often increasingly complex…

神经与进化计算 · 计算机科学 2022-08-18 Unai Garciarena , Roberto Santana , Alexander Mendiburu

Deep neural networks have been the driving force behind the success in classification tasks, e.g., object and audio recognition. Impressive results and generalization have been achieved by a variety of recently proposed architectures, the…

计算机视觉与模式识别 · 计算机科学 2022-08-12 Grigorios G Chrysos , Markos Georgopoulos , Jiankang Deng , Jean Kossaifi , Yannis Panagakis , Anima Anandkumar

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Transformer-based models have achieved stateof-the-art results in many tasks in natural language processing. However, such models are usually slow at inference time, making deployment difficult. In this paper, we develop an efficient…

机器学习 · 计算机科学 2020-08-18 Henry Tsai , Jayden Ooi , Chun-Sung Ferng , Hyung Won Chung , Jason Riesa

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

We propose a vision-based architecture search algorithm for robot manipulation learning, which discovers interactions between low dimension action inputs and high dimensional visual inputs. Our approach automatically designs architectures…

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

声音 · 计算机科学 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

Semantic matching is of central importance to many natural language tasks \cite{bordes2014semantic,RetrievalQA}. A successful matching algorithm needs to adequately model the internal structures of language objects and the interaction…

计算与语言 · 计算机科学 2015-03-12 Baotian Hu , Zhengdong Lu , Hang Li , Qingcai Chen

This paper proposes a neural architecture search space using ResNet as a framework, with search objectives including parameters for convolution, pooling, fully connected layers, and connectivity of the residual network. In addition to…

神经与进化计算 · 计算机科学 2025-11-03 Shang Wang , Huanrong Tang , Jianquan Ouyang

Neural architecture search has been shown to hold great promise towards the automation of deep learning. However in spite of its potential, neural architecture search remains quite costly. To this point, we propose a novel gradient-based…

机器学习 · 计算机科学 2019-02-18 Efi Kokiopoulou , Anja Hauth , Luciano Sbaiz , Andrea Gesmundo , Gabor Bartok , Jesse Berent

Deep Neural Networks (DNNs) are intensively used to solve a wide variety of complex problems. Although powerful, such systems require manual configuration and tuning. To this end, we view DNNs as configurable systems and propose an…

机器学习 · 计算机科学 2019-04-10 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Differentiable neural architecture search methods became popular in recent years, mainly due to their low search costs and flexibility in designing the search space. However, these methods suffer the difficulty in optimizing network, so…

计算机视觉与模式识别 · 计算机科学 2020-03-27 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Bowen Shi , Qi Tian , Hongkai Xiong

This paper addresses the scalability challenge of architecture search by formulating the task in a differentiable manner. Unlike conventional approaches of applying evolution or reinforcement learning over a discrete and non-differentiable…

机器学习 · 计算机科学 2019-04-24 Hanxiao Liu , Karen Simonyan , Yiming Yang

The dramatic success of deep neural networks across multiple application areas often relies on experts painstakingly designing a network architecture specific to each task. To simplify this process and make it more accessible, an emerging…

机器学习 · 计算机科学 2018-01-17 Kamil Bennani-Smires , Claudiu Musat , Andreea Hossmann , Michael Baeriswyl

In this paper, we propose a context-aware keyword spotting model employing a character-level recurrent neural network (RNN) for spoken term detection in continuous speech. The RNN is end-to-end trained with connectionist temporal…

计算与语言 · 计算机科学 2015-12-31 Kyuyeon Hwang , Minjae Lee , Wonyong Sung

Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a…

机器学习 · 计算机科学 2019-09-05 Renqian Luo , Fei Tian , Tao Qin , Enhong Chen , Tie-Yan Liu

Recently, Neural Architecture Search (NAS) has successfully identified neural network architectures that exceed human designed ones on large-scale image classification. In this paper, we study NAS for semantic image segmentation. Existing…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Chenxi Liu , Liang-Chieh Chen , Florian Schroff , Hartwig Adam , Wei Hua , Alan Yuille , Li Fei-Fei