English
Related papers

Related papers: Query-by-Example Keyword Spotting system using Mul…

200 papers

Keyword spotting is an important research field because it plays a key role in device wake-up and user interaction on smart devices. However, it is challenging to minimize errors while operating efficiently in devices with limited resources…

Sound · Computer Science 2023-07-06 Byeonggeun Kim , Simyung Chang , Jinkyu Lee , Dooyong Sung

Attention mechanisms in biological perception are thought to select subsets of perceptual information for more sophisticated processing which would be prohibitive to perform on all sensory inputs. In computer vision, however, there has been…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Mateusz Malinowski , Carl Doersch , Adam Santoro , Peter Battaglia

Search advertising is essential for merchants to reach the target users on short video platforms. Short video ads aligned with user search intents are displayed through relevance matching and bid ranking mechanisms. This paper focuses on…

Information Retrieval · Computer Science 2025-02-11 Guobing Gan , Kaiming Gao , Li Wang , Shen Jiang , Peng Jiang

Two of the central factors believed to underpin human sentence processing difficulty are expectations and retrieval from working memory. A recent attempt to create a unified cognitive model integrating these two factors relied on the…

Computation and Language · Computer Science 2023-10-26 William Timkey , Tal Linzen

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. In this paper, we propose a temporally…

Sound · Computer Science 2021-08-30 Shenghua Hu , Jing Wang , Yujun Wang , Wenjing Yang

Recently, multi-task spoken language understanding (SLU) models have emerged, designed to address various speech processing tasks. However, these models often rely on a large number of parameters. Also, they often encounter difficulties in…

Computation and Language · Computer Science 2024-06-19 Hayato Futami , Siddhant Arora , Yosuke Kashiwagi , Emiru Tsunoo , Shinji Watanabe

We present memory-based learning approaches to shallow parsing and apply these to five tasks: base noun phrase identification, arbitrary base phrase recognition, clause detection, noun phrase parsing and full parsing. We use feature…

Computation and Language · Computer Science 2007-05-23 Erik F. Tjong Kim Sang

Recently, a deep reinforcement learning method is proposed to solve multiobjective optimization problem. In this method, the multiobjective optimization problem is decomposed to a number of single-objective optimization subproblems and all…

Neural and Evolutionary Computing · Computer Science 2020-02-14 Hong Wu , Jiahai Wang , Zizhen Zhang

Several text classification tasks such as sentiment analysis, news categorization, multi-label classification and opinion classification are challenging problems even for modern deep learning networks. Recently, Capsule Networks (CapsNets)…

Computation and Language · Computer Science 2020-07-09 Akhilesh Kumar Gangwar , Vadlamani Ravi

Few-shot learning arises in important practical scenarios, such as when a natural language understanding system needs to learn new semantic labels for an emerging, resource-scarce domain. In this paper, we explore retrieval-based methods…

Computation and Language · Computer Science 2021-04-14 Dian Yu , Luheng He , Yuan Zhang , Xinya Du , Panupong Pasupat , Qi Li

This paper is interested in investigating whether human gaze signals can be leveraged to improve state-of-the-art search engine performance and how to incorporate this new input signal marked by human attention into existing neural…

Information Retrieval · Computer Science 2022-07-06 Sibo Dong , Justin Goldstein , Grace Hui Yang

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

Artificial Intelligence · Computer Science 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

We simplify sentences with an attentive neural network sequence to sequence model, dubbed S4. The model includes a novel word-copy mechanism and loss function to exploit linguistic similarities between the original and simplified sentences.…

Computation and Language · Computer Science 2018-05-16 Alexander Mathews , Lexing Xie , Xuming He

We introduce a neural network with a recurrent attention model over a possibly large external memory. The architecture is a form of Memory Network (Weston et al., 2015) but unlike the model in that work, it is trained end-to-end, and hence…

Neural and Evolutionary Computing · Computer Science 2015-11-25 Sainbayar Sukhbaatar , Arthur Szlam , Jason Weston , Rob Fergus

In this paper, we propose a deep hierarchical attention context model for lossless attribute compression of point clouds, leveraging a multi-resolution spatial structure and residual learning. A simple and effective Level of Detail (LoD)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yueru Chen , Wei Zhang , Dingquan Li , Jing Wang , Ge Li

The performance of deep neural networks improves with more annotated data. The problem is that the budget for annotation is limited. One solution to this is active learning, where a model asks human to annotate data that it perceived as…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Donggeun Yoo , In So Kweon

Multimedia or spoken content presents more attractive information than plain text content, but the former is more difficult to display on a screen and be selected by a user. As a result, accessing large collections of the former is much…

Computation and Language · Computer Science 2017-01-03 Wei Fang , Jui-Yang Hsu , Hung-yi Lee , Lin-Shan Lee

We consider the problem of predicting edges in a graph from node attributes in an e-commerce setting. Specifically, given nodes labelled with search query text, we want to predict links to related queries that share products. Experiments…

Machine Learning · Computer Science 2020-06-15 Matthew Dippel , Adam Kiezun , Tanay Mehta , Ravi Sundaram , Srikanth Thirumalai , Akshar Varma

Keyword spotting (KWS) provides a critical user interface for many mobile and edge applications, including phones, wearables, and cars. As KWS systems are typically 'always on', maximizing both accuracy and power efficiency are central to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-11 Peter Blouw , Gurshaant Malik , Benjamin Morcos , Aaron R. Voelker , Chris Eliasmith