English
Related papers

Related papers: Query-by-Example Keyword Spotting system using Mul…

200 papers

In the past few years, triplet loss-based metric embeddings have become a de-facto standard for several important computer vision problems, most no-tably, person reidentification. On the other hand, in the area of speech recognition the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Roman Vygon , Nikolay Mikhaylovskiy

The quadratic computational complexity of softmax transformers has become a bottleneck in long-context scenarios. In contrast, linear attention model families provide a promising direction towards a more efficient sequential model. These…

Computation and Language · Computer Science 2026-02-04 Difan Deng , Andreas Bentzen Winje , Lukas Fehring , Marius Lindauer

Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism. More specifically, given the description of a person, the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-26 Tao Zhou , Muhao Chen , Jie Yu , Demetri Terzopoulos

Aiming at the problems of cross-modal feature fusion, low efficiency of long text modeling and lack of hierarchical semantic coherence in patent text semantic mining, this study proposes HGM-Net, a deep learning framework that integrates…

Machine Learning · Computer Science 2025-05-27 Zhenzhen Song , Ziwei Liu , Hongji Li

This paper proposes Attention-Seeker, an unsupervised keyphrase extraction method that leverages self-attention maps from a Large Language Model to estimate the importance of candidate phrases. Our approach identifies specific components -…

Computation and Language · Computer Science 2024-12-17 Erwin D. López Z. , Cheng Tang , Atsushi Shimada

3D point cloud semantic segmentation aims to group all points into different semantic categories, which benefits important applications such as point cloud scene reconstruction and understanding. Existing supervised point cloud semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Canyu Zhang , Zhenyao Wu , Xinyi Wu , Ziyu Zhao , Song Wang

The goal in word spotting is to retrieve parts of document images which are relevant with respect to a certain user-defined query. The recent past has seen attribute-based Convolutional Neural Networks take over this field of research. As…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Eugen Rusakov , Sebastian Sudholt , Fabian Wolf , Gernot A. Fink

In this paper we propose to augment a modern neural-network architecture with an attention model inspired by human perception. Specifically, we adversarially train and analyze a neural model incorporating a human inspired, visual attention…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Daniel Zoran , Mike Chrzanowski , Po-Sen Huang , Sven Gowal , Alex Mott , Pushmeet Kohl

Establishing the correct correspondence of feature points is a fundamental task in computer vision. However, the presence of numerous outliers among the feature points can significantly affect the matching results, reducing the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shuyuan Lin , Yu Guo , Xiao Chen , Yanjie Liang , Guobao Xiao , Feiran Huang

Few-shot 3D point cloud semantic segmentation (FS-3DSeg) aims to segment novel classes with only a few labeled samples. However, existing metric-based prototype learning methods generate prototypes solely from the support set, without…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 YiLin Zhou , Lili Wei , Zheming Xu , Ziyi Chen , Congyan Lang

State of the art solutions to query by example spoken term detection (QbE-STD) usually rely on bottleneck feature representation of the query and audio document to perform dynamic time warping (DTW) based template matching. Here, we present…

Computation and Language · Computer Science 2019-07-02 Dhananjay Ram , Lesly Miculicich , Hervé Bourlard

Learning from a few examples remains a key challenge in machine learning. Despite recent advances in important domains such as vision and language, the standard supervised deep learning paradigm does not offer a satisfactory solution for…

Machine Learning · Computer Science 2018-01-01 Oriol Vinyals , Charles Blundell , Timothy Lillicrap , Koray Kavukcuoglu , Daan Wierstra

Attention models are typically learned by optimizing one of three standard loss functions that are variously called -- soft attention, hard attention, and latent variable marginal likelihood (LVML) attention. All three paradigms are…

Machine Learning · Computer Science 2023-10-16 Rahul Vashisht , Harish G. Ramaswamy

Multi-head attention advances neural machine translation by working out multiple versions of attention in different subspaces, but the neglect of semantic overlapping between subspaces increases the difficulty of translation and…

Computation and Language · Computer Science 2019-09-04 Shuhao Gu , Yang Feng

In this paper, we propose to incorporate convolutional neural networks with a multi-context attention mechanism into an end-to-end framework for human pose estimation. We adopt stacked hourglass networks to generate attention maps from…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Xiao Chu , Wei Yang , Wanli Ouyang , Cheng Ma , Alan L. Yuille , Xiaogang Wang

We cast visual retrieval as a regression problem by posing triplet loss as a regression loss. This enables epistemic uncertainty estimation using dropout as a Bayesian approximation framework in retrieval. Accordingly, Monte Carlo (MC)…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Ahmed Taha , Yi-Ting Chen , Xitong Yang , Teruhisa Misu , Larry Davis

Fine-grained classification of microscopic image data with limited samples is an open problem in computer vision and biomedical imaging. Deep learning based vision systems mostly deal with high number of low-resolution images, whereas…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Mengran Fan , Tapabrata Chakrabort , Eric I-Chao Chang , Yan Xu , Jens Rittscher

Intent detection and slot filling are two fundamental tasks for building a spoken language understanding (SLU) system. Multiple deep learning-based joint models have demonstrated excellent results on the two tasks. In this paper, we propose…

Computation and Language · Computer Science 2021-02-10 Pengfei Wei , Bi Zeng , Wenxiong Liao

We consider the importance of different utterances in the context for selecting the response usually depends on the current query. In this paper, we propose the model TripleNet to fully model the task with the triple <context, query,…

Computation and Language · Computer Science 2019-11-05 Wentao Ma , Yiming Cui , Nan Shao , Su He , Wei-Nan Zhang , Ting Liu , Shijin Wang , Guoping Hu

User-defined keyword spotting on a resource-constrained edge device is challenging. However, keywords are often bounded by a maximum keyword length, which has been largely under-leveraged in prior works. Our analysis of keyword-length…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Kumari Nishu , Minsik Cho , Devang Naik