English
Related papers

Related papers: Exploring Representation Learning for Small-Footpr…

200 papers

Keyword spotting (KWS) is becoming a ubiquitous need with the advancement in artificial intelligence and smart devices. Recent work in this field have focused on several different architectures to achieve good results on datasets with low…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Anwesh Mohanty , Adrian Frischknecht , Christoph Gerum , Oliver Bringmann

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu

Weakly supervised visual recognition using inexact supervision is a critical yet challenging learning problem. It significantly reduces human labeling costs and traditionally relies on multi-instance learning and pseudo-labeling. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Lianghui Zhu , Junwei Zhou , Yan Liu , Xin Hao , Wenyu Liu , Xinggang Wang

In this work, we present a wireless localization method that operates on self-supervised and unlabeled channel estimates. Our self-supervising method learns general-purpose channel features robust to fading and system impairments. Learned…

Signal Processing · Electrical Eng. & Systems 2023-02-15 Artan Salihu , Stefan Schwarz , Markus Rupp

Image denoising is essential in low-level vision applications such as photography and automated driving. Existing methods struggle with distinguishing complex noise patterns in real-world scenes and consume significant computational…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Binghong Chen , Tingting Chai , Wei Jiang , Yuanrong Xu , Guanglu Zhou , Xiangqian Wu

Weakly supervised learning has emerged as an appealing alternative to alleviate the need for large labeled datasets in semantic segmentation. Most current approaches exploit class activation maps (CAMs), which can be generated from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Gaurav Patel , Jose Dolz

Large medical imaging datasets can be cheaply and quickly annotated with low-confidence, weak labels (e.g., radiological scores). Access to high-confidence labels, such as histology-based diagnoses, is rare and costly. Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Emma Sarfati , Alexandre Bône , Marc-Michel Rohé , Pietro Gori , Isabelle Bloch

Most previous neural text-to-speech (TTS) methods are mainly based on supervised learning methods, which means they depend on a large training dataset and hard to achieve comparable performance under low-resource conditions. To address this…

Sound · Computer Science 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams and has become a fast-growing technology thanks to the paradigm shift introduced by deep learning a few years ago. This has allowed the rapid embedding…

Sound · Computer Science 2021-11-23 Iván López-Espejo , Zheng-Hua Tan , John Hansen , Jesper Jensen

Weakly Supervised Object Localization (WSOL), which aims to localize objects by only using image-level labels, has attracted much attention because of its low annotation cost in real applications. Recent studies leverage the advantage of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Haotian Bai , Ruimao Zhang , Jiong Wang , Xiang Wan

Weakly Supervised Semantic Segmentation (WSSS) is challenging, particularly when image-level labels are used to supervise pixel level prediction. To bridge their gap, a Class Activation Map (CAM) is usually generated to provide pixel level…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Weixuan Sun , Jing Zhang , Zheyuan Liu , Yiran Zhong , Nick Barnes

Recent development in angle-resolved photoemission spectroscopy (ARPES) technique involves spatially resolving samples while maintaining the high-resolution feature of momentum space. This development easily expands the data size and its…

Instrumentation and Detectors · Physics 2023-08-24 Sandy Adhitia Ekahana , Genta Indra Winata , Y. Soh , Gabriel Aeppli , Radovic Milan , Ming Shi

Learning generic joint representations for video and text by a supervised method requires a prohibitively substantial amount of manually annotated video datasets. As a practical alternative, a large-scale but uncurated and narrated video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Dohwan Ko , Joonmyung Choi , Juyeon Ko , Shinyeong Noh , Kyoung-Woon On , Eun-Sol Kim , Hyunwoo J. Kim

Existing keyword spotting (KWS) systems primarily rely on predefined keyword phrases. However, the ability to recognize customized keywords is crucial for tailoring interactions with intelligent devices. In this paper, we present a novel…

Computation and Language · Computer Science 2024-11-26 Zhenyu Wang , Shuyu Kong , Li Wan , Biqiao Zhang , Yiteng Huang , Mumin Jin , Ming Sun , Xin Lei , Zhaojun Yang

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount of transcribed data…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Takuya Higuchi , Anmol Gupta , Chandra Dhir

We explore unsupervised pre-training for speech recognition by learning representations of raw audio. wav2vec is trained on large amounts of unlabeled audio data and the resulting representations are then used to improve acoustic model…

Computation and Language · Computer Science 2019-09-12 Steffen Schneider , Alexei Baevski , Ronan Collobert , Michael Auli

In recent years, there has been an increasing focus on user convenience, leading to increased interest in text-based keyword enrollment systems for keyword spotting (KWS). Since the system utilizes text input during the enrollment phase and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Youngmoon Jung , Seungjin Lee , Joon-Young Yang , Jaeyoung Roh , Chang Woo Han , Hoon-Young Cho

Self-supervised speech representation learning (SSL) has shown to be effective in various downstream tasks, but SSL models are usually large and slow. Model compression techniques such as pruning aim to reduce the model size and computation…

Computation and Language · Computer Science 2023-03-01 Yifan Peng , Kwangyoun Kim , Felix Wu , Prashant Sridhar , Shinji Watanabe

Semantic segmentation is a core computer vision problem, but the high costs of data annotation have hindered its wide application. Weakly-Supervised Semantic Segmentation (WSSS) offers a cost-efficient workaround to extensive labeling in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Elham Ravanbakhsh , Cheng Niu , Yongqing Liang , J. Ramanujam , Xin Li