English
Related papers

Related papers: DB-KSVD: Scalable Alternating Optimization for Dis…

200 papers

Frames are the foundation of the linear operators used in the decomposition and reconstruction of signals, such as the discrete Fourier transform, Gabor, wavelets, and curvelet transforms. The emergence of sparse representation models has…

Signal Processing · Electrical Eng. & Systems 2019-06-26 Wen-Liang Hwang , Ping-Tzan Huang , Tai-Lang Jong

Existing zero-shot skeleton-based action recognition methods utilize projection networks to learn a shared latent space of skeleton features and semantic embeddings. The inherent imbalance in action recognition datasets, characterized by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sheng-Wei Li , Zi-Xiang Wei , Wei-Jie Chen , Yi-Hsin Yu , Chih-Yuan Yang , Jane Yung-jen Hsu

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

Sound · Computer Science 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Domain adaptation aims to mitigate the domain gap when transferring knowledge from an existing labeled domain to a new domain. However, existing disentanglement-based methods do not fully consider separation between domain-invariant and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Youshan Zhang , Brian D. Davison

Learning sentence embeddings often requires a large amount of labeled data. However, for most tasks and domains, labeled data is seldom available and creating it is expensive. In this work, we present a new state-of-the-art unsupervised…

Computation and Language · Computer Science 2021-09-13 Kexin Wang , Nils Reimers , Iryna Gurevych

Self-supervised disentangled representation learning is a critical task in sequence modeling. The learnt representations contribute to better model interpretability as well as the data generation, and improve the sample efficiency for…

Machine Learning · Computer Science 2021-10-26 Junwen Bai , Weiran Wang , Carla Gomes

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Sparse autoencoders (SAEs) provide a powerful mechanism for decomposing the dense representations produced by Large Language Models (LLMs) into interpretable latent features. We posit that SAEs constitute a natural foundation for Learned…

Machine Learning · Computer Science 2026-03-17 Thibault Formal , Maxime Louis , Hervé Dejean , Stéphane Clinchant

In many modern data sets, High dimension low sample size (HDLSS) data is prevalent in many fields of studies. There has been an increased focus recently on using machine learning and statistical methods to mine valuable information out of…

Optimization and Control · Mathematics 2023-05-23 Srivathsan Amruth , Xin Yee Lam

This work considers noise removal from images, focusing on the well known K-SVD denoising algorithm. This sparsity-based method was proposed in 2006, and for a short while it was considered as state-of-the-art. However, over the years it…

Machine Learning · Computer Science 2020-11-19 Meyer Scetbon , Michael Elad , Peyman Milanfar

In solving hard computational problems, semidefinite program (SDP) relaxations often play an important role because they come with a guarantee of optimality. Here, we focus on a popular semidefinite relaxation of K-means clustering which…

Machine Learning · Computer Science 2018-09-07 Mariano Tepper , Anirvan M. Sengupta , Dmitri Chklovskii

Sparse Representation (SR) of signals or data has a well founded theory with rigorous mathematical error bounds and proofs. SR of a signal is given by superposition of very few columns of a matrix called Dictionary, implicitly reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 G. Madhuri , Atul Negi

We present a semi-unified sparse dictionary learning framework that bridges the gap between classical sparse models and modern deep architectures. Specifically, the method integrates strict Top-$K$ LISTA and its convex FISTA-based variant…

Machine Learning · Computer Science 2025-11-14 Fengsheng Lin , Shengyi Yan , Trac Duy Tran

Deep learning is a kind of feature learning method with strong nonliear feature transformation and becomes more and more important in many fields of artificial intelligence. Deep autoencoder is one representative method of the deep learning…

Machine Learning · Computer Science 2020-02-18 Yongming Li , Yan Lei , Pin Wang , Yuchuan Liu

Tools to generate high quality synthetic speech signal that is perceptually indistinguishable from speech recorded from human speakers are easily available. Several approaches have been proposed for detecting synthetic speech. Many of these…

Semi-supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data. With recent advancements in deep learning, researchers have designed efficient deep anomaly detection methods.…

Machine Learning · Computer Science 2024-01-23 Hadi Hojjati , Narges Armanfard

Learning interpretable disentangled representations is a crucial yet challenging task. In this paper, we propose a weakly semi-supervised method, termed as Dual Swap Disentangling (DSD), for disentangling using both labeled and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Zunlei Feng , Xinchao Wang , Chenglong Ke , Anxiang Zeng , Dacheng Tao , Mingli Song

Deep neural networks perform well on classification tasks where data streams are i.i.d. and labeled data is abundant. Challenges emerge with non-stationary training data streams such as continual learning. One powerful approach that has…