English
Related papers

Related papers: S-SPADE Done Right: Detailed Study of the Sparse A…

200 papers

Practical systems often suffer from hardware impairments that already appear during signal generation. Despite the limiting effect of such input-noise impairments on signal processing systems, they are routinely ignored in the literature.…

Signal Processing · Electrical Eng. & Systems 2021-10-04 Ramina Ghods , Charles Jeon , Arian Maleki , Christoph Studer

Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable selection. However, it is quite challenging to solve the…

Machine Learning · Statistics 2018-09-12 Lei Guan , Linbo Qiao , Dongsheng Li , Tao Sun , Keshi Ge , Xicheng Lu

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of…

Computer Vision and Pattern Recognition · Computer Science 2009-09-29 Julien Mairal , Francis Bach , Jean Ponce , Guillermo Sapiro , Andrew Zisserman

Sparse coding is a class of unsupervised methods for learning a sparse representation of the input data in the form of a linear combination of a dictionary and a sparse code. This learning framework has led to state-of-the-art results in…

Machine Learning · Computer Science 2021-09-01 Ye Xue , Vincent Lau , Songfu Cai

A function $f: \mathbb{R}^d \rightarrow \mathbb{R}$ is a Sparse Additive Model (SPAM), if it is of the form $f(\mathbf{x}) = \sum_{l \in \mathcal{S}}\phi_{l}(x_l)$ where $\mathcal{S} \subset [d]$, $|\mathcal{S}| \ll d$. Assuming $\phi$'s,…

Machine Learning · Computer Science 2017-05-09 Hemant Tyagi , Anastasios Kyrillidis , Bernd Gärtner , Andreas Krause

We propose a two-stage method called \textit{Spline Assisted Partial Differential Equation based Model Identification (SAPDEMI)} to identify partial differential equation (PDE)-based models from noisy data. In the first stage, we employ the…

Methodology · Statistics 2025-09-17 Yujie Zhao , Xiaoming Huo , Yajun Mei

Stochastic gradient descent type methods are ubiquitous in machine learning, but they are only applicable to the optimization of differentiable functions. Proximal algorithms are more general and applicable to nonsmooth functions. We…

Optimization and Control · Mathematics 2025-05-20 Laurent Condat , Elnur Gasanov , Peter Richtárik

Large-scale distributed training of deep acoustic models plays an important role in today's high-performance automatic speech recognition (ASR). In this paper we investigate a variety of asynchronous decentralized distributed training…

Computation and Language · Computer Science 2021-10-22 Xiaodong Cui , Wei Zhang , Abdullah Kayi , Mingrui Liu , Ulrich Finkler , Brian Kingsbury , George Saon , David Kung

In this article, we analyze the SPICE method developed in [1], and establish its connections with other standard sparse estimation methods such as the Lasso and the LAD-Lasso. This result positions SPICE as a computationally efficient…

Machine Learning · Statistics 2015-06-11 Cristian R. Rojas , Dimitrios Katselis , Håkan Hjalmarsson

Many types of anomaly detection methods have been proposed recently, and applied to a wide variety of fields including medical screening and production quality checking. Some methods have utilized images, and, in some cases, a part of the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-08 Minori Narita , Daiki Kimura , Ryuki Tachibana

Privacy preserving machine learning algorithms are crucial for learning models over user data to protect sensitive information. Motivated by this, differentially private stochastic gradient descent (SGD) algorithms for training machine…

Machine Learning · Computer Science 2019-10-25 Venkatadheeraj Pichapati , Ananda Theertha Suresh , Felix X. Yu , Sashank J. Reddi , Sanjiv Kumar

In semiconductor manufacturing, testing costs remain significantly high, especially during wafer and FPGA testing. To reduce the number of required tests while maintaining predictive accuracy, this study investigates three baseline sampling…

Machine Learning · Computer Science 2025-06-05 Wang WeiQuan , Riaz-ul-Haque Mian

We present a strategy for the recovery of a sparse solution of a common problem in acoustic engineering, which is the reconstruction of sound source levels and locations applying microphone array measurements. The considered task bears…

Optimization and Control · Mathematics 2016-07-04 Laurent Hoeltgen , Michael Breuß , Gert Herold , Ennes Sarradj

Although large-scale self-supervised learning (SSL) models like WavLM have achieved state-of-the-art performance in speech processing, their significant size impedes deployment on resource-constrained devices. While structured pruning is a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Junyi Peng , Lin Zhang , Jiangyu Han , Oldřich Plchot , Johan Rohdin , Themos Stafylakis , Shuai Wang , Jan Černocký

Sparse code multiple access (SCMA) has been one of non-orthogonal multiple access (NOMA) schemes aiming to support high spectral efficiency and ubiquitous access requirements for 5G wireless communication networks. Conventional SCMA…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Jinzhi Lin , Shengzhong Feng , Zhile Yang , Yun Zhang , Yong Zhang

We propose a novel sparse representation for heavily underdetermined multichannel sound mixtures, i.e., with much more sources than microphones. The proposed approach operates in the complex Fourier domain, thus preserving spatial…

Sound · Computer Science 2014-10-10 Antoine Deleforge , Walter Kellermann

Transformer models have achieved superior performance in various natural language processing tasks. However, the quadratic computational cost of the attention mechanism limits its practicality for long sequences. There are existing…

Computation and Language · Computer Science 2022-12-19 Simiao Zuo , Xiaodong Liu , Jian Jiao , Denis Charles , Eren Manavoglu , Tuo Zhao , Jianfeng Gao

Automatic modulation classification (AMC) is an important task for modern communication systems; however, it is a challenging problem when signal features and precise models for generating each modulation may be unknown. We present a new…

Machine Learning · Statistics 2016-05-18 Benjamin Migliori , Riley Zeller-Townson , Daniel Grady , Daniel Gebhardt

Sparse coding is an unsupervised learning algorithm that learns a succinct high-level representation of the inputs given only unlabeled data; it represents each input as a sparse linear combination of a set of basis functions. Originally…

Machine Learning · Computer Science 2012-06-26 Roger Grosse , Rajat Raina , Helen Kwong , Andrew Y. Ng

A streaming algorithm to compute the spectral proper orthogonal decomposition (SPOD) of stationary random processes is presented. As new data becomes available, an incremental update of the truncated eigenbasis of the estimated…

Fluid Dynamics · Physics 2019-01-14 Oliver T. Schmidt , Aaron Towne