中文
相关论文

相关论文: Beyond L2-Loss Functions for Learning Sparse Model…

200 篇论文

We investigate robust nonparametric regression in the presence of heavy-tailed noise, where the hypothesis class may contain unbounded functions and robustness is ensured via a robust loss function $\ell_\sigma$. Using Huber regression as a…

机器学习 · 计算机科学 2025-10-14 Yunlong Feng , Qiang Wu

Learned Sparse Retrieval (LSR) such as SPLADE has growing interest for effective semantic 1st stage matching while enjoying the efficiency of inverted indices. A recent work on learning SPLADE models with expanded vocabularies (ESPLADE) was…

信息检索 · 计算机科学 2026-04-21 Hiun Kim , Tae Kwan Lee , Taeryun Won

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

数值分析 · 数学 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

Training large, deep neural networks to convergence can be prohibitively expensive. As a result, often only a small selection of popular, dense models are reused across different contexts and tasks. Increasingly, sparsely activated models,…

The efficient sparse coding and reconstruction of signal vectors via linear observations has received a tremendous amount of attention over the last decade. In this context, the automated learning of a suitable basis or overcomplete…

信息论 · 计算机科学 2015-06-19 Andreas M. Tillmann

Performing signal processing tasks on compressive measurements of data has received great attention in recent years. In this paper, we extend previous work on compressive dictionary learning by showing that more general random projections…

机器学习 · 统计学 2015-04-07 Farhad Pourkamali-Anaraki , Stephen Becker , Shannon M. Hughes

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

机器学习 · 统计学 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a…

应用统计 · 统计学 2015-03-29 Yong Huang , James L. Beck

We study a family of sparse estimators defined as minimizers of some empirical Lipschitz loss function -- which include the hinge loss, the logistic loss and the quantile regression loss -- with a convex, sparse or group-sparse…

机器学习 · 统计学 2021-09-23 Antoine Dedieu

In sparse recovery we are given a matrix $A$ (the dictionary) and a vector of the form $A X$ where $X$ is sparse, and the goal is to recover $X$. This is a central notion in signal processing, statistics and machine learning. But in…

数据结构与算法 · 计算机科学 2014-05-27 Sanjeev Arora , Rong Ge , Ankur Moitra

We study the problem of learning a sparse linear regression vector under additional conditions on the structure of its sparsity pattern. This problem is relevant in machine learning, statistics and signal processing. It is well known that a…

机器学习 · 统计学 2015-03-17 Charles A. Micchelli , Jean M. Morales , Massimiliano Pontil

A robust algorithm is proposed to reconstruct the spatial support and the Lam\'e parameters of multiple inclusions in a homogeneous background elastic material using a few measurements of the displacement field over a finite collection of…

数值分析 · 数学 2017-02-27 Jaejun Yoo , Younghoon Jung , Mikyoung Lim , Jong Chul Ye , Abdul Wahab

While deep neural networks (DNNs) have proven to be efficient for numerous tasks, they come at a high memory and computation cost, thus making them impractical on resource-limited devices. However, these networks are known to contain a…

神经与进化计算 · 计算机科学 2020-07-21 Anthony Berthelier , Yongzhe Yan , Thierry Chateau , Christophe Blanc , Stefan Duffner , Christophe Garcia

We consider the problem of learning overcomplete dictionaries in the context of sparse coding, where each sample selects a sparse subset of dictionary elements. Our main result is a strategy to approximately recover the unknown dictionary…

机器学习 · 统计学 2014-07-08 Alekh Agarwal , Animashree Anandkumar , Praneeth Netrapalli

One of the crucial tasks in many inference problems is the extraction of sparse information out of a given number of high-dimensional measurements. In machine learning, this is frequently achieved using, as a penality term, the $L_p$ norm…

无序系统与神经网络 · 物理学 2012-02-09 Alejandro Lage-Castellanos , Andrea Pagnani , Martin Weigt

Sparse representations using learned dictionaries are being increasingly used with success in several data processing and machine learning applications. The availability of abundant training data necessitates the development of efficient,…

计算机视觉与模式识别 · 计算机科学 2013-09-26 Jayaraman J. Thiagarajan , Karthikeyan Natesan Ramamurthy , Andreas Spanias

Leveraging on the underlying low-dimensional structure of data, low-rank and sparse modeling approaches have achieved great success in a wide range of applications. However, in many applications the data can display structures beyond simply…

机器学习 · 计算机科学 2019-12-04 Zhao Kang , Xiao Lu , Yiwei Lu , Chong Peng , Zenglin Xu

Sparse coding algorithms are about finding a linear basis in which signals can be represented by a small number of active (non-zero) coefficients. Such coding has many applications in science and engineering and is believed to play an…

神经与进化计算 · 计算机科学 2016-08-14 András Lőrincz , Zsolt Palotai , Gábor Szirtes

Signal models based on sparsity, low-rank and other properties have been exploited for image reconstruction from limited and corrupted data in medical imaging and other computational imaging applications. In particular, sparsifying…

图像与视频处理 · 电气工程与系统科学 2020-01-08 Xuehang Zheng , Saiprasad Ravishankar , Yong Long , Marc Louis Klasky , Brendt Wohlberg

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

统计方法学 · 统计学 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao