English
Related papers

Related papers: Joint Linear Trend Recovery Using L1 Regularizatio…

200 papers

The mutual intensity and its equivalent phase-space representations quantify an optical field's state of coherence and are important tools in the study of light propagation and dynamics, but they can only be estimated indirectly from…

Optics · Physics 2017-11-16 Chenglong Bao , George Barbastathis , Hui Ji , Zuowei Shen , Zhengyun Zhang

Nowadays, l1 penalized likelihood has absorbed a high amount of consideration due to its simplicity and well developed theoretical properties. This method is known as a reliable method in order to apply in a broad range of applications…

Methodology · Statistics 2015-06-12 Hamed Haselimashhadi

We consider two theorems from the theory of compressive sensing. Mainly a theorem concerning uniform recovery of random sampling matrices, where the number of samples needed in order to recover an $s$-sparse signal from linear measurements…

Information Theory · Computer Science 2013-06-05 Joel Andersson , Jan-Olov Strömberg

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

Numerical Analysis · Mathematics 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

We study additive models built with trend filtering, i.e., additive models whose components are each regularized by the (discrete) total variation of their $k$th (discrete) derivative, for a chosen integer $k \geq 0$. This results in $k$th…

Machine Learning · Statistics 2018-11-26 Veeranjaneyulu Sadhanala , Ryan J. Tibshirani

A unit root test is proposed for time series with a general nonlinear deterministic trend component. It is shown that asymptotically the pooled OLS estimator of overlapping blocks filters out any trend component that satisfies some…

Econometrics · Economics 2020-09-15 Sven Otto

We use transductive regression techniques to learn mappings between source and target features of given parallel corpora and use these mappings to generate machine translation outputs. We show the effectiveness of $L_1$ regularized…

Computation and Language · Computer Science 2024-07-01 Ergun Biçici

We consider the problem of recovering a signal from nonlinear transformations, under convex constraints modeling a priori information. Standard feasibility and optimization methods are ill-suited to tackle this problem due to the…

Optimization and Control · Mathematics 2020-06-16 Patrick L. Combettes , Zev. C. Woodstock

We consider the recovery of signals from their observations, which are samples of a transform of the signals rather than the signals themselves, by using machine learning (ML). We will develop a theoretical framework to characterize the…

Machine Learning · Computer Science 2019-10-08 Hong Jiang , Jong-Hoon Ahn , Xiaoyang Wang

We consider the generic regularized optimization problem $\hat{\mathsf{\beta}}(\lambda)=\arg \min_{\beta}L({\sf{y}},X{\sf{\beta}})+\lambda J({\sf{\beta}})$. Efron, Hastie, Johnstone and Tibshirani [Ann. Statist. 32 (2004) 407--499] have…

Statistics Theory · Mathematics 2007-08-22 Saharon Rosset , Ji Zhu

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

Our aim of this article is to reconstruct a signal from undersampled data in the situation that the signal is sparse in terms of a tight frame. We present a condition, which is independent of the coherence of the tight frame, to guarantee…

Numerical Analysis · Mathematics 2011-05-24 Song Li , Junhong Lin

In this paper, we study the L1/L2 minimization on the gradient for imaging applications. Several recent works have demonstrated that L1/L2 is better than the L1 norm when approximating the L0 norm to promote sparsity. Consequently, we…

Numerical Analysis · Mathematics 2022-05-25 Chao Wang , Min Tao , Chen-Nee Chuah , James Nagy , Yifei Lou

We propose TrendSegment, a methodology for detecting multiple change-points corresponding to linear trend changes in one dimensional data. A core ingredient of TrendSegment is a new Tail-Greedy Unbalanced Wavelet transform: a conditionally…

Methodology · Statistics 2023-01-09 Hyeyoung Maeng , Piotr Fryzlewicz

In this paper, we study the phase retrieval problem in the situation where the vector to be recovered has an a priori structure that can encoded into a regularization term. This regularizer is intended to promote solutions conforming to…

Optimization and Control · Mathematics 2024-07-24 Jean-Jacques Godeme , Jalal Fadili

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

Methodology · Statistics 2012-02-07 Nicolai Meinshausen

We develop a mixture procedure to monitor parallel streams of data for a change-point that affects only a subset of them, without assuming a spatial structure relating the data streams to one another. Observations are assumed initially to…

Statistics Theory · Mathematics 2013-05-10 Yao Xie , David Siegmund

We introduce a family of adaptive estimators on graphs, based on penalizing the $\ell_1$ norm of discrete graph differences. This generalizes the idea of trend filtering [Kim et al. (2009), Tibshirani (2014)], used for univariate…

Machine Learning · Statistics 2016-06-07 Yu-Xiang Wang , James Sharpnack , Alex Smola , Ryan J. Tibshirani

This paper studies the problem of recovering a non-negative sparse signal $\x \in \Re^n$ from highly corrupted linear measurements $\y = A\x + \e \in \Re^m$, where $\e$ is an unknown error vector whose nonzero entries may be unbounded.…

Information Theory · Computer Science 2008-09-02 John Wright , Yi Ma

The characteristic feature of inverse problems is their instability with respect to data perturbations. In order to stabilize the inversion process, regularization methods have to be developed and applied. In this work we introduce and…

Numerical Analysis · Mathematics 2022-08-22 Andrea Ebner , Jürgen Frikel , Dirk Lorenz , Johannes Schwab , Markus Haltmeier