English
Related papers

Related papers: Smoothing splines for discontinuous signals

200 papers

A high-frequency recovered fully discrete low-regularity integrator is constructed to approximate rough and possibly discontinuous solutions of the semilinear wave equation. The proposed method, with high-frequency recovery techniques, can…

Numerical Analysis · Mathematics 2024-10-18 Jiachuan Cao , Buyang Li , Yanping Lin , Fangyan Yao

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok

This paper proposes a novel algorithm for signal classification problems. We consider a non-stationary random signal, where samples can be classified into several different classes, and samples in each class are identically independently…

Information Theory · Computer Science 2009-03-02 Xudong Ma

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that…

Systems and Control · Computer Science 2015-06-30 Henri Nurminen , Tohid Ardeshiri , Robert Piché , Fredrik Gustafsson

Recent studies highlight that deep learning models often learn spurious features mistakenly linked to labels, compromising their reliability in real-world scenarios where such correlations do not hold. Despite the increasing research…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiwei Xuan , Ziquan Deng , Hsuan-Tien Lin , Kwan-Liu Ma

Recent advancements in single-cell RNA-sequencing (scRNA-seq) have enhanced our understanding of cell heterogeneity at a high resolution. With the ability to sequence over 10,000 cells per hour, researchers can collect large scRNA-seq…

Methodology · Statistics 2024-01-30 Yifu Tang , Yi Zhang , Yue Wang , Jingyi Zhang , Xiaoxiao Sun

Sampling of signals belonging to a low-dimensional subspace has well-documented merits for dimensionality reduction, limited memory storage, and online processing of streaming network data. When the subspace is known, these signals can be…

Information Theory · Computer Science 2019-11-26 Fernando Gama , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

High-dimensional simulation optimization is notoriously challenging. We propose a new sampling algorithm that converges to a global optimal solution and suffers minimally from the curse of dimensionality. The algorithm consists of two…

Machine Learning · Statistics 2021-07-21 Liang Ding , Rui Tuo , Xiaowei Zhang

This paper investigates optimal control problems formulated over a class of piecewise-smooth vector fields. Instead of optimizing over the discontinuous system directly, we instead formulate optimal control problems over a family of…

Dynamical Systems · Mathematics 2019-04-02 Tyler Westenbroek , Xiaobin Xiong , Aaron D Ames , S Shankar Sastry

Uni- and bivariate data smoothing with spline functions is a well established method in nonparametric regression analysis. The extension to multivariate data is straightforward, but suffers from exponentially increasing memory and…

Numerical Analysis · Mathematics 2024-12-20 Martin Siebenborn , Julian Wagner

In this paper, we focus on the variable selection techniques for a class of semiparametric spatial regression models which allow one to study the effects of explanatory variables in the presence of the spatial information. The spatial…

Methodology · Statistics 2021-06-03 Guannan Wang , Jue Wang

Smoothing splines can be thought of as the posterior mean of a Gaussian process regression in a certain limit. By constructing a reproducing kernel Hilbert space with an appropriate inner product, the Bayesian form of the V-spline is…

Statistics Theory · Mathematics 2018-07-25 Zhanglong Cao , David Bryant , Matthew Parry

The sliding window model generalizes the standard streaming model and often performs better in applications where recent data is more important or more accurate than data that arrived prior to a certain time. We study the problem of…

Data Structures and Algorithms · Computer Science 2021-09-06 Vladimir Braverman , Viska Wei , Samson Zhou

In the rapidly evolving internet-of-things (IoT) ecosystem, effective data analysis techniques are crucial for handling distributed data generated by sensors. Addressing the limitations of existing methods, such as the sub-gradient…

Machine Learning · Computer Science 2024-08-12 Reza Mirzaeifard , Diyako Ghaderyan , Stefan Werner

In this paper, we present a new ellipsoid-type algorithm for solving nonsmooth problems with convex structure. Examples of such problems include nonsmooth convex minimization problems, convex-concave saddle-point problems and variational…

Optimization and Control · Mathematics 2021-06-28 Anton Rodomanov , Yurii Nesterov

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

Optimization and Control · Mathematics 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

In many classification problems it is desirable to output well-calibrated probabilities on the different classes. We propose a robust, non-parametric method of calibrating probabilities called SplineCalib that utilizes smoothing splines to…

Machine Learning · Statistics 2018-09-21 Brian Lucena

In areas such as kernel smoothing and non-parametric regression there is emphasis on smooth interpolation and smooth statistical models. Splines are known to have optimal smoothness properties in one and higher dimensions. It is shown, with…

Computation · Statistics 2008-09-29 Ron A. Bates , Hugo Maruri-Aguilar , Henry P. Wynn