English
Related papers

Related papers: L1 Splines for Robust, Simple, and Fast Smoothing …

200 papers

As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the…

Machine Learning · Computer Science 2019-07-02 Feiping Nie , Hua Wang , Zheng Wang , Heng Huang

We consider functional data where an underlying smooth curve is composed not just with errors, but also with irregular spikes. We propose an approach that, combining regularized spline smoothing and an Expectation-Maximization algorithm,…

Methodology · Statistics 2023-07-18 Huy Dang , Marzia Cremona , Francesca Chiaromonte

In the era of big data, an ever-growing volume of information is recorded, either continuously over time or sporadically, at distinct time intervals. Functional Data Analysis (FDA) stands at the cutting edge of this data revolution,…

Methodology · Statistics 2024-10-21 Anna De Magistris , Valentina De Simone , Elvira Romano , Gerardo Toraldo

Randomized smoothing is a general technique for computing sample-dependent robustness guarantees against adversarial attacks for deep classifiers. Prior works on randomized smoothing against L_1 adversarial attacks use additive smoothing…

Machine Learning · Computer Science 2021-06-14 Alexander Levine , Soheil Feizi

We consider the weighted least squares spline approximation of a noisy dataset. By interpreting the weights as a probability distribution, we maximize the associated entropy subject to the constraint that the mean squared error is…

Numerical Analysis · Mathematics 2024-01-19 Luigi Brugnano , Domenico Giordano , Felice Iavernaro , Giorgia Rubino

In this paper, we study spline trajectory generation via the solution of two optimisation problems: (i) a quadratic program (QP) with linear equality constraints and (ii) a nonlinear and nonconvex optimisation program. We propose an…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Declan Burke , Airlie Chapman , Iman Shames

Smoothing splines have been used pervasively in nonparametric regressions. However, the computational burden of smoothing splines is significant when the sample size $n$ is large. When the number of predictors $d\geq2$, the computational…

Methodology · Statistics 2022-10-13 Cheng Meng , Jun Yu , Yongkai Chen , Wenxuan Zhong , Ping Ma

In this paper, we consider two formulations for Linear Matrix Inequalities (LMIs) under Slater type constraint qualification assumption, namely, SDP smooth and non-smooth formulations. We also propose two first-order linearly convergent…

Optimization and Control · Mathematics 2013-09-10 Cong D. Dang , Guanghui Lan

B-spline models are a powerful way to represent scientific data sets with a functional approximation. However, these models can suffer from spurious oscillations when the data to be approximated are not uniformly distributed. Model…

Numerical Analysis · Mathematics 2022-03-29 David Lenz , Raine Yeh , Vijay Mahadevan , Iulian Grindeanu , Tom Peterka

The paper considers functional linear regression, where scalar responses $Y_1,...,Y_n$ are modeled in dependence of random functions $X_1,...,X_n$. We propose a smoothing splines estimator for the functional slope parameter based on a…

Statistics Theory · Mathematics 2009-02-26 Christophe Crambes , Alois Kneip , Pascal Sarda

The most promising approaches for efficient detection in multiple-input multiple-output (MIMO) wireless systems are based on sphere-decoding (SD). The conventional (and optimum) norm that is used to conduct the tree traversal step in SD is…

Information Theory · Computer Science 2008-11-18 Dominik Seethaler , Helmut Bölcskei

The smoothing spline is one of the most popular curve-fitting methods, partly because of empirical evidence supporting its effectiveness and partly because of its elegant mathematical formulation. However, there are two obstacles that…

Statistics Theory · Mathematics 2012-09-11 Yu Ryan Yue , Daniel Simpson , Finn Lindgren , Håvard Rue

We consider estimation and inference in a single index regression model with an unknown but smooth link function. In contrast to the standard approach of using kernels or regression splines, we use smoothing splines to estimate the smooth…

Methodology · Statistics 2019-05-28 Arun Kumar Kuchibhotla , Rohit Kumar Patra

In fitting data with a spline, finding the optimal placement of knots can significantly improve the quality of the fit. However, the challenging high-dimensional and non-convex optimization problem associated with completely free knot…

Computation · Statistics 2020-07-28 Soumya D. Mohanty , Ethan Fahnestock

The theory of compressive sensing (CS) suggests that under certain conditions, a sparse signal can be recovered from a small number of linear incoherent measurements. An effective class of reconstruction algorithms involve solving a convex…

Information Theory · Computer Science 2015-05-13 Muhammad Salman Asif , Justin Romberg

Recent studies highlight that deep learning models often learn spurious features mistakenly linked to labels, compromising their reliability in real-world scenarios where such correlations do not hold. Despite the increasing research…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiwei Xuan , Ziquan Deng , Hsuan-Tien Lin , Kwan-Liu Ma

Bang-bang control is ubiquitous for Optimal Control Problems (OCPs) where the constrained control variable appears linearly in the dynamics and cost function. Based on the Pontryagin's Minimum Principle, the indirect method is widely used…

Optimization and Control · Mathematics 2023-12-04 Kun Wang , Zheng Chen , Zhenyu Wei , Fangmin Lu , Jun Li

In this paper we propose an augmented smoothing function for nonlinear L1 -norm minimization problem and consider a global stability of a gradient-based neural network model to minimize the smoothing function. The numerical simulations show…

Optimization and Control · Mathematics 2012-07-10 Yunchol Jong

We present a comprehensive framework for evaluating line chart smoothing methods under a variety of visual analytics tasks. Line charts are commonly used to visualize a series of data samples. When the number of samples is large, or the…

Human-Computer Interaction · Computer Science 2020-09-22 Paul Rosen , Ghulam Jilani Quadri

We present SplineNets, a practical and novel approach for using conditioning in convolutional neural networks (CNNs). SplineNets are continuous generalizations of neural decision graphs, and they can dramatically reduce runtime complexity…

Machine Learning · Computer Science 2018-11-01 Cem Keskin , Shahram Izadi