English
Related papers

Related papers: Functional Autoregression Without Truncation: A Co…

200 papers

Problems in machine learning (ML) can involve noisy input data, and ML classification methods have reached limiting accuracies when based on standard ML data sets consisting of feature vectors and their classes. Greater accuracy will…

Machine Learning · Statistics 2013-12-31 Yue Fan , Louise Raphael , Mark Kon

Functional linear regression is an important topic in functional data analysis. It is commonly assumed that samples of the functional predictor are independent realizations of an underlying stochastic process, and are observed over a grid…

Methodology · Statistics 2020-09-15 Cheng Chen , Shaojun Guo , Xinghao Qiao

The Inverse Problem for the estimation of a point-wise approximation error occurring at the discretization and solving of the system of partial differential equations is addressed. The set of the differences between the numerical solutions…

Numerical Analysis · Mathematics 2021-01-05 Aleksey Alekseev , Alexander Bondarev

Balanced truncation is one of the most common model order reduction schemes. In this paper, we study finite-frequency model order reduction (FF-MOR) problems of linear continuous-time systems within the framework of balanced truncation…

Systems and Control · Computer Science 2017-03-21 Xin Du , Peter Benner

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

Conformal prediction provides prediction sets with coverage guarantees. The informativeness of conformal prediction depends on its efficiency, typically quantified by the expected size of the prediction set. Prior work on the efficiency of…

Machine Learning · Computer Science 2026-03-06 Yunzhen Yao , Lie He , Michael Gastpar

This paper studies the control-oriented identification problem of set-valued moving average systems with uniform persistent excitations and observation noises. A stochastic approximation-based (SA-based) algorithm without projections or…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Jieming Ke , Ying Wang , Yanlong Zhao , Ji-Feng Zhang

With the rapid growth of data, how to extract effective information from data is one of the most fundamental problems. In this paper, based on Tikhonov regularization, we propose an effective method for reconstructing the function and its…

Numerical Analysis · Mathematics 2021-05-04 Jiantang Zhang , Jin Cheng , Min Zhong

Stochastic non-smooth convex optimization constitutes a class of problems in machine learning and operations research. This paper considers minimization of a non-smooth function based on stochastic subgradients. When the function has a…

Optimization and Control · Mathematics 2016-07-12 Sucha Supittayapornpong , Michael J. Neely

We study multi-parameter Tikhonov regularization, i.e., with multiple penalties. Such models are useful when the sought-for solution exhibits several distinct features simultaneously. Two choice rules, i.e., discrepancy principle and…

Numerical Analysis · Mathematics 2011-03-29 Kazufumi Ito , Bangti Jin , Tomoya Takeuchi

We propose an Adagrad-like algorithm for multi-objective unconstrained optimization that relies on the computation of a common descent direction only. Unlike classical local algorithms for multi-objective optimization, our approach does not…

Optimization and Control · Mathematics 2026-02-06 Marianna De Santis , Gabriele Eichfelder , Margherita Porcelli

This paper investigates the convergence properties of spectral algorithms -- a class of regularization methods originating from inverse problems -- under covariate shift. In this setting, the marginal distributions of inputs differ between…

Machine Learning · Statistics 2025-09-08 Ren-Rui Liu , Zheng-Chu Guo

A fully stochastic second-order adaptive-regularization method for unconstrained nonconvex optimization is presented which never computes the objective-function value, but yet achieves the optimal $\mathcal{O}(\epsilon^{-3/2})$ complexity…

Optimization and Control · Mathematics 2025-01-22 Serge Gratton , Sadok Jerad , Philippe L. Toint

The conditional survival function of a time-to-event outcome subject to censoring and truncation is a common target of estimation in survival analysis. This parameter may be of scientific interest and also often appears as a nuisance in…

Methodology · Statistics 2024-08-20 Charles J. Wolock , Peter B. Gilbert , Noah Simon , Marco Carone

To deal with the ill-posed nature of the inverse heat conduction problem (IHCP), the regularization parameter alpha can be incorporated into a minimization problem, which is known as Tikhonov regularization method, a popular technique to…

Numerical Analysis · Mathematics 2021-10-05 C. Ahn , C. Park , DI. Park , JG. Kim

In this note we consider spectral cut-off estimators to solve a statistical linear inverse problem under arbitrary white noise. The truncation level is determined with a recently introduced adaptive method based on the classical discrepancy…

Numerical Analysis · Mathematics 2022-02-28 Tim Jahn

This paper develops inferential methods for a very general class of ill-posed models in econometrics encompassing the nonparametric instrumental variable regression, various functional regressions, and the density deconvolution. We focus on…

Statistics Theory · Mathematics 2020-12-22 Andrii Babii

A default assumption in reinforcement learning (RL) and optimal control is that observations arrive at discrete time points on a fixed clock cycle. Yet, many applications involve continuous-time systems where the time discretization, in…

Machine Learning · Computer Science 2024-01-17 Zichen Zhang , Johannes Kirschner , Junxi Zhang , Francesco Zanini , Alex Ayoub , Masood Dehghan , Dale Schuurmans

In a real Hilbert space $\mathcal{H}$. Given any function $f$ convex differentiable whose solution set $\argmin_{\mathcal{H}}\,f$ is nonempty, by considering the Proximal Algorithm $x_{k+1}=\text{prox}_{\b_k f}(d x_k)$, where $0<d<1$ and…

Optimization and Control · Mathematics 2023-09-26 A. C. Bagy , Z. Chbani , H. Riahi

We propose a regularized factor-augmented vector autoregressive (FAVAR) model that allows for sparsity in the factor loadings. In this framework, factors may only load on a subset of variables which simplifies the factor identification and…

Econometrics · Economics 2019-12-13 Maurizio Daniele , Julie Schnaitmann