English
Related papers

Related papers: Sensitivity-driven adaptive sparse stochastic appr…

200 papers

The aim of this paper is to investigate superresolution in deconvolution driven by sparsity priors. The observed signal is a convolution of an original signal with a continuous kernel.With the prior knowledge that the original signal can be…

Optimization and Control · Mathematics 2025-03-20 Alexandra Koulouri , Pia Heins , Martin Burger

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

Predicting the behavior of complex systems is critical in many scientific and engineering domains, and hinges on the model's ability to capture their underlying dynamics. Existing methods encode the intrinsic dynamics of high-dimensional…

Computational Engineering, Finance, and Science · Computer Science 2025-11-18 Jingwen Cheng , Ruikun Li , Huandong Wang , Yong Li

The need for fast sparse optimization is emerging, e.g., to deal with large-dimensional data-driven problems and to track time-varying systems. In the framework of linear sparse optimization, the iterative shrinkage-thresholding algorithm…

Optimization and Control · Mathematics 2025-01-22 Vito Cerone , Sophie M. Fosson , Diego Regruto

High-dimensional interpolation problems appear in various applications of uncertainty quantification, stochastic optimization and machine learning. Such problems are computationally expensive and request the use of adaptive grid generation…

Numerical Analysis · Mathematics 2025-05-26 Hendrik Wilka , Jens Lang

Adaptive gradient methods, such as AdaGrad, are among the most successful optimization algorithms for neural network training. While these methods are known to achieve better dimensional dependence than stochastic gradient descent (SGD) for…

Optimization and Control · Mathematics 2025-06-09 Ruichen Jiang , Devyani Maladkar , Aryan Mokhtari

The simulation of complex nonlinear engineering systems such as compressible fluid flows may be targeted to make more efficient and accurate the approximation of a specific (scalar) quantity of interest of the system. Putting aside modeling…

Numerical Analysis · Mathematics 2018-11-14 Jan Van Langenhove , Didier Lucor , Frédéric Alauzet , Anca Belme

In this paper we consider estimation of sparse covariance matrices and propose a thresholding procedure which is adaptive to the variability of individual entries. The estimators are fully data driven and enjoy excellent performance both…

Methodology · Statistics 2011-02-14 Tony Cai , Weidong Liu

Artificial intelligence methods show great promise in increasing the quality and speed of work with large astronomical datasets, but the high complexity of these methods leads to the extraction of dataset-specific, non-robust features.…

Astrophysics of Galaxies · Physics 2023-03-23 A. Ćiprijanović , A. Lewis , K. Pedro , S. Madireddy , B. Nord , G. N. Perdue , S. M. Wild

Stochastic approximation (SA) is a powerful and scalable computational method for iteratively estimating the solution of optimization problems in the presence of randomness, particularly well-suited for large-scale and streaming data…

Statistics Theory · Mathematics 2023-10-03 Meimei Liu , Zuofeng Shang , Yun Yang

Global sensitivity analysis aims at determining which uncertain input parameters of a computational model primarily drives the variance of the output quantities of interest. Sobol' indices are now routinely applied in this context when the…

Computation · Statistics 2017-05-30 R. Schöbi , B. Sudret

Dense depth map capture is challenging in existing active sparse illumination based depth acquisition techniques, such as LiDAR. Various techniques have been proposed to estimate a dense depth map based on fusion of the sparse depth map…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Qiqin Dai , Fengqiang Li , Oliver Cossairt , Aggelos K Katsaggelos

This paper presents a novel adaptive-sparse polynomial dimensional decomposition (PDD) method for stochastic design optimization of complex systems. The method entails an adaptive-sparse PDD approximation of a high-dimensional stochastic…

Numerical Analysis · Mathematics 2016-01-13 Sharif Rahman , Xuchun Ren , Vaibhav Yadav

This paper proposes an adaptive hyper-reduction method to reduce the computational cost associated with the simulation of parametric particle-based kinetic plasma models, specifically focusing on the Vlasov-Poisson equation. Conventional…

Numerical Analysis · Mathematics 2026-02-05 Cecilia Pagliantini , Federico Vismara

Stochastic gradient methods (SGMs) are the predominant approaches to train deep learning models. The adaptive versions (e.g., Adam and AMSGrad) have been extensively used in practice, partly because they achieve faster convergence than the…

Optimization and Control · Mathematics 2022-04-14 Yangyang Xu , Yibo Xu , Yonggui Yan , Colin Sutcher-Shepard , Leopold Grinberg , Jie Chen

This paper concerns the adaptive control problem for a class of nonlinear stochastic systems in which the state update is given by a nonlinear function of linear dynamics plus additive stochastic noise. Such systems arise in a wide range of…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Lantian Zhang , Bo Wahlberg , Silun Zhang

Kernel interpolation, especially in the context of Gaussian process emulation, is a widely used technique in surrogate modelling, where the goal is to cheaply approximate an input-output map using a limited number of function evaluations.…

Numerical Analysis · Mathematics 2025-11-13 Elliot J. Addy , Jonas Latz , Aretha L. Teckentrup

The growing threats of uncertainties, anomalies, and cyberattacks on power grids are driving a critical need to advance situational awareness which allows system operators to form a complete and accurate picture of the present and future…

Signal Processing · Electrical Eng. & Systems 2024-12-20 Shimiao Li

Indoor localization is a supporting technology for a broadening range of pervasive wireless applications. One promis- ing approach is to locate users with radio frequency fingerprints. However, its wide adoption in real-world systems is…

Information Theory · Computer Science 2017-08-04 Xiao-Yang Liu , Shuchin Aeron , Vaneet Aggarwal , Xiaodong Wang , Min-You Wu

Successful detection of weak signals is a universal challenge for numerous technical and biological systems and crucially limits signal transduction and transmission. Stochastic resonance (SR) has been identified to have the potential to…

Information Theory · Computer Science 2015-04-21 Patrick Krauss , Claus Metzner , Konstantin Tziridis , Holger Schulze