English
Related papers

Related papers: Kinetic Energy Plus Penalty Functions for Sparse E…

200 papers

This paper addresses the problem of sparsity penalized least squares for applications in sparse signal processing, e.g. sparse deconvolution. This paper aims to induce sparsity more strongly than L1 norm regularization, while avoiding…

Machine Learning · Computer Science 2015-06-15 Ivan W. Selesnick , Ilker Bayram

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster

We report a direct scheme calculation of kinetic energy functional derivative using Machine Learning. Support Vector Regression and Kernel Ridge Regression techniques were independently employed to estimate the kinetic energy functional and…

Computational Physics · Physics 2021-03-16 H. Saidaoui , S. Kais , S. Rashkeev , FH. Alharbi

We propose a new algorithm for sparse estimation of eigenvectors in generalized eigenvalue problems (GEP). The GEP arises in a number of modern data-analytic situations and statistical methods, including principal component analysis (PCA),…

Methodology · Statistics 2020-06-29 Sungkyu Jung , Jeongyoun Ahn , Yongho Jeon

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

There is a number of explicit kinetic energy density functionals for non-interacting electron systems that are obtained in terms of the electron density and its derivatives. These semilocal functionals have been widely used in the…

Other Condensed Matter · Physics 2011-12-22 David Garcia-Aldea , J. E. Alvarellos

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

We introduce a novel class of variable selection penalties called TWIN, which provides sensible data-adaptive penalization. Under a linear sparsity regime and random Gaussian designs we show that penalties in the TWIN class have a high…

Methodology · Statistics 2018-06-07 Xiaowu Dai , Jared D. Huling

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

We study the performance of fourth-order gradient expansions of the kinetic energy density (KED) in semi-local kinetic energy functionals depending on the density-dependent variables. The formal fourth-order expansion is convergent for…

Computational Physics · Physics 2019-01-30 Pavlo Golub , Sergei Manzhos

Sparsity-inducing penalties are useful tools for variable selection and they are also effective for regression settings where the data are functions. We consider the problem of selecting not only variables but also decision boundaries in…

Methodology · Statistics 2020-06-01 Hidetoshi Matsui

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

In this paper, we propose an unifying view of several recently proposed structured sparsity-inducing norms. We consider the situation of a model simultaneously (a) penalized by a set- function de ned on the support of the unknown parameter…

Machine Learning · Statistics 2012-05-08 Guillaume Obozinski , Francis Bach

We propose a simple scheme to estimate potential energy surface (PES) with which the accuracy can be easily controlled and improved up to the level of the density functional theory (DFT) calculations. It is based on a model selection within…

Materials Science · Physics 2014-07-11 Atsuto Seko , Akira Takahashi , Isao Tanaka

Orbital-free density functional theory promises to deliver linear-scaling electronic structure calculations. This requires the knowledge of the non-interacting kinetic-energy density functional (KEDF), which should be accurate and must…

Materials Science · Physics 2024-12-12 Michael A. J. Mitchell , Teresa Del Aguila Ferrandis , Stefano Sanvito

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized…

Statistics Theory · Mathematics 2024-02-09 Shiyuan He , Jianhua Z. Huang , Kejun He

Within ``orbital-free'' density functional theory, it is essential to develop general kinetic energy density (KED), denoted as $t(\mathbf{r})$. This is usually done by empirical corrections and enhancements, gradient expansions, machine…

Quantum Physics · Physics 2022-10-26 Abdulaziz H. Al-Aswad , Fahhad H. Alharbi

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We consider the problem of variable selection in varying-coefficient functional linear models, where multiple predictors are functions and a response is a scalar and depends on an exogenous variable. The varying-coefficient functional…

Methodology · Statistics 2021-10-26 Hidetoshi Matsui

This paper considers stochastic optimization problems with weakly convex objective and constraint functions. We propose Prox-PEP, a proximal method equipped with quadratic subproblems. To handle nonlinear equality constraints, we employ an…

Optimization and Control · Mathematics 2026-05-11 Lixin Tang , Xingyu Wang , Liwei Zhang