English
Related papers

Related papers: An Automated Approach Towards Sparse Single-Equati…

200 papers

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarchical selection.…

Methodology · Statistics 2024-03-11 Ryan Thompson , Farshid Vahid

Methods to generate realistic non-stationary demand scenarios are a key component for analyzing and optimizing decision policies in supply chains. Typical forecasting techniques recommended in standard inventory control textbooks consist of…

Applications · Statistics 2024-04-12 Lotte van Hezewijk , Nico Dellaert , Willem van Jaarsveld

The stochastic gradient descent (SGD) algorithm has been widely used in statistical estimation for large-scale data due to its computational and memory efficiency. While most existing works focus on the convergence of the objective function…

Machine Learning · Statistics 2023-11-02 Xi Chen , Jason D. Lee , Xin T. Tong , Yichen Zhang

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

We consider a sparse grid collocation method in conjunction with a time discretization of the differential equations for computing expectations of functionals of solutions to differential equations perturbed by time-dependent white noise.…

Numerical Analysis · Mathematics 2015-05-18 Z. Zhang , M. V. Tretyakov , B. Rozovskii , G. E. Karniadakis

We consider the high-dimensional sparse linear regression problem of accurately estimating a sparse vector using a small number of linear measurements that are contaminated by noise. It is well known that the standard cadre of…

Statistics Theory · Mathematics 2014-02-25 Divyanshu Vats , Richard G. Baraniuk

Checking how well a fitted model explains the data is one of the most fundamental parts of a Bayesian data analysis. However, existing model checking methods suffer from trade-offs between being well-calibrated, automated, and…

Methodology · Statistics 2024-05-24 Jiawei Li , Jonathan H. Huggins

This paper presents approaches to compute sparse solutions of Generalized Singular Value Problem (GSVP). The GSVP is regularized by $\ell_1$-norm and $\ell_q$-penalty for $0<q<1$, resulting in the $\ell_1$-GSVP and $\ell_q$-GSVP…

Machine Learning · Computer Science 2024-10-08 Ugochukwu O. Ugwu , Michael Kirby

We propose Co-op, a novel method for accurately and robustly estimating the 6DoF pose of objects unseen during training from a single RGB image. Our method requires only the CAD model of the target object and can precisely estimate its pose…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sungphill Moon , Hyeontae Son , Dongcheol Hur , Sangwook Kim

We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on…

Many popular statistical models, such as factor and random effects models, give arise a certain type of covariance structures that is a summation of low rank and sparse matrices. This paper introduces a penalized approximation framework to…

Methodology · Statistics 2015-03-19 Xi Luo

In this article, we propose some new generalizations of M-estimation procedures for single-index regression models in presence of randomly right-censored responses. We derive consistency and asymptotic normality of our estimates. The…

Statistics Theory · Mathematics 2008-12-18 Olivier Lopez

The single-step explicit time integration methods have long been valuable for solving large-scale nonlinear structural dynamic problems, classified into single-solve and multi-sub-step approaches. However, no existing explicit single-solve…

Numerical Analysis · Mathematics 2025-11-25 Liu Yaokun , Li Jinze , Yu Kaiping

We propose a new method based on sparse optimal discriminant clustering (SODC), incorporating a penalty term into the scoring matrix based on convex clustering. With the addition of this penalty term, it is expected to improve the accuracy…

Methodology · Statistics 2025-10-15 Mayu Hiraishi , Kensuke Tanioka , Hiroshi Yadohisa

Exact recovery of a sparse solution for an underdetermined system of linear equations implies full search among all possible subsets of the dictionary, which is computationally intractable, while l1 minimization will do the job when a…

Information Theory · Computer Science 2014-12-22 Mohsen Joneidi , Mahdi Barzegar Khalilsarai , Alireza Zaeemzadeh , Nazanin Rahnavard

Sparse logistic regression is for classification and feature selection simultaneously. Although many studies have been done to solve $\ell_1$-regularized logistic regression, there is no equivalently abundant work on solving sparse logistic…

Machine Learning · Computer Science 2023-10-13 Mengyuan Zhang , Kai Liu

Gaussian processes (GPs) are an important tool in machine learning and statistics with applications ranging from social and natural science through engineering. They constitute a powerful kernelized non-parametric method with…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

As deep learning continues to be driven by ever-larger datasets, understanding which examples are most important for generalization has become a critical question. While progress in data selection continues, emerging applications require…

Machine Learning · Computer Science 2025-07-02 Mustafa Burak Gurbuz , Xingyu Zheng , Constantine Dovrolis

We consider the problem of estimating parameters of stochastic differential equations (SDEs) with discrete-time observations that are either completely or partially observed. The transition density between two observations is generally…

Methodology · Statistics 2015-09-09 Libo Sun , Chihoon Lee , Jennifer A. Hoeting

We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive…

Statistics Theory · Mathematics 2008-04-09 Pradeep Ravikumar , John Lafferty , Han Liu , Larry Wasserman