English
Related papers

Related papers: Leave-one-out least squares Monte Carlo algorithm …

200 papers

This work provides simple algorithms for multi-class (and multi-label) prediction in settings where both the number of examples n and the data dimension d are relatively large. These robust and parameter free algorithms are essentially…

Machine Learning · Computer Science 2013-10-22 Alekh Agarwal , Sham M. Kakade , Nikos Karampatziakis , Le Song , Gregory Valiant

The statistics literature of the past 15 years has established many favorable properties for sparse diminishing-bias regularization: techniques which can roughly be understood as providing estimation under penalty functions spanning the…

Applications · Statistics 2016-05-03 Matt Taddy

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

In many financial applications Quasi Monte Carlo (QMC) based on Sobol low-discrepancy sequences (LDS) outperforms Monte Carlo showing faster and more stable convergence. However, unlike MC QMC lacks a practical error estimate. Randomized…

Computational Finance · Quantitative Finance 2023-10-17 J. Hok , S. Kucherenko

We propose a block least mean square (LMS) algorithm to monitor the longitudinal power profile of a fiber-optic link through receiver-based digital data from a coherent detector. Compared to the benchmark least squares (LS) method, the…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Paolo Serena , Chiara Lasagni , Alberto Bononi , Fabien Boitier , Joana Girard-Jollet

The least squares of depth-trimmed (LST) residuals regression, proposed and studied in Zuo and Zuo (2023), serves as a robust alternative to the classic least squares (LS) regression as well as a strong competitor to the renowned robust…

Applications · Statistics 2025-01-28 Yijun Zuo , Hanwen Zuo

In this paper, we present a method for computing the marginal likelihood, also known as the model likelihood or Bayesian evidence, from Markov Chain Monte Carlo (MCMC), or other sampled posterior distributions. In order to do this, one…

This paper introduces a set of algorithms for Monte-Carlo Bayesian reinforcement learning. Firstly, Monte-Carlo estimation of upper bounds on the Bayes-optimal value function is employed to construct an optimistic policy. Secondly,…

Machine Learning · Computer Science 2016-11-18 Christos Dimitrakakis

This work presents a new variation of the commonly used Least Mean Squares Algorithm (LMS) for the identification of sparse signals with an a-priori known sparsity using a hard threshold operator in every iteration. It examines some useful…

Systems and Control · Computer Science 2016-08-04 Lampros Flokas , Petros Maragos

We propose a minimum distance estimation method for robust regression in sparse high-dimensional settings. The traditional likelihood-based estimators lack resilience against outliers, a critical issue when dealing with high-dimensional…

Methodology · Statistics 2013-07-12 Aurélie C. Lozano , Nicolai Meinshausen

In the following paper we provide a review and development of sequential Monte Carlo (SMC) methods for option pricing. SMC are a class of Monte Carlo-based algorithms, that are designed to approximate expectations w.r.t a sequence of…

Computation · Statistics 2010-05-27 Ajay Jasra , Pierre Del Moral

In this work, we extend the hybrid Chernoff tau-leap method to the multilevel Monte Carlo (MLMC) setting. Inspired by the work of Anderson and Higham on the tau-leap MLMC method with uniform time steps, we develop a novel algorithm that is…

Numerical Analysis · Mathematics 2014-11-24 Alvaro Moraes , Raul Tempone , Pedro Vilanova

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2020-02-27 Meixia Lin , Defeng Sun , Kim-Chuan Toh

Leave-one-out (LOO) prediction provides a principled, data-dependent measure of generalization, yet guarantees in fully transductive settings remain poorly understood beyond specialized models. We introduce Median of Level-Set Aggregation…

Machine Learning · Computer Science 2026-03-03 Jian Qian , Jiachen Xu

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

Machine Learning · Statistics 2016-08-01 Abolfazl Hashemi , Haris Vikalo

We consider linear mixed models in which the observations are grouped. A L1-penalization on the fixed effects coefficients of the log-likelihood obtained by considering the random effects as missing values is proposed. A multicycle ECM…

Computation · Statistics 2013-01-29 Florian Rohart , Magali San-Cristobal , Béatrice Laurent

Markov Chain Monte Carlo (MCMC) sampling from a posterior distribution corresponding to a massive data set can be computationally prohibitive since producing one sample requires a number of operations that is linear in the data size. In…

Machine Learning · Statistics 2017-07-03 Reihaneh Entezari , Radu V. Craiu , Jeffrey S. Rosenthal

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

We introduce a computationally effective algorithm for a linear model selection consisting of three steps: screening--ordering--selection (SOS). Screening of predictors is based on the thresholded Lasso that is l_1 penalized least squares.…

Machine Learning · Statistics 2013-10-24 Piotr Pokarowski , Jan Mielniczuk

The rough Bergomi (rBergomi) model, introduced recently in [5], is a promising rough volatility model in quantitative finance. It is a parsimonious model depending on only three parameters, and yet remarkably fits with empirical implied…

Computational Finance · Quantitative Finance 2020-07-13 Christian Bayer , Chiheb Ben Hammouda , Raul Tempone