English
Related papers

Related papers: Rejoinder: Boosting Algorithms: Regularization, Pr…

200 papers

In the context of computer models, calibration is the process of estimating unknown simulator parameters from observational data. Calibration is variously referred to as model fitting, parameter estimation/inference, an inverse problem, and…

Methodology · Statistics 2023-10-16 Richard D. Wilkinson , Christopher W. Lanyon

This document contains improved and updated proofs of convergence for the sampling method presented in our paper "Free-configuration Biased Sampling for Motion Planning".

Robotics · Computer Science 2013-11-05 Joshua Bialkowski , Michael Otte , Emilio Frazzoli

We deal with the task of supervised learning if the data is of functional type. The crucial point is the choice of the appropriate fitting method (learner). Boosting is a stepwise technique that combines learners in such a way that the…

Statistics Theory · Mathematics 2007-06-13 Nicole Kraemer

Regularization is one of the crucial ingredients of deep learning, yet the term regularization has various definitions, and regularization methods are often studied separately from each other. In our work we present a systematic, unifying…

Machine Learning · Computer Science 2017-10-31 Jan Kukačka , Vladimir Golkov , Daniel Cremers

Interpreting data with mathematical models is an important aspect of real-world industrial and applied mathematical modeling. Often we are interested to understand the extent to which a particular set of data informs and constrains model…

Methodology · Statistics 2025-03-06 Matthew J Simpson , Ruth E Baker

This article presents a short and concise description of stochastic approximation algorithms in reinforcement learning of Markov decision processes. The algorithms can also be used as a suboptimal method for partially observed Markov…

Optimization and Control · Mathematics 2015-12-25 Vikram Krishnamurthy

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

Methodology · Statistics 2019-07-16 Darren Homrighausen , Daniel J. McDonald

The Annals of Applied Probability 16 (2006) 984--1033 [URL: http://projecteuclid.org/euclid.aoap/1151592257]

Probability · Mathematics 2008-12-18 Yan Dolinsky , Yuri Kifer

In this contribution we revisit regular model checking, a powerful framework that has been successfully applied for the verification of infinite-state systems, especially parameterized systems (concurrent systems with an arbitrary number of…

Logic in Computer Science · Computer Science 2021-11-23 Anthony W. Lin , Philipp Rümmer

In recent years, a variety of extensions and refinements have been developed for data augmentation based model fitting routines. These developments aim to extend the application, improve the speed and/or simplify the implementation of data…

Methodology · Statistics 2016-02-19 David A. van Dyk , Xiao-Li Meng

We introduce a new replicable boosting algorithm which significantly improves the sample complexity compared to previous algorithms. The algorithm works by doing two layers of majority voting, using an improved version of the replicable…

Machine Learning · Computer Science 2025-02-05 Kasper Green Larsen , Markus Engelund Mathiasen , Clement Svendsen

This paper surveys the machine learning literature and presents in an optimization framework several commonly used machine learning approaches. Particularly, mathematical optimization models are presented for regression, classification,…

Optimization and Control · Mathematics 2021-01-12 Claudio Gambella , Bissan Ghaddar , Joe Naoum-Sawaya

Machine learning (ML) has become a standard tool for the exploration of chemical space. Much of the performance of such models depends on the chosen database for a given task. Here, this aspect is investigated for "chemical tasks" including…

Chemical Physics · Physics 2025-04-03 Luis Itza Vazquez-Salazar , Markus Meuwly

Regularization is a popular technique to solve the overfitting problem of machine learning algorithms. Most regularization technique relies on parameter selection of the regularization coefficient. Plug-in method and cross-validation…

Machine Learning · Computer Science 2022-05-24 Hao Wang

In this thesis, we draw inspiration from both classical system identification and modern machine learning in order to solve estimation problems for real-world, physical systems. The main approach to estimation and learning adopted is…

Machine Learning · Computer Science 2024-09-23 Fredrik Bagge Carlson

When a user finds an interesting recommendation in a recommender system, the user may want to recall related items recommended in the past to reconsider or to enjoy them again. If the system can pick up such "recalled" items at each user's…

Information Retrieval · Computer Science 2013-10-24 Keisuke Hara , Tomihisa Kamada

Boosting is a fundamental approach in machine learning that enjoys both strong theoretical and practical guarantees. At a high-level, boosting algorithms cleverly aggregate weak learners to generate predictions with arbitrarily high…

Machine Learning · Computer Science 2022-10-19 Vinod Raman , Ambuj Tewari

Deep-learning-based nonlinear system identification has shown the ability to produce reliable and highly accurate models in practice. However, these black-box models lack physical interpretability, and a considerable part of the learning…

Machine Learning · Computer Science 2025-07-15 Bendegúz M. Györök , Jan H. Hoekstra , Johan Kon , Tamás Péni , Maarten Schoukens , Roland Tóth

A new recalibration post-processing method is presented to improve the quality of the posterior approximation when using Approximate Bayesian Computation (ABC) algorithms. Recalibration may be used in conjunction with existing…

Computation · Statistics 2017-04-24 G. S. Rodrigues , D. Prangle , S. A. Sisson

We develop a model-based boosting approach for multivariate distributional regression within the framework of generalized additive models for location, scale, and shape. Our approach enables the simultaneous modeling of all distribution…

Methodology · Statistics 2022-07-19 Annika Strömer , Nadja Klein , Christian Staerk , Hannah Klinkhammer , Andreas Mayr