English
Related papers

Related papers: Efficient and Consistent Data-Driven Model Selecti…

200 papers

A maximum likelihood based model selection of discrete Bayesian networks is considered. The model selection is performed through scoring function $S$, which, for a given network $G$ and $n$-sample $D_n$, is defined to be the maximum…

Statistics Theory · Mathematics 2013-04-18 Nikolay H. Balov

Effective model selection is critical in symbolic regression (SR) to identify mathematical expressions that balance accuracy and complexity, and have low expected error on unseen data. Many modern implementations of genetic programming (GP)…

Machine Learning · Computer Science 2026-05-13 Ali Soltani , Gabriel Kronberger , Fabricio Olivetti de Franca , Mattia Billa , Alessandro Lucantonio

The potential of Model Predictive Control in buildings has been shown many times, being successfully used to achieve various goals, such as minimizing energy consumption or maximizing thermal comfort. However, mass deployment has thus far…

Applications · Statistics 2023-02-09 Manuel Koch , Colin N. Jones

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

The Bayesian information criterion (BIC), defined as the observed data log likelihood minus a penalty term based on the sample size $N$, is a popular model selection criterion for factor analysis with complete data. This definition has also…

Machine Learning · Statistics 2022-04-21 Jianhua Zhao , Changchun Shang , Shulan Li , Ling Xin , Philip L. H. Yu

We provide in this paper a fully adaptive penalized procedure to select a covariance among a collection of models observing i.i.d replications of the process at fixed observation points. For this we generalize previous results of Bigot and…

Statistics Theory · Mathematics 2012-03-05 Rolando Biscay , Hélène Lescornel , Jean-Michel Loubes

We prove the consistency and asymptotic normality of the Laplacian Quasi-Maximum Likelihood Estimator (QMLE) for a general class of causal time series including ARMA, AR($\infty$), GARCH, ARCH($\infty$), ARMA-GARCH, APARCH, ARMA-APARCH,...,…

Statistics Theory · Mathematics 2017-02-22 Jean-Marc Bardet , Yakoub Boularouk , Khedidja Djaballah

Approximate Bayesian Computation (ABC) methods are increasingly used for inference in situations in which the likelihood function is either computationally costly or intractable to evaluate. Extensions of the basic ABC rejection algorithm…

Computation · Statistics 2020-05-01 Umberto Simola , Jessica Cisewski-Kehe , Michael U. Gutmann , Jukka Corander

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

Statistics Theory · Mathematics 2009-09-11 Ikhlef Bechar

Choosing a shrinkage method can be done by selecting a penalty from a list of pre-specified penalties or by constructing a penalty based on the data. If a list of penalties for a class of linear models is given, we provide comparisons based…

Methodology · Statistics 2022-01-10 Dean Dustin , Bertrand Clarke , Jennifer Clarke

We study the quadratic prediction error method -- i.e., nonlinear least squares -- for a class of time-varying parametric predictor models satisfying a certain identifiability condition. While this method is known to asymptotically achieve…

Statistics Theory · Mathematics 2024-04-17 Charis Stamouli , Ingvar Ziemann , George J. Pappas

An increasing number of applications require to recognize the class of an incoming time series as quickly as possible without unduly compromising the accuracy of the prediction. In this paper, we put forward a new optimization criterion…

Machine Learning · Computer Science 2021-03-25 Youssef Achenchabe , Alexis Bondu , Antoine Cornuéjols , Asma Dachraoui

We deal with Bayesian inference for Beta autoregressive processes. We restrict our attention to the class of conditionally linear processes. These processes are particularly suitable for forecasting purposes, but are difficult to estimate…

Statistics Theory · Mathematics 2010-08-03 R. Casarin , L. Dalla Valle , F. Leisen

We express the classic ARMA time-series model as a directed graphical model. In doing so, we find that the deterministic relationships in the model make it effectively impossible to use the EM algorithm for learning model parameters. To…

Applications · Statistics 2012-08-10 Bo Thiesson , David Maxwell Chickering , David Heckerman , Christopher Meek

This paper studies the problem of Anytime-Competitive Markov Decision Process (A-CMDP). Existing works on Constrained Markov Decision Processes (CMDPs) aim to optimize the expected reward while constraining the expected cost over random…

Machine Learning · Computer Science 2024-02-06 Jianyi Yang , Pengfei Li , Tongxin Li , Adam Wierman , Shaolei Ren

The Cox proportional hazards model, commonly used in clinical trials, assumes proportional hazards. However, it does not hold when, for example, there is a delayed onset of the treatment effect. In such a situation, an acute change in the…

Methodology · Statistics 2022-04-22 Ryoto Ozaki , Yoshiyuki Ninomiya

With the rapid development of technology, the automated monitoring systems of large-scale factories are becoming more and more important. By collecting a large amount of machine sensor data, we can have many ways to find anomalies. We…

Machine Learning · Computer Science 2024-05-06 Ching Chang , Wen-Chih Peng

This paper demonstrates the applicability of the safe model predictive control (SMPC) framework to autonomous driving scenarios, focusing on the design of adaptive cruise control (ACC) and automated lane-change systems. Building on the SMPC…

Systems and Control · Electrical Eng. & Systems 2025-05-12 Francesco Prignoli , Ying Shuai Quan , Mohammad Jeddi , Jonas Sjöberg , Paolo Falcone

In this paper, we present a robust adaptive model predictive control (MPC) scheme for linear systems subject to parametric uncertainty and additive disturbances. The proposed approach provides a computationally efficient formulation with…

Systems and Control · Electrical Eng. & Systems 2020-03-12 Johannes Köhler , Elisa Andina , Raffaele Soloperto , Matthias A. Müller , Frank Allgöwer

Approximate Bayesian computation methods can be used to evaluate posterior distributions without having to calculate likelihoods. In this paper we discuss and apply an approximate Bayesian computation (ABC) method based on sequential Monte…

Computation · Statistics 2009-01-15 Tina Toni , David Welch , Natalja Strelkowa , Andreas Ipsen , Michael P. H. Stumpf