English
Related papers

Related papers: pared: Model selection using multi-objective optim…

200 papers

Fine-tuning from a collection of models pre-trained on different domains (a "model zoo") is emerging as a technique to improve test accuracy in the low-data regime. However, model selection, i.e. how to pre-select the right model to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Aditya Deshpande , Alessandro Achille , Avinash Ravichandran , Hao Li , Luca Zancato , Charless Fowlkes , Rahul Bhotika , Stefano Soatto , Pietro Perona

We consider a multi-objective optimization problem with objective functions that are expensive to evaluate. The decision maker (DM) has unknown preferences, and so the standard approach is to generate an approximation of the Pareto front…

Machine Learning · Computer Science 2021-05-28 Juan Ungredda , Mariapia Marchi , Teresa Montrone , Juergen Branke

High-dimensional prediction considers data with more variables than samples. Generic research goals are to find the best predictor or to select variables. Results may be improved by exploiting prior information in the form of co-data,…

Methodology · Statistics 2022-05-17 Mirrelijn M. van Nee , Lodewyk F. A. Wessels , Mark A. van de Wiel

Analyzing time-series cross-sectional (also known as longitudinal or panel) data is an important process across a number of fields, including the social sciences, economics, finance, and medicine. PanelMatch is an R package that implements…

Methodology · Statistics 2025-08-19 Adam Rauh , In Song Kim , Kosuke Imai

The sequential parameter optimization (SPOT) package for R is a toolbox for tuning and understanding simulation and optimization algorithms. Model-based investigations are common approaches in simulation and optimization. Sequential…

Neural and Evolutionary Computing · Computer Science 2010-06-25 Thomas Bartz-Beielstein

Latent Markov (LM) models represent an important class of models for the analysis of longitudinal data (Bartolucci et. al., 2013), especially when response variables are categorical. These models have a great potential of application for…

Computation · Statistics 2015-01-20 Francesco Bartolucci , Alessio Farcomeni , Silvia Pandolfi , Fulvia Pennoni

Finite mixture modelling provides a framework for cluster analysis based on parsimonious Gaussian mixture models. Variable or feature selection is of particular importance in situations where only a subset of the available variables provide…

Computation · Statistics 2014-11-04 Luca Scrucca , Adrian E. Raftery

Background: Clinical prediction models are increasingly used to inform healthcare decisions, but determining the minimum sample size for their development remains a critical and unresolved challenge. Inadequate sample sizes can lead to…

Machine Learning · Computer Science 2026-03-02 Diana Shamsutdinova , Felix Zimmer , Oyebayo Ridwan Olaniran , Sarah Markham , Daniel Stahl , Gordon Forbes , Ewan Carr

varstan is an \proglang{R} package for Bayesian analysis of time series models using \proglang{Stan}. The package offers a dynamic way to choose a model, define priors in a wide range of distributions, check model's fit, and forecast with…

Computation · Statistics 2020-05-22 Izhar Asael Alonzo Matamoros , Cristian Andres Cruz Torres

In the context of regression with a large number of explanatory variables, Cox and Battey (2017) emphasize that if there are alternative reasonable explanations of the data that are statistically indistinguishable, one should aim to specify…

Computation · Statistics 2019-03-15 Henrique Helfer Hoeltgebaum , Heather Battey

The sparse group lasso optimization problem is solved using a coordinate gradient descent algorithm. The algorithm is applicable to a broad class of convex loss functions. Convergence of the algorithm is established, and the algorithm is…

Machine Learning · Statistics 2013-02-07 Martin Vincent , Niels Richard Hansen

The INLA package provides a tool for computationally efficient Bayesian modeling and inference for various widely used models, more formally the class of latent Gaussian models. It is a non-sampling based framework which provides…

Methodology · Statistics 2019-07-26 Janet van Niekerk , Haakon Bakka , Haavard Rue , Olaf Schenk

Stability selection represents an attractive approach to identify sparse sets of features jointly associated with an outcome in high-dimensional contexts. We introduce an automated calibration procedure via maximisation of an in-house…

Ordinal user-provided ratings across multiple items are frequently encountered in both scientific and commercial applications. Whilst recommender systems are known to do well on these type of data from a predictive point of view, their…

Methodology · Statistics 2025-03-05 Sjoerd Hermes

The matrixdist R package provides a comprehensive suite of tools for the statistical analysis of matrix distributions, including phase-type, inhomogeneous phase-type, discrete phase-type, and related multivariate distributions. This paper…

Computation · Statistics 2025-03-11 Martin Bladt , Alaric Mueller , Jorge Yslas

Cross-fitting is a key ingredient in many semiparametric estimation procedures, such as double/debiased machine learning (DML), enabling valid estimation of low-dimensional targets in the presence of high-dimensional nuisance functions by…

Computation · Statistics 2026-05-18 Etienne Peyrot , François Petit

Bayesian methodologies prioritising accurate associations above sparsity in Gaussian graphical model (GGM) estimation remain relatively scarce in scientific literature. It is well accepted that the $\ell_2$ penalty enjoys a smaller…

Methodology · Statistics 2022-10-31 J. Smith , M. Arashi , A. Bekker

We present `latentcor`, an R package for correlation estimation from data with mixed variable types. Mixed variables types, including continuous, binary, ordinal, zero-inflated, or truncated data are routinely collected in many areas of…

Computation · Statistics 2022-04-22 Mingze Huang , Christian L. Müller , Irina Gaynanova

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected…

Artificial Intelligence · Computer Science 2022-11-11 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

An R package for specifying and estimating linear latent variable models is presented. The philosophy of the implementation is to separate the model specification from the actual data, which leads to a dynamic and easy way of modeling…

Computation · Statistics 2013-12-10 Klaus K. Holst , Esben Budtz-Jørgensen