English
Related papers

Related papers: pared: Model selection using multi-objective optim…

200 papers

To harness the full benefit of new computing platforms, it is necessary to develop software with parallel computing capabilities. This is no less true for statisticians than for astrophysicists. The R programming language, which is perhaps…

Computation · Statistics 2017-09-08 George Ostrouchov , Wei-Chen Chen , Drew Schmidt

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

In this work, we propose a novel method to tackle the problem of multiobjective optimization under parameteric uncertainties, by considering the Conditional Pareto Sets and Conditional Pareto Fronts. Based on those quantities we can define…

Optimization and Control · Mathematics 2026-01-15 Victor Trappler , Céline Helbert , Rodolphe Le Riche

This paper provides a novel framework for solving multiobjective discrete optimization problems with an arbitrary number of objectives. Our framework formulates these problems as network models, in that enumerating the Pareto frontier…

Optimization and Control · Mathematics 2018-09-06 David Bergman , Merve Bodur , Carlos Cardonha , Andre A. Cire

Variable selection is recognized as one of the most critical steps in statistical modeling. The problems encountered in engineering and social sciences are commonly characterized by over-abundance of explanatory variables, non-linearities…

Computation · Statistics 2016-07-14 Ankur Sinha , Pekka Malo , Timo Kuosmanen

The past decade has witnessed a dramatic increase in the size and scope of biological and behavioral experiments. These experiments are providing an unprecedented level of detail and depth of data. However, this increase in data presents…

Quantitative Methods · Quantitative Biology 2014-04-03 Samuel V. Scarpino , Ross Gillette , David Crews

The prediction interval is gaining prominence in meta-analysis as it enables the assessment of uncertainties in treatment effects and heterogeneity between studies. However, coverage probabilities of the current standard method for…

Methodology · Statistics 2021-10-18 Kengo Nagashima , Hisashi Noma , Toshi A. Furukawa

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos

A homotopy method for multi-objective optimization that produces uniformly sampled Pareto fronts by construction is presented. While the algorithm is general, of particular interest is application to simulation-based engineering…

Optimization and Control · Mathematics 2015-05-13 Andreas Adelmann , Peter Arbenz , Andrew Foster , Yves Ineichen

Generalized additive model is a powerful statistical learning and predictive modeling tool that has been applied in a wide range of applications. The need of high-dimensional additive modeling is eminent in the context of dealing with high…

Methodology · Statistics 2021-07-08 Kaixu Yang , Tapabrata Maiti

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

We introduce a computationally effective algorithm for a linear model selection consisting of three steps: screening--ordering--selection (SOS). Screening of predictors is based on the thresholded Lasso that is l_1 penalized least squares.…

Machine Learning · Statistics 2013-10-24 Piotr Pokarowski , Jan Mielniczuk

In this paper, we propose a novel variable selection approach in the framework of multivariate linear models taking into account the dependence that may exist between the responses. It consists in estimating beforehand the covariance matrix…

Statistics Theory · Mathematics 2017-07-14 Marie Perrot-Dockès , Céline Lévy-Leduc , Laure Sansonnet , Julien Chiquet

In this paper, for Lasso penalized linear regression models in high-dimensional settings, we propose a modified cross-validation method for selecting the penalty parameter. The methodology is extended to other penalties, such as Elastic…

Methodology · Statistics 2013-09-10 Yi Yu , Yang Feng

In several applied fields, multimodality assessment is a crucial task as a previous exploratory tool or for determining the suitability of certain distributions. The goal of this paper is to present the utilities of the R package multimode,…

Computation · Statistics 2022-11-21 Jose Ameijeiras-Alonso , Rosa M. Crujeiras , Alberto Rodríguez-Casal

We present vivid, an R package for visualizing variable importance and variable interactions in machine learning models. The package provides a range of displays including heatmap and graph-based displays for viewing variable importance and…

Computation · Statistics 2024-10-15 Alan Inglis , Andrew Parnell , Catherine Hurley

Multiple imputation is widely used for handling missing data in real-world applications. For variable selection on multiply-imputed datasets, however, if selection is performed on each imputed dataset separately, it can result in different…

Methodology · Statistics 2025-08-07 Jungang Zou , Sijian Wang , Qixuan Chen

Gaussian processes (GPs) are well-known tools for modeling dependent data with applications in spatial statistics, time series analysis, or econometrics. In this article, we present the R package varycoef that implements estimation,…

Computation · Statistics 2021-06-07 Jakob A. Dambon , Fabio Sigrist , Reinhard Furrer

Ranking data represent a peculiar form of multivariate ordinal data taking values in the set of permutations. Despite the numerous methodological contributions to increase the flexibility of ranked data modeling, the application of more…

Computation · Statistics 2018-03-13 Cristina Mollica , Luca Tardella

We present a multi-objective Bayesian optimisation algorithm that allows the user to express preference-order constraints on the objectives of the type "objective A is more important than objective B". These preferences are defined based on…

Machine Learning · Computer Science 2019-11-14 Majid Abdolshah , Alistair Shilton , Santu Rana , Sunil Gupta , Svetha Venkatesh