English
Related papers

Related papers: A Multi-objective Exploratory Procedure for Regres…

200 papers

We propose Stepwise cOnditional likelihood variable selection for Discriminant Analysis (SODA) to detect both main and quadratic interaction effects in logistic regression and quadratic discriminant analysis (QDA) models. In the forward…

Methodology · Statistics 2017-05-31 Yang Li , Jun S. Liu

In the data-rich environment, using many economic predictors to forecast a few key variables has become a new trend in econometrics. The commonly used approach is factor augment (FA) approach. In this paper, we pursue another direction,…

Econometrics · Economics 2020-07-21 Zhenzhong Wang , Zhengyuan Zhu , Cindy Yu

For classification problems, feature extraction is a crucial process which aims to find a suitable data representation that increases the performance of the machine learning algorithm. According to the curse of dimensionality theorem, the…

Machine Learning · Computer Science 2010-10-12 Ilknur Icke , Andrew Rosenberg

We derive an objective function that can be optimized to give an estimator of the Vapnik- Chervonenkis dimension for model selection in regression problems. We verify our estimator is consistent. Then, we verify it performs well compared to…

Statistics Theory · Mathematics 2018-08-17 Merlin Mpoudeu , Bertrand Clarke

Many data sets consist of variables with an inherent group structure. The problem of group selection has been well studied, but in this paper, we seek to do the opposite: our goal is to select at least one variable from each group in the…

Methodology · Statistics 2015-05-29 Frederick Campbell , Genevera I. Allen

We propose a data segmentation methodology for the high-dimensional linear regression problem where regression parameters are allowed to undergo multiple changes. The proposed methodology, MOSEG, proceeds in two stages: first, the data are…

Methodology · Statistics 2023-11-02 Haeran Cho , Dom Owens

In this paper, we propose an interactive genetic algorithm for solving multi-objective combinatorial optimization problems under preference imprecision. More precisely, we consider problems where the decision maker's preferences over…

Artificial Intelligence · Computer Science 2023-11-13 Nawal Benabbou , Cassandre Leroy , Thibaut Lust

Regression plays a key role in many research areas and its variable selection is a classic and major problem. This study emphasizes cost of predictors to be purchased for future use, when we select a subset of them. Its economic aspect is…

Methodology · Statistics 2021-03-19 Steven N. MacEachern , Koji Miyawaki

In real case applications within the virtual prototyping process, it is not always possible to reduce the complexity of the physical models and to obtain numerical models which can be solved quickly. Usually, every single numerical…

Machine Learning · Computer Science 2024-08-29 Thomas Most , Johannes Will

Multiobjective feature selection seeks to determine the most discriminative feature subset by simultaneously optimizing two conflicting objectives: minimizing the number of selected features and the classification error rate. The goal is to…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Zhenxing Zhang , Qianxiang An , Yilei Wang , Chenfeng Wu , Baoling Dong , Chunjie Zhou

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in particular whenever…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Christian Haider , Fabricio Olivetti de França , Bogdan Burlacu , Gabriel Kronberger

This paper considers multiple regression procedures for analyzing the relationship between a response variable and a vector of covariates in a nonparametric setting where both tuning parameters and the number of covariates need to be…

Statistics Theory · Mathematics 2007-06-13 Chad M. Schafer , Kjell A. Doksum

Automated Algorithm Selection (AAS) is a popular meta-algorithmic approach and has demonstrated to work well for single-objective optimisation in combination with exploratory landscape features (ELA), i.e., (numerical) descriptive features…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Oliver Preuß , Jeroen Rook , Jakob Bossek , Heike Trautmann

Outlying observations can be challenging to handle and adversely affect subsequent analyses, especially in data with increasing dimensional complexity. Although outliers are not always undesired anomalies in the data and may possess…

Methodology · Statistics 2025-09-18 Anthony-Alexander Christidis , Gabriela Cohen-Freue

In real case applications within the virtual prototyping process, it is not always possible to reduce the complexity of the physical models and to obtain numerical models which can be solved quickly. Usually, every single numerical…

Methodology · Statistics 2024-08-08 Thomas Most , Johannes Will

In the regression problem, we consider the problem of estimating the variance function by the means of aggregation methods. We focus on two particular aggregation setting: Model Selection aggregation (MS) and Convex aggregation (C) where…

Machine Learning · Statistics 2021-10-07 Ahmed Zaoui

Software quality estimation is a challenging and time-consuming activity, and models are crucial to face the complexity of such activity on modern software applications. In this context, software refactoring is a crucial activity within…

Software Engineering · Computer Science 2024-01-31 Vittorio Cortellessa , Daniele Di Pompeo , Vincenzo Stoico , Michele Tucci

Metaheuristic search algorithms look for solutions that either maximise or minimise a set of objectives, such as cost or performance. However most real-world optimisation problems consist of nonlinear problems with complex constraints and…

Neural and Evolutionary Computing · Computer Science 2022-06-29 Manjinder Singh , Alexander E. I. Brownlee , David Cairns

For linear models that may have asymmetric errors, we study variable selection by cross-validation. The data are split into training and validation sets, with the number of observations in the validation set much larger than in the training…

Methodology · Statistics 2026-01-16 Bilel Bousselmi , Gabriela Ciuperca

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky