English
Related papers

Related papers: Causal-Guided Dimension Reduction for Efficient Pa…

200 papers

Pareto optimization using evolutionary multi-objective algorithms has been widely applied to solve constrained submodular optimization problems. A crucial factor determining the runtime of the used evolutionary algorithms to obtain good…

Neural and Evolutionary Computing · Computer Science 2023-05-15 Frank Neumann , Carsten Witt

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data structures, linear…

Machine Learning · Computer Science 2022-05-25 Oskar Allerbo , Rebecka Jörnsten

We investigate the unconstrained global optimization of functions with low effective dimensionality, that are constant along certain (unknown) linear subspaces. Extending the technique of random subspace embeddings in [Wang et al., Bayesian…

Optimization and Control · Mathematics 2020-03-24 Coralia Cartis , Adilet Otemissov

Engineering design optimization requires an efficient combination of a 3D shape representation, an optimization algorithm, and a design performance evaluation method, which is often computationally expensive. We present a prompt evolution…

Artificial Intelligence · Computer Science 2024-08-13 Melvin Wong , Thiago Rios , Stefan Menzel , Yew Soon Ong

Existing causal discovery methods based on combinatorial optimization or search are slow, prohibiting their application on large-scale datasets. In response, more recent methods attempt to address this limitation by formulating causal…

Machine Learning · Computer Science 2024-03-07 Victor Akinwande , J. Zico Kolter

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

Methodology · Statistics 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

Dealing with multi-objective problems by using generation methods has some interesting advantages since it provides the decision-maker with the complete information about the set of non-dominated points (Pareto front) and a clear overview…

Optimization and Control · Mathematics 2022-09-09 Mariana Mesquita-Cunha , José Rui Figueira , Ana Paula Barbosa-Póvoa

The multi-gradient descent algorithm (MGDA) finds a common descent direction that can improve all objectives by identifying the minimum-norm point in the convex hull of the objective gradients. This method has become a foundational tool in…

Optimization and Control · Mathematics 2025-04-16 Yuan-Zheng Lei , Yaobang Gong , Xianfeng Terry Yang

We consider the penalized distributionally robust optimization (DRO) problem with a closed, convex uncertainty set, a setting that encompasses learning using $f$-DRO and spectral/$L$-risk minimization. We present Drago, a stochastic…

Machine Learning · Statistics 2025-02-12 Ronak Mehta , Jelena Diakonikolas , Zaid Harchaoui

Software quality estimation is a challenging and time-consuming activity, and models are crucial to face the complexity of such activity on modern software applications. One main challenge is that the improvement of distinctive quality…

Software Engineering · Computer Science 2022-12-19 Vittorio Cortellessa , Daniele Di Pompeo , Vincenzo Stoico , Michele Tucci

In observational studies, the causal effect of a treatment may be confounded with variables that are related to both the treatment and the outcome of interest. In order to identify a causal effect, such studies often rely on the…

Methodology · Statistics 2017-10-17 Emma Persson , Jenny Häggström , Ingeborg Waernbaum , Xavier de Luna

Many mathematical optimization algorithms fail to sufficiently explore the solution space of high-dimensional nonlinear optimization problems due to the curse of dimensionality. This paper proposes generative models as a complement to…

Neural and Evolutionary Computing · Computer Science 2021-05-05 Pouya Rezazadeh Kalehbasti , Michael D. Lepech , Samarpreet Singh Pandher

The Non-dominated Sorting Genetic Algorithm II (NSGA-II) is the most prominent multi-objective evolutionary algorithm for real-world applications. While it performs evidently well on bi-objective optimization problems, empirical studies…

Neural and Evolutionary Computing · Computer Science 2023-08-25 Simon Wietheger , Benjamin Doerr

This paper is devoted to the design of efficient primal-dual algorithm (PDA) for solving convex optimization problems with known saddle-point structure. We present a new PDA with larger acceptable range of parameters and correction, which…

Optimization and Control · Mathematics 2019-12-04 Xiaokai Chang , Sanyang Liu

The advent of parameter-efficient fine-tuning methods has significantly reduced the computational burden of adapting large-scale pretrained models to diverse downstream tasks. However, existing approaches often struggle to achieve robust…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Haotian Zhang , Liu Liu , Baosheng Yu , Jiayan Qiu , Yanwei Ren , Xianglong Liu

Bayesian optimisation (BO) is a standard approach for sample-efficient global optimisation of expensive black-box functions, yet its scalability to high dimensions remains challenging. Here, we investigate nonlinear dimensionality reduction…

Optimization and Control · Mathematics 2025-10-20 Luo Long , Coralia Cartis , Paz Fink Shustin

This study presents a methodology for surrogate optimization of cyclic adsorption processes, focusing on enhancing Pressure Swing Adsorption units for carbon dioxide ($CO_{2}$) capture. We developed and implemented a multiple-input,…

Chemical Physics · Physics 2023-12-08 Carine Menezes Rebello , Idelfonso B. R. Nogueira

Deep convolutional neural networks are shown to be overkill with high parametric and computational redundancy in many application scenarios, and an increasing number of works have explored model pruning to obtain lightweight and efficient…

Machine Learning · Computer Science 2023-03-31 Wenzheng Hu , Zhengping Che , Ning Liu , Mingyang Li , Jian Tang , Changshui Zhang , Jianqiang Wang

We present a massively parallel Lagrange decomposition method for solving 0--1 integer linear programs occurring in structured prediction. We propose a new iterative update scheme for solving the Lagrangean dual and a perturbation technique…

Optimization and Control · Mathematics 2022-04-20 Ahmed Abbas , Paul Swoboda

We develop estimation for potentially high-dimensional additive structural equation models. A key component of our approach is to decouple order search among the variables from feature or edge selection in a directed acyclic graph encoding…

Methodology · Statistics 2014-12-02 Peter Bühlmann , Jonas Peters , Jan Ernest