English
Related papers

Related papers: A distributed active subspace method for scalable …

200 papers

The immense model sizes of large language models (LLMs) challenge deployment on memory-limited consumer GPUs. Although model compression and parameter offloading are common strategies to address memory limitations, compression can degrade…

Computation and Language · Computer Science 2025-10-10 Pei-Shuo Wang , Jian-Jia Chen , Chun-Che Yang , Chi-Chih Chang , Ning-Chi Huang , Mohamed S. Abdelfattah , Kai-Chiang Wu

Expensive multi-objective optimization problems (EMOPs) are common in real-world scenarios where evaluating objective functions is costly and involves extensive computations or physical experiments. Current Pareto set learning methods for…

Machine Learning · Computer Science 2025-03-18 Minh-Duc Nguyen , Phuong Mai Dinh , Quang-Huy Nguyen , Long P. Hoang , Dung D. Le

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

Numerical Analysis · Mathematics 2024-04-03 Phillip Semler , Martin Weiser

Gradient-based optimization of engineering designs is limited by non-differentiable components in the typical computer-aided engineering (CAE) workflow, which calculates performance metrics from design parameters. While gradient-based…

Computational Engineering, Finance, and Science · Computer Science 2025-11-17 Andrin Rehmann , Nolan Black , Josiah Bjorgaard , Alessandro Angioi , Andrei Paleyes , Niklas Heim , Dion Häfner , Alexander Lavin

In this article, the formulation of Lagrange Multiplier State-Space Substructuring (LM-SSS) is presented and extended to directly compute coupled displacement and velocity state-space models. The LM-SSS method is applied to couple and…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Rafael Da Silva Oliveira Dias , Milena Martarelli , Paolo Chiariotti

A surrogate model based hyperparameter tuning approach for deep learning is presented. This article demonstrates how the architecture-level parameters (hyperparameters) of deep learning models that were implemented in Keras/tensorflow can…

Machine Learning · Computer Science 2021-07-07 Thomas Bartz-Beielstein , Frederik Rehbach , Amrita Sen , Martin Zaefferer

Surrogate models have shown to be an extremely efficient aid in solving engineering problems that require repeated evaluations of an expensive computational model. They are built by sparsely evaluating the costly original model and have…

Machine Learning · Statistics 2022-12-01 M. Moustapha , B. Sudret

Thanks to their versatility, ease of deployment and high-performance, surrogate models have become staple tools in the arsenal of uncertainty quantification (UQ). From local interpolants to global spectral decompositions, surrogates are…

Machine Learning · Statistics 2020-02-12 C. Lataniotis , S. Marelli , B. Sudret

We propose an active sampling flow, with the use-case of simulating the impact of combined variations on analog circuits. In such a context, given the large number of parameters, it is difficult to fit a surrogate model and to efficiently…

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Diffusion kernels over graphs have been widely utilized as effective tools in various applications due to their ability to accurately model the flow of information through nodes and edges. However, there is a notable gap in the literature…

Numerical Analysis · Mathematics 2026-04-15 Giuseppe Alessio D'Inverno , Kylian Ajavon , Simone Brugiapaglia

Surrogate models are widely used in mechanical design and manufacturing process optimization, where high-fidelity computational models may be unavailable or prohibitively expensive. Their effectiveness, however, is often limited by data…

Machine Learning · Computer Science 2026-03-03 Bingran Wang , Seongha Jeong , Sebastiaan P. C. van Schie , Dongyeon Han , Jaeho Min , John T. Hwang

Recent advancements in Machine Learning (ML) have substantially improved its predictive and computational abilities, offering promising opportunities for surrogate modeling in scientific applications. By accurately approximating complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zane Fink , Konstantinos Parasyris , Praneet Rathi , Giorgis Georgakoudis , Harshitha Menon , Peer-Timo Bremer

Taking agent-based models (ABM) closer to the data is an open challenge. This paper explicitly tackles parameter space exploration and calibration of ABMs combining supervised machine-learning and intelligent sampling to build a surrogate…

Economics · Quantitative Finance 2017-04-07 Francesco Lamperti , Andrea Roventini , Amir Sani

High-fidelity electromagnetic (EM) simulations are indispensable for the design of microwave and wave devices, yet repeated full-wave evaluations over high-dimensional design spaces are often computationally prohibitive. While neural…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Mingze Sun , Liang Li , Xile Zhao , Zheng Tan , Yulu Hu , Xing Li , Bin Li

The previously established LOUPE (Learning-based Optimization of the Under-sampling Pattern) framework for optimizing the k-space sampling pattern in MRI was extended in three folds: firstly, fully sampled multi-coil k-space data from the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-30 Jinwei Zhang , Hang Zhang , Alan Wang , Qihao Zhang , Mert Sabuncu , Pascal Spincemaille , Thanh D. Nguyen , Yi Wang

High-fidelity numerical simulations of chaotic, high dimensional nonlinear dynamical systems are computationally expensive, necessitating the development of efficient surrogate models. Most surrogate models for such systems are…

Machine Learning · Computer Science 2026-03-16 Dibyajyoti Chakraborty , Hojin Kim , Romit Maulik

A multi-fidelity surrogate model for highly nonlinear multiscale problems is proposed. It is based on the introduction of two different surrogate models and an adaptive on-the-fly switching. The two concurrent surrogates are built…

Computational Physics · Physics 2019-05-03 Felix Fritzen , Mauricio Fernández , Fredrik Larsson

In this work, we propose a novel sampling method for Design of Experiments. This method allows to sample such input values of the parameters of a computational model for which the constructed surrogate model will have the least possible…

Numerical Analysis · Computer Science 2018-10-03 V. P. Zankin , G. V. Ryzhakov , I. V. Oseledets

Deep learning has proven to be effective in a wide variety of loss minimization problems. However, many applications of interest, like minimizing projected Bellman error and min-max optimization, cannot be modelled as minimizing a scalar…

Machine Learning · Computer Science 2025-05-27 Ryan D'Orazio , Danilo Vucetic , Zichu Liu , Junhyung Lyle Kim , Ioannis Mitliagkas , Gauthier Gidel