中文
相关论文

相关论文: Surrogate Model Based Hyperparameter Tuning for De…

200 篇论文

Hyperparameter optimization is very frequently employed in machine learning. However, an optimization of a large space of parameters could result in overfitting of models. In recent studies on solubility prediction the authors collected…

机器学习 · 计算机科学 2024-11-26 Igor V. Tetko , Ruud van Deursen , Guillaume Godin

Surrogate strategies are used widely for uncertainty quantification of groundwater models in order to improve computational efficiency. However, their application to dynamic multiphase flow problems is hindered by the curse of…

机器学习 · 统计学 2019-05-02 Shaoxing Mo , Yinhao Zhu , Nicholas Zabaras , Xiaoqing Shi , Jichun Wu

We present a traffic simulation named DeepTraffic where the planning systems for a subset of the vehicles are handled by a neural network as part of a model-free, off-policy reinforcement learning process. The primary goal of DeepTraffic is…

神经与进化计算 · 计算机科学 2019-01-04 Lex Fridman , Jack Terwilliger , Benedikt Jenik

This chapter deals with kernel methods as a special class of techniques for surrogate modeling. Kernel methods have proven to be efficient in machine learning, pattern recognition and signal analysis due to their flexibility, excellent…

数值分析 · 数学 2022-10-31 Gabriele Santin , Bernard Haasdonk

Production optimization in stress-sensitive unconventional reservoirs is governed by a nonlinear trade-off between pressure-driven flow and stress-induced degradation of fracture conductivity and matrix permeability. While higher drawdown…

机器学习 · 计算机科学 2026-04-02 Mahammad Valiyev , Jodel Cornelio , Behnam Jafarpour

Prompt tuning prepends a soft prompt to the input embeddings or hidden states and only optimizes the prompt to adapt pretrained models (PTMs) to downstream tasks. The previous work manually selects prompt layers which are far from optimal…

计算与语言 · 计算机科学 2023-11-01 Wei Zhu , Ming Tan

Surrogate-assistance approaches have long been used in computationally expensive domains to improve the data-efficiency of optimization algorithms. Neuroevolution, however, has so far resisted the application of these techniques because it…

神经与进化计算 · 计算机科学 2018-04-18 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

Surrogate models are often used as computationally efficient approximations to complex simulation models, enabling tasks such as solving inverse problems, sensitivity analysis, and probabilistic forward predictions, which would otherwise be…

机器学习 · 统计学 2026-05-13 Philipp Reiser , Paul-Christian Bürkner , Anneli Guthke

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

最优化与控制 · 数学 2023-12-27 Rishabh Gupta , Qi Zhang

Hyperparameter optimization in machine learning (ML) deals with the problem of empirically learning an optimal algorithm configuration from data, usually formulated as a black-box optimization problem. In this work, we propose a zero-shot…

Driven by increased complexity of dynamical systems, the solution of system of differential equations through numerical simulation in optimization problems has become computationally expensive. This paper provides a smart data driven…

最优化与控制 · 数学 2021-08-25 Kainat Khowaja , Mykhaylo Shcherbatyy , Wolfgang Karl Härdle

Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Proper Orthogonal…

计算工程、金融与科学 · 计算机科学 2025-02-26 Abhishek Ajayakumar , Soumyendu Raha

Microstructure evolution, which plays a critical role in determining materials properties, is commonly simulated by the high-fidelity but computationally expensive phase-field method. To address this, we approximate microstructure evolution…

材料科学 · 物理学 2024-11-22 Saurabh Tiwari , Prathamesh Satpute , Supriyo Ghosh

Parameter-efficient transfer learning (PETL) methods adapt large artificial neural networks to downstream tasks without fine-tuning the entire model. However, existing additive methods, such as adapters, sometimes struggle to capture…

机器学习 · 计算机科学 2026-04-20 Amirmohammad Mohammadi , Davelle Carreiro , Alexandra Van Dine , Joshua Peeples

Machine learning surrogate emulators are needed in engineering design and optimization tasks to rapidly emulate computationally expensive physics-based models. In micromechanics problems the local full-field response variables are desired…

计算工程、金融与科学 · 计算机科学 2024-05-17 Patxi Fernandez-Zelaia , Jason Mayeur , Jiahao Cheng , Yousub Lee , Kevin Knipe , Kai Kadau

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

机器学习 · 计算机科学 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo

This paper investigates lung nodule classification by using deep neural networks (DNNs). Hyperparameter optimization in DNNs is a computationally expensive problem, where evaluating a hyperparameter configuration may take several hours or…

机器学习 · 计算机科学 2019-01-03 Miao Zhang , Huiqi Li , Juan Lyu , Sai Ho Ling , Steven Su

Highly accurate datasets from numerical or physical experiments are often expensive and time-consuming to acquire, posing a significant challenge for applications that require precise evaluations, potentially across multiple scenarios and…

机器学习 · 计算机科学 2026-02-06 Paolo Conti , Mengwu Guo , Attilio Frangi , Andrea Manzoni

Parametric reduced-order modelling often serves as a surrogate method for hemodynamics simulations to improve the computational efficiency in many-query scenarios or to perform real-time simulations. However, the snapshots of the method…

计算工程、金融与科学 · 计算机科学 2023-10-24 Dongwei Ye , Valeria Krzhizhanovskaya , Alfons G. Hoekstra

Artificial intelligence is transforming scientific computing with deep neural network surrogates that approximate solutions to partial differential equations (PDEs). Traditional off-line training methods face issues with storage and I/O…

机器学习 · 计算机科学 2024-10-10 Sofya Dymchenko , Abhishek Purandare , Bruno Raffin