中文
相关论文

相关论文: Efficient Activation Function Optimization through…

200 篇论文

Surrogate-assistance approaches have long been used in computationally expensive domains to improve the data-efficiency of optimization algorithms. Neuroevolution, however, has so far resisted the application of these techniques because it…

神经与进化计算 · 计算机科学 2018-04-18 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

In constraint learning, we use a neural network as a surrogate for part of the constraints or of the objective function of an optimization model. However, the tractability of the resulting model is heavily influenced by the size of the…

最优化与控制 · 数学 2026-03-19 Hung Pham , Aiden Ren , Ibrahim Tahir , Jiatai Tong , Thiago Serra

Mathematical models of the human heart are increasingly playing a vital role in understanding the working mechanisms of the heart, both under healthy functioning and during disease. The aim is to aid medical practitioners diagnose and treat…

数值分析 · 数学 2023-11-13 Sridhar Chellappa , Barış Cansız , Lihong Feng , Peter Benner , Michael Kaliske

Sensor-based human activity recognition is a key technology for many human-centered intelligent applications. However, this research is still in its infancy and faces many unresolved challenges. To address these, we propose a comprehensive…

信号处理 · 电气工程与系统科学 2025-04-08 Hanyu Liu , Ying Yu , Hang Xiao , Siyao Li , Xuze Li , Jiarui Li , Haotian Tang

Surrogate models of numerical relativity simulations of merging black holes provide the most accurate tools for gravitational-wave data analysis. Neural network-based surrogates promise evaluation speedups, but their accuracy relies on…

广义相对论与量子宇宙学 · 物理学 2025-05-21 Lucy M. Thomas , Katerina Chatziioannou , Vijay Varma , Scott E. Field

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

机器学习 · 计算机科学 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

Using Neuroevolution combined with Novelty Search to promote behavioural diversity is capable of constructing high-performing ensembles for classification. However, using gradient descent to train evolved architectures during the search can…

机器学习 · 计算机科学 2022-02-09 Rui P. Cardoso , Emma Hart , David Burth Kurka , Jeremy V. Pitt

This paper describes a simple, but effective sampling method for optimizing and learning a discrete approximation (or surrogate) of a multi-dimensional function along a one-dimensional line segment of interest. The method does not rely on…

最优化与控制 · 数学 2023-07-21 Dimitri J. Papageorgiou , Jan Kronqvist , Krishnan Kumaran

We present a new active learning framework for multiclass classification based on surrogate risk minimization that operates beyond the standard realizability assumption. Existing surrogate-based active learning algorithms crucially rely on…

机器学习 · 计算机科学 2025-06-05 Atul Ganju , Shashaank Aiyer , Ved Sriraman , Karthik Sridharan

Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural network topologies, other aspects of neural network design can…

机器学习 · 计算机科学 2023-04-10 Garrett Bingham

We employ an evolutionary optimization framework that perturbs initial states to generate informative and diverse policy demonstrations. A joint surrogate fitness function guides the optimization by combining local diversity, behavioral…

Sample efficiency in the face of computationally expensive simulations is a common concern in surrogate modeling. Current strategies to minimize the number of samples needed are not as effective in simulated environments with wide state…

机器学习 · 计算机科学 2025-09-03 Julen Cestero , Marco Quartulli , Marcello Restelli

Constructing first-principles models is usually a challenging and time-consuming task due to the complexity of the real-life processes. On the other hand, data-driven modeling, and in particular neural network models often suffer from…

最优化与控制 · 数学 2023-02-03 Ece S. Koksal , Erdal Aydin

This study aims to provide a comprehensive assessment of single-objective and multi-objective optimisation algorithms for the design of an elbow-type draft tube, as well as to introduce a computationally efficient optimisation workflow. The…

最优化与控制 · 数学 2024-01-18 Ante Sikirica , Ivana Lučin , Marta Alvir , Lado Kranjčević , Zoran Čarija

The activation function plays a crucial role in model optimisation, yet the optimal choice remains unclear. For example, the Sigmoid activation is the de-facto activation in balanced classification tasks, however, in imbalanced…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Konstantinos Panagiotis Alexandridis , Jiankang Deng , Anh Nguyen , Shan Luo

This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a preference such as "this is better than that" between two candidate decision…

机器学习 · 计算机科学 2019-10-01 Alberto Bemporad , Dario Piga

Surrogate models are effective tools for accelerated design of complex systems. The result of a design optimization procedure using surrogate models can be used to initialize an optimization routine using the full order system. High…

计算工程、金融与科学 · 计算机科学 2025-01-15 Anas Abdelrehim , Dhairya Gandhi , Sharan Yalburgi , Ashutosh Bharambe , Ranjan Anantharaman , Chris Rackauckas

Machine learning surrogate emulators are needed in engineering design and optimization tasks to rapidly emulate computationally expensive physics-based models. In micromechanics problems the local full-field response variables are desired…

计算工程、金融与科学 · 计算机科学 2024-05-17 Patxi Fernandez-Zelaia , Jason Mayeur , Jiahao Cheng , Yousub Lee , Kevin Knipe , Kai Kadau

Learning automatically the best activation function for the task is an active topic in neural network research. At the moment, despite promising results, it is still difficult to determine a method for learning an activation function that…

机器学习 · 计算机科学 2019-10-29 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Evolutionary illumination is a recent technique that allows producing many diverse, optimal solutions in a map of manually defined features. To support the large amount of objective function evaluations, surrogate model assistance was…

神经与进化计算 · 计算机科学 2017-03-30 Alexander Hagg