English
Related papers

Related papers: Gradient-free neural topology optimization: Toward…

200 papers

Gradient porous structured materials possess significant potential of being applied in many engineering fields. To accelerate the design process of infill graded microstructures, a novel asymptotic homogenisation topology optimisation…

Computational Engineering, Finance, and Science · Computer Science 2019-12-18 Dingchuan Xue , Yichao Zhu , Shaoshuai Li , Chang Liu , Weisheng Zhang , Xu Guo

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

We suggest simple modifications of the conditional gradient method for smooth optimization problems, which maintain the basic convergence properties, but reduce the implementation cost of each iteration essentially. Namely, we propose the…

Optimization and Control · Mathematics 2018-01-17 Igor Konnov

This paper studies non-smooth problems of convex stochastic optimization. Using the smoothing technique based on the replacement of the function value at the considered point by the averaged function value over a ball (in $l_1$-norm or…

Optimization and Control · Mathematics 2023-05-23 Aleksandr Lobanov , Belal Alashqar , Darina Dvinskikh , Alexander Gasnikov

Automating parts of the user interface (UI) design process has been a longstanding challenge. We present an automated technique for optimizing the layouts of mobile UIs. Our method uses gradient descent on a neural network model of task…

Human-Computer Interaction · Computer Science 2020-02-26 Peitong Duan , Casimir Wierzynski , Lama Nachman

Motion planning is a key aspect of robotics. A common approach to address motion planning problems is trajectory optimization. Trajectory optimization can represent the high-level behaviors of robots through mathematical formulations.…

Robotics · Computer Science 2024-08-21 Fatemeh Rastgar

Nonlinear optimal control problems for trajectory planning with obstacle avoidance present several challenges. While general-purpose optimizers and dynamic programming methods struggle when adopted separately, their combination enabled by a…

Optimization and Control · Mathematics 2024-08-09 Rebecca Richter , Alberto De Marchi , Matthias Gerdts

Generative design refers to computational design methods that can automatically conduct design exploration under constraints defined by designers. Among many approaches, topology optimization-based generative designs aim to explore diverse…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Seowoo Jang , Soyoung Yoo , Namwoo Kang

Gradient-based optimization drives the unprecedented performance of modern deep neural network models across diverse applications. Adaptive algorithms have accelerated neural network training due to their rapid convergence rates; however,…

Machine Learning · Computer Science 2025-05-06 Chia-Wei Hsu , Nien-Ti Tsou , Yu-Cheng Chen , Yang Jeong Park , Ju Li

Structured pruning is an effective approach for compressing large pre-trained neural networks without significantly affecting their performance. However, most current structured pruning methods do not provide any performance guarantees, and…

Machine Learning · Computer Science 2023-02-14 Marwa El Halabi , Suraj Srinivas , Simon Lacoste-Julien

We propose an optimization proxy in terms of iterative implicit gradient methods for solving constrained optimization problems with nonconvex loss functions. This framework can be applied to a broad range of machine learning settings,…

Optimization and Control · Mathematics 2025-10-14 Harshal D. Kaushik , Ming Jin

Topology optimization problems often support multiple local minima due to a lack of convexity. Typically, gradient-based techniques combined with continuation in model parameters are used to promote convergence to more optimal solutions;…

Numerical Analysis · Mathematics 2021-01-13 Ioannis P. A. Papadopoulos , Patrick E. Farrell , Thomas M. Surowiec

Dealing with planning problems with both logical relations and numeric changes in real-world dynamic environments is challenging. Existing numeric planning systems for the problem often discretize numeric variables or impose convex…

Artificial Intelligence · Computer Science 2022-10-11 Kebing Jin , Hankz Hankui Zhuo , Zhanhao Xiao , Hai Wan , Subbarao Kambhampati

We propose new sequential simulation-optimization algorithms for general convex optimization via simulation problems with high-dimensional discrete decision space. The performance of each choice of discrete decision variables is evaluated…

Optimization and Control · Mathematics 2022-02-15 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

Many combinatorial optimization problems can be phrased in the language of constraint satisfaction problems. We introduce a graph neural network architecture for solving such optimization problems. The architecture is generic; it works for…

Artificial Intelligence · Computer Science 2020-02-12 Jan Toenshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

Iterative optimization is central to modern artificial intelligence (AI) and provides a crucial framework for understanding adaptive systems. This review provides a unified perspective on this subject, bridging classic theory with neural…

Machine Learning · Computer Science 2025-10-22 Jesús García Fernández , Nasir Ahmad , Marcel van Gerven

In this research, we propose a deep learning based approach for speeding up the topology optimization methods. The problem we seek to solve is the layout problem. The main novelty of this work is to state the problem as an image…

Machine Learning · Computer Science 2017-09-28 Ivan Sosnovik , Ivan Oseledets

Algorithmic reproducibility measures the deviation in outputs of machine learning algorithms upon minor changes in the training process. Previous work suggests that first-order methods would need to trade-off convergence rate (gradient…

Machine Learning · Computer Science 2024-01-11 Liang Zhang , Junchi Yang , Amin Karbasi , Niao He

The design of fluid channel structures of reactors or separators of chemical processes is key to enhancing the mass transfer processes inside the devices. However, the systematic design of channel topological structures is difficult for…

Fluid Dynamics · Physics 2025-03-07 Chenhui Kou , Yuhui Yin , Min Zhu , Shengkun Jia , Yiqing Luo , Xigang Yuana , Lu Lu

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin