English
Related papers

Related papers: Rethinking Gradient-Based Methods: Multi-Property …

200 papers

Machine learning has the potential to accelerate materials discovery by accurately predicting materials properties at a low computational cost. However, the model inputs remain a key stumbling block. Current methods typically use…

Computational Physics · Physics 2021-01-07 Rhys E. A. Goodall , Alpha A. Lee

The identification of materials with exceptional properties is an essential objective to enable technological progress. We propose the application of \textit{Quality-Diversity} algorithms to the field of crystal structure prediction. The…

Materials Science · Physics 2024-03-07 Marta Wolinska , Aron Walsh , Antoine Cully

In multistage decision problems, it is often the case that an initial strategic decision (such as investment) is followed by many operational ones (operating the investment). Such initial strategic decision can be seen as a parameter…

Optimization and Control · Mathematics 2026-03-17 Adrien Le Franc , Pierre Carpentier , Jean-Philippe Chancelier , Michel de Lara

The development of new materials and structures for extreme conditions including impact remains a continuing challenge despite steady advances. Design is currently accomplished using a sequential approach: an optimal material is first…

Materials Science · Physics 2021-06-14 Xingsheng Sun , Burigede Liu , Kaushik Bhattacharya , Michael Ortiz

Computing atomic-scale properties of chemically disordered materials requires an efficient exploration of their vast configuration space. Traditional approaches such as Monte Carlo or Special Quasirandom Structures either entail sampling an…

Materials Science · Physics 2026-03-17 Maciej J. Karcz , Luca Messina , Eiji Kawasaki , Emeric Bourasseau

The performance of optimization methods is often tied to the spectrum of the objective Hessian. Yet, conventional assumptions, such as smoothness, do often not enable us to make finely-grained convergence statements -- particularly not for…

Optimization and Control · Mathematics 2024-02-08 Nikita Doikov , Sebastian U. Stich , Martin Jaggi

Crystalline materials are widely used in technological applications, yet their discovery remains a significant challenge. As their properties are driven by structure, crystal structure prediction (CSP) methods play a central role in…

Machine Learning · Computer Science 2026-04-28 Stavros Gerolymatos , J. Kyle Brubaker , Martin J. A. Schuetz , Vladimir V. Gusev

In structurally constrained molecular optimization, state-of-the-art methods restart an expensive oracle-driven search from scratch for every new input structure, scaling poorly to settings with many starting structures or expensive…

The Mean-Variance-Skewness-Kurtosis (MVSK) portfolio optimization model is a quartic nonconvex polynomial minimization problem over a polytope, which can be formulated as a Difference-of-Convex (DC) program. In this manuscript, we…

Optimization and Control · Mathematics 2022-05-09 Yi-Shuai Niu , Ya-Juan Wang , Hoai An Le Thi , Dinh Tao Pham

Adapting large-scale pre-trained generative models in a parameter-efficient manner is gaining traction. Traditional methods like low rank adaptation achieve parameter efficiency by imposing constraints but may not be optimal for tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Xinxi Zhang , Song Wen , Ligong Han , Felix Juefei-Xu , Akash Srivastava , Junzhou Huang , Hao Wang , Molei Tao , Dimitris N. Metaxas

Stochastic gradient methods (SGMs) have been widely used for solving stochastic optimization problems. A majority of existing works assume no constraints or easy-to-project constraints. In this paper, we consider convex stochastic…

Optimization and Control · Mathematics 2022-01-03 Yonggui Yan , Yangyang Xu

We propose a new simple variant of Fast Gradient Method that requires only one projection per iteration. We called this method Triangle Method (TM) because it has a corresponding geometric description. We generalize TM for convex and…

Optimization and Control · Mathematics 2017-11-28 Alexander Gasnikov , Yurii Nesterov

Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Andreas Themelis

The spectral gradient method is known to be a powerful low-cost tool for solving large-scale optimization problems. In this paper, our goal is to exploit its advantages in the stochastic optimization framework, especially in the case of…

Optimization and Control · Mathematics 2024-10-10 Stefania Bellavia , Nataša Krejić , Nataša Krklec Jerinkić , Marcos Raydan

We present a level-set based topology optimization algorithm for design optimization problems involving an arbitrary number of different materials, where the evolution of a design is solely guided by topological derivatives. Our method can…

Optimization and Control · Mathematics 2020-06-24 Peter Gangl

Implicit bias induced by gradient-based algorithms is essential to the generalization of overparameterized models, yet its mechanisms can be subtle. This work leverages the Normalized Steepest Descent} (NSD) framework to investigate how…

Machine Learning · Computer Science 2026-03-25 Shengping Xie , Zekun Wu , Quan Chen , Kaixu Tang

We present an optimizer which uses Bayesian optimization to tune the system parameters of distributed stochastic gradient descent (SGD). Given a specific context, our goal is to quickly find efficient configurations which appropriately…

Machine Learning · Statistics 2016-12-04 Valentin Dalibard , Michael Schaarschmidt , Eiko Yoneki

Predicting crystal structures from chemical compositions is a fundamental challenge in materials discovery, complicated by complex 3D geometries that distinguish it from fields like protein folding. Here, we present Diffusion-based Crystal…

Accelerated materials discovery is an urgent demand to drive advancements in fields such as energy conversion, storage, and catalysis. Property-directed generative design has emerged as a transformative approach for rapidly discovering new…

Molecular design based on generative models, such as variational autoencoders (VAEs), has become increasingly popular in recent years due to its efficiency for exploring high-dimensional molecular space to identify molecules with desired…

Machine Learning · Computer Science 2024-08-13 A N M Nafiz Abeer , Nathan Urban , M Ryan Weil , Francis J. Alexander , Byung-Jun Yoon