English
Related papers

Related papers: Energy-Decreasing Dynamics in Mean-Field Spin Mode…

200 papers

We report a study of the basins of attraction for potential energy minima defined by different minimisation algorithms for an atomic system. We find that whereas some minimisation algorithms produce compact basins, others produce basins…

Computational Physics · Physics 2013-10-01 Daniel Asenjo , Jacob D. Stevenson , David J. Wales , Daan Frenkel

Minimizing both power fluctuations and energy waste in an electrical grid is a central challenge to energy policy. Any discrepancy between power production and loads may lead to inefficiencies and instability in the system. Right now, the…

Systems and Control · Electrical Eng. & Systems 2024-05-20 H. Grebel

We introduce "AnnealSGD", a regularized stochastic gradient descent algorithm motivated by an analysis of the energy landscape of a particular class of deep networks with sparse random weights. The loss function of such networks can be…

Machine Learning · Computer Science 2017-04-25 Pratik Chaudhari , Stefano Soatto

As data-driven methods are deployed in real-world settings, the processes that generate the observed data will often react to the decisions of the learner. For example, a data source may have some incentive for the algorithm to provide a…

Machine Learning · Computer Science 2023-04-26 Roy Dong , Heling Zhang , Lillian J. Ratliff

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

We investigate low-energy properties of a generalized spin ladder model with both of the spin alternation and the bond alternation, which allows us to systematically study not only ladder systems but also alternating spin chains. By…

Strongly Correlated Electrons · Physics 2009-10-30 A. Koga , S. Kumada , N. Kawakami , T. Fukui

We describe a numerical study of the potential energy landscape for the two-dimensional XY model (with no disorder), considering up to 100 spins and CPU and GPU implementations of local optimization, focusing on minima and saddles of index…

Statistical Mechanics · Physics 2013-11-27 Dhagash Mehta , Ciaran Hughes , Mario Schröck , David J. Wales

A central challenge in the design of energy-efficient wind farms is the presence of wake effects between turbines. When a wind turbine harvests energy from free wind, it produces a turbulent region with reduced energy for downstream…

Optimization and Control · Mathematics 2025-12-24 James Kotary , Natalie Isenberg , Draguna Vrabie

Bayesian Reinforcement Learning (RL) is capable of not only incorporating domain knowledge, but also solving the exploration-exploitation dilemma in a natural way. As Bayesian RL is intractable except for special cases, previous work has…

Artificial Intelligence · Computer Science 2013-06-14 Kenji Kawaguchi , Mauricio Araya

Many algorithms for maximizing a monotone submodular function subject to a knapsack constraint rely on the natural greedy heuristic. We present a novel refined analysis of this greedy heuristic which enables us to: $(1)$ reduce the…

Data Structures and Algorithms · Computer Science 2021-03-16 Ariel Kulik , Roy Schwartz , Hadas Shachnai

We are developing a general framework for using learned Bayesian models for decision-theoretic control of search and reasoningalgorithms. We illustrate the approach on the specific task of controlling both general and domain-specific…

Artificial Intelligence · Computer Science 2013-01-14 Eric J. Horvitz , Yongshao Ruan , Carla P. Gomes , Henry Kautz , Bart Selman , David Maxwell Chickering

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson

Stable states in complex systems correspond to local minima on the associated potential energy surface. Transitions between these local minima govern the dynamics of such systems. Precisely determining the transition pathways in complex and…

Machine Learning · Computer Science 2024-10-25 Adittya Pal

We study how a Reinforcement Learning (RL) system can remain sample-efficient when learning from an imperfect model of the environment. This is particularly challenging when the learning system is resource-constrained and in continual…

Machine Learning · Computer Science 2024-07-01 Bradley Burega , John D. Martin , Luke Kapeluck , Michael Bowling

We consider learning a convex combination of basis models, and present some new theoretical and empirical results that demonstrate the effectiveness of a greedy approach. Theoretically, we first consider whether we can use linear, instead…

Machine Learning · Computer Science 2020-05-05 Tan Nguyen , Nan Ye , Peter L. Bartlett

This paper studies the problem of expected loss minimization given a data distribution that is dependent on the decision-maker's action and evolves dynamically in time according to a geometric decay process. Novel algorithms for both the…

Optimization and Control · Mathematics 2022-04-19 Mitas Ray , Dmitriy Drusvyatskiy , Maryam Fazel , Lillian J. Ratliff

The study of greedy approximation in the context of convex optimization is becoming a promising research direction as greedy algorithms are actively being employed to construct sparse minimizers for convex functions with respect to given…

Numerical Analysis · Mathematics 2022-04-26 Anton Dereventsov , Vladimir Temlyakov

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

The increasing deployment of wearable sensors and implantable devices is shifting AI processing demands to the extreme edge, necessitating ultra-low power for continuous operation. Inspired by the brain, emerging memristive devices promise…

Many engineering processes can be accurately modelled using partial differential equations (PDEs), but high dimensionality and non-convexity of the resulting systems pose limitations on their efficient optimisation. In this work, a model…

Optimization and Control · Mathematics 2024-10-17 Min Tao , Panagiotis Petsagkourakis , Jie Li , Constantinos Theodoropoulos