English
Related papers

Related papers: Economic Accelerator with Memory: Discrete Time Ap…

200 papers

The concept of memory is of central importance for characterizing complex systems and phenomena. Presence of long-term memories indicates how their dynamics can be less sensitive to initial conditions compared to the chaotic cases. On the…

Geophysics · Physics 2023-07-11 Sumiyoshi Abe , Norikazu Suzuki

In a discrete-time financial market model with instantaneous price impact, we find an asymptotically optimal strategy for an investor maximizing her expected wealth. The asset price is assumed to follow a process with negative memory. We…

Probability · Mathematics 2021-04-27 Miklós Rásonyi , Lóránt Nagy

Previous papers have proposed to add memory registers to the dynamics of discrete-time linear systems in order to accelerate their convergence. In particular, it has been proved that adding one memory slot per agent allows faster…

Optimization and Control · Mathematics 2015-10-12 Alain Sarlette

Accelerated gradient methods have had significant impact in machine learning -- in particular the theoretical side of machine learning -- due to their ability to achieve oracle lower bounds. But their heuristic construction has hindered…

Computation · Statistics 2018-02-16 Michael Betancourt , Michael I. Jordan , Ashia C. Wilson

This paper studies a discrete-time mean-variance model based on reinforcement learning. Compared with its continuous-time counterpart in \cite{zhou2020mv}, the discrete-time model makes more general assumptions about the asset's return…

Mathematical Finance · Quantitative Finance 2023-12-27 Xiangyu Cui , Xun Li , Yun Shi , Si Zhao

Continuous time models in the theory of real options give explicit formulas for optimal exercise strategies when options are simple and the price of an underlying asset follows a geometric Brownian motion. This paper suggests a general,…

Other Condensed Matter · Physics 2008-12-02 Svetlana Boyarchenko , Sergei Levendorskii

Many reinforcement learning algorithms are built on an assumption that an agent interacts with an environment over fixed-duration, discrete time steps. However, physical systems are continuous in time, requiring a choice of…

Machine Learning · Computer Science 2024-09-04 Kris De Asis , Richard S. Sutton

We study stochastic motion planning problems which involve a controlled process, with possibly discontinuous sample paths, visiting certain subsets of the state-space while avoiding others in a sequential fashion. For this purpose, we first…

Optimization and Control · Mathematics 2017-11-27 Peyman Mohajerin Esfahani , Debasish Chatterjee , John Lygeros

We present a probabilistic model with discrete latent variables that control the computation time in deep learning models such as ResNets and LSTMs. A prior on the latent variables expresses the preference for faster computation. The amount…

Machine Learning · Computer Science 2017-12-04 Michael Figurnov , Artem Sobolev , Dmitry Vetrov

Optimizing problems in a distributed manner is critical for systems involving multiple agents with private data. Despite substantial interest, a unified method for analyzing the convergence rates of distributed optimization algorithms is…

Optimization and Control · Mathematics 2024-10-01 Mayank Baranwal , Kushal Chakrabarti

A succesful method to describe the asymptotic behavior of a discrete time stochastic process governed by some recursive formula is to relate it to the limit sets of a well chosen mean differential equation. Under an attainability condition,…

Probability · Mathematics 2011-01-19 Mathieu Faure , Gregory Roth

Scientists have long aimed to discover meaningful formulae which accurately describe experimental data. A common approach is to manually create mathematical models of natural phenomena using domain knowledge, and then fit these models to…

A new approach to describing correlation properties of complex dynamic systems with long-range memory based on a concept of additive Markov chains (Phys. Rev. E 68, 061107 (2003)) is developed. An equation connecting a memory function of…

Classical Physics · Physics 2007-05-23 S. S. Melnyk , O. V. Usatenko , V. A. Yampol'skii

We discuss a dynamical systems perspective on discrete optimization. Departing from the fact that many combinatorial optimization problems can be reformulated as finding low energy spin configurations in corresponding Ising models, we…

Optimization and Control · Mathematics 2023-05-16 Tong Guanchun , Michael Muehlebach

The synapses of real neural systems seem to have delays. Therefore, it is worthwhile to analyze associative memory models with delayed synapses. Thus, a sequential associative memory model with delayed synapses is discussed, where a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Seiji Miyoshi , Hiro-Fumi Yanai , Masato Okada

We consider stochastic dynamical systems defined by differential equations with a uniform random time delay. The latter equations are shown to be equivalent to deterministic higher-order differential equations: for an $n$-th order equation…

Statistical Mechanics · Physics 2011-10-11 P. L. Krapivsky , J. M. Luck , K. Mallick

We analyze continuous-time models of accelerated gradient methods through deriving conservation laws in dilated coordinate systems. Namely, instead of analyzing the dynamics of $X(t)$, we analyze the dynamics of $W(t)=t^\alpha(X(t)-X_c)$…

Optimization and Control · Mathematics 2022-06-27 Jaewook J. Suh , Gyumin Roh , Ernest K. Ryu

High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with…

Optimization and Control · Mathematics 2021-06-08 Joseph E. Gaudio , Anuradha M. Annaswamy , José M. Moreu , Michael A. Bolender , Travis E. Gibson

We propose a new discrete-time online parameter estimation algorithm that combines two different aspects, one that adds momentum, and another that includes a time-varying learning rate. It is well known that recursive least squares based…

Optimization and Control · Mathematics 2023-03-21 Yingnan Cui , Anuradha M. Annaswamy

Flexibility at hardware level is the main driving force behind adaptive systems whose aim is to realise microarhitecture deconfiguration 'online'. This feature allows the software/hardware stack to tolerate drastic changes of the workload…

Hardware Architecture · Computer Science 2016-12-28 Ana Lava , Mahdi Jelodari Mamaghani , Siamak Mohammadi , Steve Furber