English
Related papers

Related papers: Emergent Higher-Order Structure from Fast Adaptive…

200 papers

Tensor network methods are powerful tools for studying quantum many-body systems. In this paper, we investigate the emergent statistical properties of random high-dimensional tensor-network states and the trainability of variational tensor…

Quantum Physics · Physics 2023-05-23 Zidu Liu , Qi Ye , Li-Wei Yu , L. -M. Duan , Dong-Ling Deng

Real networks often grow through the sequential addition of new nodes that connect to older ones in the graph. However, many real systems evolve through the branching of fundamental units, whether those be scientific fields, countries, or…

Physics and Society · Physics 2020-06-30 Muhua Zheng , Guillermo García-Pérez , Marián Boguñá , M. Ángeles Serrano

We introduce Parseval networks, a form of deep neural networks in which the Lipschitz constant of linear, convolutional and aggregation layers is constrained to be smaller than 1. Parseval networks are empirically and theoretically…

Machine Learning · Statistics 2017-08-08 Moustapha Cisse , Piotr Bojanowski , Edouard Grave , Yann Dauphin , Nicolas Usunier

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

Recurrent Neural Networks excel at predicting and generating complex high-dimensional temporal patterns. Due to their inherent nonlinear dynamics and memory, they can learn unbounded temporal dependencies from data. In a Machine Learning…

Machine Learning · Computer Science 2024-05-14 Guillaume Pourcel , Mirko Goldmann , Ingo Fischer , Miguel C. Soriano

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We have evaluated perturbation coefficients of Wilson loops up to $O(g^8)$ for the four-dimensional twisted Eguchi-Kawai model using the numerical stochastic perturbation theory (NSPT) in arXiv:1902.09847. In this talk we present a progress…

High Energy Physics - Lattice · Physics 2020-01-10 Antonio González-Arroyo , Issaku Kanamori , Ken-Ichi Ishikawa , Kanata Miyahana , Masanori Okawa , Ryoichiro Ueno

Adaptive networks change their connectivity with time, depending on their dynamical state. While synchronization in structurally static networks has been studied extensively, this problem is much more challenging for adaptive networks. In…

Adaptation and Self-Organizing Systems · Physics 2021-01-20 Rico Berner , Simon Vock , Eckehard Schöll , Serhiy Yanchuk

Spanning tree problems with specialized constraints can be difficult to solve in real-world scenarios, often requiring intricate algorithmic design and exponential time. Recently, there has been growing interest in end-to-end deep neural…

Machine Learning · Computer Science 2023-06-13 Yuchen Shi , Congying Han , Tiande Guo

Shallow free surface flows are often characterized by both subdomains that require high modeling complexity and subdomains that can be sufficiently accurately modeled with low modeling complexity. Moreover, these subdomains may change in…

Fluid Dynamics · Physics 2025-11-04 Rik Verbiest , Julian Koellermeier

Co-evolutionary adaptive mechanisms are not only ubiquitous in nature, but also beneficial for the functioning of a variety of systems. We here consider an adaptive network of oscillators with a stochastic, fitness-based, rule of…

Physics and Society · Physics 2016-06-08 Young-Ho Eom , Stefano Boccaletti , Guido Caldarelli

Higher order networks are able to characterize data as different as functional brain networks, protein interaction networks and social networks beyond the framework of pairwise interactions. Most notably higher order networks include…

Disordered Systems and Neural Networks · Physics 2018-11-26 Daan Mulder , Ginestra Bianconi

Elastic structures can be designed to exhibit precise, complex, and exotic functions. While recent work has focused on the quasistatic limit governed by force balance, the mechanics at a finite driving rate are governed by Newton's…

Soft Condensed Matter · Physics 2024-12-17 Marc Berneman , Daniel Hexner

For smooth random dynamical systems we consider the quenched linear and higher-order response of equivariant physical measures to perturbations of the random dynamics. We show that the spectral perturbation theory of Gou\"ezel, Keller, and…

Dynamical Systems · Mathematics 2021-05-25 Harry Crimmins , Yushi Nakano

We study shortest paths and spanning trees of complex networks with random edge weights. Edges which do not belong to the spanning tree are inactive in a transport process within the network. The introduction of quenched disorder modifies…

Statistical Mechanics · Physics 2009-11-07 Jae Dong Noh , Heiko Rieger

We analyze the performance of graph neural network (GNN) architectures from the perspective of random graph theory. Our approach promises to complement existing lenses on GNN analysis, such as combinatorial expressive power and worst-case…

Machine Learning · Computer Science 2023-10-12 Drake Brown , Trevor Garrity , Kaden Parker , Jason Oliphant , Stone Carson , Cole Hanson , Zachary Boyd

We analyze the interplay of synchronization and structure evolution in an evolving network of phase oscillators. An initially random network is adaptively rewired according to the dynamical coherence of the oscillators, in order to enhance…

Statistical Mechanics · Physics 2007-09-27 Pablo M. Gleiser , Damián H. Zanette

This paper provides an algorithmic framework for obtaining fast distributed algorithms for a highly-dynamic setting, in which *arbitrarily many* edge changes may occur in each round. Our algorithm significantly improves upon prior work in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-13 Keren Censor-Hillel , Neta Dafni , Victor I. Kolobov , Ami Paz , Gregory Schwartzman

Several complex systems can be modeled as large networks in which the state of the nodes continuously evolves through interactions among neighboring nodes, forming a high-dimensional nonlinear dynamical system. One of the main challenges of…

Adaptation and Self-Organizing Systems · Physics 2020-11-18 Vincent Thibeault , Guillaume St-Onge , Louis J. Dubé , Patrick Desrosiers