English
Related papers

Related papers: Exploring simplicity bias in 1D dynamical systems

200 papers

The distributional simplicity bias (DSB) posits that neural networks learn low-order moments of the data distribution first, before moving on to higher-order correlations. In this work, we present compelling new evidence for the DSB by…

Machine Learning · Computer Science 2024-10-10 Nora Belrose , Quintin Pope , Lucia Quirke , Alex Mallen , Xiaoli Fern

In the open map approach to bisimilarity, the paths and their runs in a given state-based system are the first-class citizens, and bisimilarity becomes a derived notion. While open maps were successfully used to model bisimilarity in…

Logic in Computer Science · Computer Science 2023-01-18 Jérémy Dubut , Thorsten Wißmann

We consider the asymptotic consistency of maximum likelihood parameter estimation for dynamical systems observed with noise. Under suitable conditions on the dynamical systems and the observations, we show that maximum likelihood parameter…

Statistics Theory · Mathematics 2014-12-01 Kevin McGoff , Sayan Mukherjee , Andrew Nobel , Natesh Pillai

Physical systems behave according to their underlying dynamical equations which, in turn, can be identified from experimental data. Explaining data requires selecting mathematical models that best capture the data regularities. Identifying…

Data Analysis, Statistics and Probability · Physics 2014-03-18 Carlo Cafaro

The problem of the insensitivity of the macroscopic behavior of any thermodynamical system to partitioning generates a bias between the reproducibility of its macroscopic behavior viewed as the simplest form of causality and its long-term…

General Physics · Physics 2007-05-23 Maria K. Koleva

Simplicity bias, the propensity of deep models to over-rely on simple features, has been identified as a potential reason for limited out-of-distribution generalization of neural networks (Shah et al., 2020). Despite the important…

Machine Learning · Statistics 2024-11-08 Nikita Tsoy , Nikola Konstantinov

We study the fractional maps of complex order, $\alpha_0e^{i r \pi/2}$ for $0<\alpha_0<1$ and $0\le r<1$ in 1 and 2 dimensions. In two dimensions, we study H{\'e}non and Lozi map and in $1d$, we study logistic, tent, Gauss, circle, and…

Chaotic Dynamics · Physics 2022-11-23 Divya D Joshi , Prashant M Gade , Sachin Bhalekar

Although it is unambiguously agreed that structure plays a fundamental role in shaping the dynamics of complex systems, this intricate relationship still remains unclear. We investigate a general computational transformation by which we can…

Disordered Systems and Neural Networks · Physics 2015-05-13 Jie Zhang , Changsong Zhou , Xiaoke Xu , Michael Small

In settings ranging from weather forecasts to political prognostications to financial projections, probability estimates of future binary outcomes often evolve over time. For example, the estimated likelihood of rain on a specific day…

Machine Learning · Computer Science 2021-11-05 Zhiyuan Jerry Lin , Hao Sheng , Sharad Goel

Various hypotheses exist about the paths used for communication between the nodes of complex networks. Most studies simply suppose that communication goes via shortest paths, while others have more explicit assumptions about how routing…

Differential equations are a ubiquitous tool to study dynamics, ranging from physical systems to complex systems, where a large number of agents interact through a graph with non-trivial topological features. Data-driven approximations of…

Statistical Mechanics · Physics 2024-04-26 Vaiva Vasiliauskaite , Nino Antulov-Fantulin

The dynamics of one dimensional iterative maps in the regime of fully developed chaos is studied in detail. Motivated by the observation of dynamical structures around the unstable fixed point we introduce the geometrical concept of a…

chao-dyn · Physics 2015-06-24 P. Schmelcher , F. K. Diakonos

Building agents that can explore their environments intelligently is a challenging open problem. In this paper, we make a step towards understanding how a hierarchical design of the agent's policy can affect its exploration capabilities.…

Machine Learning · Computer Science 2018-11-19 Maruan Al-Shedivat , Lisa Lee , Ruslan Salakhutdinov , Eric Xing

This note aims to bring attention to a simple class of discrete dynamical systems exhibiting some complex behaviour. Each of these systems is defined as a self-mapping of the unit square and is obtained by coupling two families of…

Dynamical Systems · Mathematics 2012-01-20 Chris Preston

We characterise the evolution of a dynamical system by combining two well-known complex systems' tools, namely, symbolic ordinal analysis and networks. From the ordinal representation of a time-series we construct a network in which every…

A principled approach to cyclicality and intransitivity in paired comparison data is developed. The proposed methodology enables more precise estimation of the underlying preference profile and facilitates the identification of all cyclic…

Methodology · Statistics 2025-10-08 Rahul Singh , Ori Davidov

Regression problems assume every instance is annotated (labeled) with a real value, a form of annotation we call \emph{strong guidance}. In order for these annotations to be accurate, they must be the result of a precise experiment or…

Machine Learning · Computer Science 2018-04-06 Aubrey Gress , Ian Davidson

Not all approximations arise from information systems. The problem of fitting approximations, subjected to some rules (and related data), to information systems in a rough scheme of things is known as the \emph{inverse problem}. The inverse…

Logic · Mathematics 2017-04-19 A. Mani

Nearly all nontrivial real-world systems are nonlinear dynamical systems. Chaos describes certain nonlinear dynamical systems that have a very sensitive dependence on initial conditions. Chaotic systems are always deterministic and may be…

Chaotic Dynamics · Physics 2016-11-16 Geoff Boeing

The famous Bernoulli shift (or dyadic transformation) is perhaps the simplest deterministic dynamical system exhibiting chaotic dynamics. It is a piecewise linear time-discrete map on the unit interval with a uniform slope larger than one,…

Chaotic Dynamics · Physics 2024-04-30 Jin Yan , Moitrish Majumdar , Stefano Ruffo , Yuzuru Sato , Christian Beck , Rainer Klages