English
Related papers

Related papers: Simplicity bias, algorithmic probability, and the …

200 papers

The logistic regression estimator is known to inflate the magnitude of its coefficients if the sample size $n$ is small, the dimension $p$ is (moderately) large or the signal-to-noise ratio $1/\sigma$ is large (probabilities of observing a…

Statistics Theory · Mathematics 2024-03-01 Felix Kuchelmeister , Sara van de Geer

Recently we have presented the analytical relationship between choice probabilities, noise correlations and read-out weights in the classical feedforward decision-making framework (Haefner et al. 2013). The derivation assumed that…

Neurons and Cognition · Quantitative Biology 2015-01-15 Ralf M. Haefner

We investigate the complexity of logistic regression models which is defined by counting the number of indistinguishable distributions that the model can represent (Balasubramanian, 1997). We find that the complexity of logistic models with…

Machine Learning · Statistics 2019-03-04 Nicola Bulso , Matteo Marsili , Yasser Roudi

We study the effect that the injection of a common source of noise has on the trajectories of chaotic systems, addressing some contradictory results present in the literature. We present particular examples of 1-d maps and the Lorenz…

Chaotic Dynamics · Physics 2009-11-07 Raul Toral , Claudio R. Mirasso , Emilio Hernandez-Garcia , Oreste Piro

Although noise-based logic shows potential advantages of reduced power dissipation and the ability of large parallel operations with low hardware and time complexity the question still persist: is randomness really needed out of…

Other Computer Science · Computer Science 2013-01-07 He Wen , Laszlo B. Kish

Berliner (Likelihood and Bayesian prediction for chaotic systems, J. Am. Stat. Assoc. 1991) identified a number of difficulties in using the likelihood function within the Bayesian paradigm which arise both for state estimation and for…

Data Analysis, Statistics and Probability · Physics 2016-12-30 Hailiang Du , Leonard A. Smith

It is a long-standing objective to ease the computation burden incurred by the decision making process. Identification of this mechanism's sensitivity to simplification has tremendous ramifications. Yet, algorithms for decision making under…

Artificial Intelligence · Computer Science 2021-05-13 Andrey Zhitnikov , Vadim Indelman

The human mind is known to be sensitive to complexity. For instance, the visual system reconstructs hidden parts of objects following a principle of maximum simplicity. We suggest here that higher cognitive processes, such as the selection…

Artificial Intelligence · Computer Science 2012-08-10 Jean-Louis Dessalles

Natural selection explains how life has evolved over millions of years from more primitive forms. The speed at which this happens, however, has sometimes defied formal explanations when based on random (uniformly distributed) mutations.…

Neural and Evolutionary Computing · Computer Science 2018-06-22 Santiago Hernández-Orozco , Narsis A. Kiani , Hector Zenil

Noise-induced phenomena in high-dimensional dynamical systems were investigated from a random dynamical systems point of view. In a class of generalized H\'enon maps, which are randomly perturbed delayed logistic maps, with monotonically…

Chaotic Dynamics · Physics 2024-09-05 Huayan Chen , Yuzuru Sato

Logistic regression is a well-known statistical model which is commonly used in the situation where the output is a binary random variable. It has a wide range of applications including machine learning, public health, social sciences,…

Statistics Theory · Mathematics 2019-04-18 Bernard Bercu , Antoine Godichon-Baggioni , Bruno Portier

Chaotic behavior arises from very simple non-linear dynamical equation of logistic map which makes it was used often in designing chaotic image encryption schemes. However, some properties of chaotic maps can also facilitate cryptanalysis…

Cryptography and Security · Computer Science 2016-10-14 Chengqing Li , Tao Xie , Qi Liu , Ge Cheng

Discussions of algorithmic bias tend to focus on examples where either the data or the people building the algorithms are biased. This gives the impression that clean data and good intentions could eliminate bias. The neutrality of the…

Computers and Society · Computer Science 2021-05-04 Catherine Stinson

Analysis is presented of a system whose dynamics are dramatically simplified by tiny amounts of additive noise. The dynamics divide naturally into two phases. In the slower phase, trajectories are close to an invariant manifold; this allows…

adap-org · Physics 2008-02-03 G. D. Lythe

The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and…

Machine Learning · Computer Science 2022-10-11 Laurent Risser , Agustin Picard , Lucas Hervier , Jean-Michel Loubes

This study presents PRISM, a probabilistic simplex component analysis approach to identifying the vertices of a data-circumscribing simplex from data. The problem has a rich variety of applications, the most notable being hyperspectral…

Signal Processing · Electrical Eng. & Systems 2022-02-16 Ruiyuan Wu , Wing-Kin Ma , Yuening Li , Anthony Man-Cho So , Nicholas D. Sidiropoulos

An increased awareness concerning risks of algorithmic bias has driven a surge of efforts around bias mitigation strategies. A vast majority of the proposed approaches fall under one of two categories: (1) imposing algorithmic fairness…

Machine Learning · Computer Science 2023-07-11 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

Multiplicative noise arises in inverse problems when, for example, uncertainty on measurements is proportional to the size of the measurement itself. The likelihood that arises is hence more complicated than that from additive noise. We…

Statistics Theory · Mathematics 2019-11-01 Matthew M. Dunlop

Idiosyncratic tendency to choose one alternative over others in the absence of an identified reason, is a common observation in two-alternative forced-choice experiments. It is tempting to account for it as resulting from the (unknown)…

Neurons and Cognition · Quantitative Biology 2018-03-21 Lior Lebovich , Ran Darshan , Yoni Lavi , David Hansel , Yonatan Loewenstein

Dynamic networks are interconnected dynamic systems with measured node signals and dynamic modules reflecting the links between the nodes. We address the problem of \red{identifying a dynamic network with known topology, on the basis of…

Systems and Control · Computer Science 2018-10-02 Harm H. M. Weerts , Paul M. J. Van den Hof , Arne G. Dankers