English
Related papers

Related papers: The Curse of Instability

200 papers

Here we briefly reflect on the philosophical foundations that ground the quest towards ever-detailed models and identify four practical dangers derived from this pursuit: explosion of the model's uncertainty space, model black-boxing,…

General Literature · Computer Science 2022-11-01 Arnald Puy , Andrea Saltelli

According to the Hughes phenomenon, the major challenges encountered in computations with learning models comes from the scale of complexity, e.g. the so-called curse of dimensionality. There are various approaches for accelerate learning…

Machine Learning · Computer Science 2024-10-15 Luisa D'Amore

Although learning in high dimensions is commonly believed to suffer from the curse of dimensionality, modern machine learning methods often exhibit an astonishing power to tackle a wide range of challenging real-world learning problems…

Machine Learning · Computer Science 2022-07-12 Lechao Xiao , Jeffrey Pennington

One might think that, once we know something is computable, how efficiently it can be computed is a practical question with little further philosophical importance. In this essay, I offer a detailed case that one would be wrong. In…

Computational Complexity · Computer Science 2024-05-11 Scott Aaronson

This work investigates the optimization instability of deep neural networks from a less-explored yet insightful perspective: the emergence and amplification of singularities in the parametric space. Our analysis reveals that parametric…

Technological innovations have revolutionized the process of scientific research and knowledge discovery. The availability of massive data and challenges from frontiers of research and development have reshaped statistical thinking, data…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Runze Li

The curse of dimensionality poses a significant challenge to modern multilayer perceptron-based architectures, often causing performance stagnation and scalability issues. Addressing this limitation typically requires vast amounts of data.…

Machine Learning · Computer Science 2024-11-19 Divesh Basina , Joseph Raj Vishal , Aarya Choudhary , Bharatesh Chakravarthi

Gradually growing the depth of Transformers during training can not only reduce training cost but also lead to improved reasoning performance, as shown by MIDAS (Saunshi et al., 2024). Thus far, however, a mechanistic understanding of these…

Computation and Language · Computer Science 2025-12-10 Ferdinand Kapl , Emmanouil Angelis , Tobias Höppe , Kaitlin Maile , Johannes von Oswald , Nino Scherrer , Stefan Bauer

We propose an axiomatic approach to the concept of an intrinsic dimension of a dataset, based on a viewpoint of geometry of high-dimensional structures. Our first axiom postulates that high values of dimension be indicative of the presence…

Machine Learning · Computer Science 2016-11-17 Vladimir Pestov

The classical simulation of physical processes using standard models of computation is fraught with problems. On the other hand, attempts at modelling real-world computation with the aim of isolating its hypercomputational content have…

Logic · Mathematics 2009-04-21 S. Barry Cooper

After a brief review of current scenarios for the resolution and/or avoidance of the Big Bang, an alternative hypothesis is put forward implying an infinite increase in complexity towards the initial singularity. This may result in an…

General Relativity and Quantum Cosmology · Physics 2021-09-22 Hermann Nicolai

In the present paper a behavior of the "average case" approximation complexity for d-parametric random fields of tensor-type is studied. It was shown in [Lifshits and Tulyakova, 2006] that for a given approximation accuracy level the…

Probability · Mathematics 2012-08-16 N. A. Serdyukova

Compositionality is a key strategy for addressing combinatorial complexity and the curse of dimensionality. Recent work has shown that compositional solutions can be learned and offer substantial gains across a variety of domains, including…

Machine Learning · Computer Science 2019-04-30 Clemens Rosenbaum , Ignacio Cases , Matthew Riemer , Tim Klinger

We perform a deeper analysis of an axiomatic approach to the concept of intrinsic dimension of a dataset proposed by us in the IJCNN'07 paper (arXiv:cs/0703125). The main features of our approach are that a high intrinsic dimension of a…

Information Retrieval · Computer Science 2009-11-17 Vladimir Pestov

The article discusses the controversy over infinite growth. It analyzes the two dominant perspectives on economic growth and finds them based on a limited and subjective view of reality. An examination of the principal aspects of economic…

General Economics · Economics 2022-01-25 Gennady Shkliarevsky

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

Auto-regressive large language models (LLMs) show impressive capacities to solve many complex reasoning tasks while struggling with some simple logical reasoning tasks such as inverse search: when trained on '$A \to B$' (e.g., 'Tom is the…

Machine Learning · Computer Science 2024-10-29 Hanlin Zhu , Baihe Huang , Shaolun Zhang , Michael Jordan , Jiantao Jiao , Yuandong Tian , Stuart Russell

A probability model exhibits instability if small changes in a data outcome result in large, and often unanticipated, changes in probability. This instability is a property of the probability model, given by a distributional form and a…

Statistics Theory · Mathematics 2019-11-18 Andee Kaplan , Daniel Nordman , Stephen Vardeman

Constraint propagation is one of the techniques central to the success of constraint programming. To reduce search, fast algorithms associated with each constraint prune the domains of variables. With global (or non-binary) constraints, the…

Artificial Intelligence · Computer Science 2009-03-09 Christian Bessiere , Emmanuel Hebrard , Brahim Hnich , Toby Walsh

The intuition that a long history is required for the emergence of complexity in natural systems is formalized using the notion of depth. The depth of a system is defined in terms of the number of parallel computational steps needed to…

Statistical Mechanics · Physics 2011-11-09 J. Machta