English
Related papers

Related papers: Multifractal analysis of perceptron learning with …

200 papers

In computer simulation of the learning process is usually assumed that all elements of the training material are assimilated equally durable. But in practice, the knowledge, which a student uses in its operations, are remembered much…

Computers and Society · Computer Science 2013-12-20 Robert V Mayer

Even though the brain operates in pure darkness, within the skull, it can infer the most likely causes of its sensory input. An approach to modelling this inference is to assume that the brain has a generative model of the world, which it…

Neural and Evolutionary Computing · Computer Science 2023-07-18 Mehran H. Bazargani , Szymon Urbas , Karl Friston

Cell counting is a ubiquitous, yet tedious task that would greatly benefit from automation. From basic biological questions to clinical trials, cell counts provide key quantitative feedback that drive research. Unfortunately, cell counting…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Carlos X. Hernández , Mohammad M. Sultan , Vijay S. Pande

Probabilistic clustering models (or equivalently, mixture models) are basic building blocks in countless statistical models and involve latent random variables over discrete spaces. For these models, posterior inference methods can be…

Machine Learning · Statistics 2020-06-24 Ari Pakman , Yueqi Wang , Catalin Mitelut , JinHyung Lee , Liam Paninski

A learning algorithm is presented which given the structure of a causal tree, will estimate its link probabilities by sequential measurements on the leaves only. Internal nodes of the tree represent conceptual (hidden) variables…

Artificial Intelligence · Computer Science 2013-04-12 Igor Roizer , Judea Pearl

We describe the application of tools from statistical mechanics to analyse the dynamics of various classes of supervised learning rules in perceptrons. The character of this paper is mostly that of a cross between a biased non-encyclopedic…

Disordered Systems and Neural Networks · Physics 2008-02-03 C. W. H. Mace , A. C. C. Coolen

Contemporary machine learning applications often involve classification tasks with many classes. Despite their extensive use, a precise understanding of the statistical properties and behavior of classification algorithms is still missing,…

Machine Learning · Computer Science 2020-11-17 Christos Thrampoulidis , Samet Oymak , Mahdi Soltanolkotabi

Multi-view subspace clustering aims to divide a set of multisource data into several groups according to their underlying subspace structure. Although the spectral clustering based methods achieve promotion in multi-view clustering, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Zhiqiang Lu , Hao Tang , Yan Yan , Songhao Zhu , Xiao-Yuan Jing , Zuoyong Li

We propose a novel end-to-end neural network architecture that, once trained, directly outputs a probabilistic clustering of a batch of input examples in one pass. It estimates a distribution over the number of clusters $k$, and for each $1…

Machine Learning · Computer Science 2018-07-12 Benjamin Bruno Meier , Ismail Elezi , Mohammadreza Amirian , Oliver Durr , Thilo Stadelmann

We learn about the world from a diverse range of sensory information. Automated systems lack this ability as investigation has centred on processing information presented in a single form. Adapting architectures to learn from multiple…

Machine Learning · Computer Science 2020-10-27 Jason Armitage , Shramana Thakur , Rishi Tripathi , Jens Lehmann , Maria Maleshkova

While most successful approaches for machine reading comprehension rely on single training objective, it is assumed that the encoder layer can learn great representation through the loss function we define in the predict layer, which is…

Computation and Language · Computer Science 2022-11-18 Yifeng Xie

Neural networks use their hidden layers to transform input data into linearly separable data clusters, with a linear or a perceptron type output layer making the final projection on the line perpendicular to the discriminating hyperplane.…

Machine Learning · Computer Science 2018-07-10 Wlodzislaw Duch

The creativity and emergence of biological and psychological behavior are nonlinear. However, that does not necessarily mean only that the measurements of the behaviors are curvilinear. Furthermore, the linear model might fail to reduce…

Data Analysis, Statistics and Probability · Physics 2021-05-28 Damian G. Kelty-Stephen , Elizabeth Lane , Madhur Mangalam

Despite its remarkable empirical success as a highly competitive branch of artificial intelligence, deep learning is often blamed for its widely known low interpretation and lack of firm and rigorous mathematical foundation. However, most…

Machine Learning · Computer Science 2018-10-04 Wendi Xu , Ming Zhang

We present an algorithm of clustering of many-dimensional objects, where only the distances between objects are used. Centers of classes are found with the aid of neuron-like procedure with lateral inhibition. The result of clustering does…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Leonid B. Litinskii , Dmitry E. Romanov

Clustering functional data is a challenging task due to intrinsic infinite-dimensionality and the need for stable, data-adaptive partitioning. In this work, we propose a clustering framework based on Random Projections, which simultaneously…

Methodology · Statistics 2025-12-18 Matteo Mori , Laura Anderlucci

We describe a method for utilizing the known structure of input data to make learning more efficient. Our work is in the domain of programming languages, and we use deep neural networks to do program analysis. Computer programs include a…

Neural and Evolutionary Computing · Computer Science 2019-04-01 Zehra Sura , Tong Chen , Hyojin Sung

Ensemble learning of $K$ nonlinear perceptrons, which determine their outputs by sign functions, is discussed within the framework of online learning and statistical mechanics. One purpose of statistical learning theory is to theoretically…

Disordered Systems and Neural Networks · Physics 2009-11-10 Seiji Miyoshi , Kazuyuki Hara , Masato Okada

We propose a novel approach to learning the generative neural fields represented by linear combinations of implicit basis networks. Our algorithm learns basis networks in the form of implicit neural representations and their coefficients in…

Machine Learning · Computer Science 2023-10-31 Tackgeun You , Mijeong Kim , Jungtaek Kim , Bohyung Han

One aim shared by multiple settings, such as continual learning or transfer learning, is to leverage previously acquired knowledge to converge faster on the current task. Usually this is done through fine-tuning, where an implicit…

Machine Learning · Computer Science 2023-10-17 Tudor Berariu , Wojciech Czarnecki , Soham De , Jorg Bornschein , Samuel Smith , Razvan Pascanu , Claudia Clopath