English
Related papers

Related papers: Applications of Random Matrix Theory in Machine Le…

200 papers

Neurodegenerative diseases are frequently associated with structural changes in the brain. Magnetic Resonance Imaging (MRI) scans can show these variations and therefore be used as a supportive feature for a number of neurodegenerative…

Autism spectrum disorder (ASD) affects the brain connectivity at different levels. Nonetheless, non-invasively distinguishing such effects using magnetic resonance imaging (MRI) remains very challenging to machine learning diagnostic…

Machine Learning · Computer Science 2020-04-29 Ismail Bilgen , Goktug Guvercin , Islem Rekik

Functional neuroimaging measures how the brain responds to complex stimuli. However, sample sizes are modest, noise is substantial, and stimuli are high dimensional. Hence, direct estimates are inherently imprecise and call for…

Applications · Statistics 2016-02-05 Leila Wehbe , Aaditya Ramdas , Rebecca C. Steorts , Cosma Rohilla Shalizi

In specific motifs of three recurrently connected neurons with probabilistic response, the spontaneous information flux, defined as the mutual information between subsequent states, has been shown to increase by adding ongoing white noise…

Neurons and Cognition · Quantitative Biology 2024-08-13 Claus Metzner , Achim Schilling , Andreas Maier , Patrick Krauss

Deep neural networks have been successfully applied to a broad range of problems where overparametrization yields weight matrices which are partially random. A comparison of weight matrix singular vectors to the Porter-Thomas distribution…

Disordered Systems and Neural Networks · Physics 2024-01-22 Max Staats , Matthias Thamm , Bernd Rosenow

Rapidly-exploring Random Tree (RRT) algorithms have been applied successfully to challenging robot motion planning and under-actuated nonlinear control problems. However a fundamental limitation of the RRT approach is the slow convergence…

Robotics · Computer Science 2024-11-04 Mathew Mithra Noel , Akshay Chawla

We present new, original and alternative method for searching signals coded in noisy data. The method is based on the properties of random matrix eigenvalue spectra. First, we describe general ideas and support them with results of…

Data Analysis, Statistics and Probability · Physics 2015-05-28 D. Grech , J. Miskiewicz

We present a novel approach to automatically segment magnetic resonance (MR) images of the human brain into anatomical regions. Our methodology is based on a deep artificial neural network that assigns each voxel in an MR image of the brain…

Computer Vision and Pattern Recognition · Computer Science 2015-06-26 Alexandre de Brebisson , Giovanni Montana

The use of machine learning (ML) algorithms has significantly increased in neuroscience. However, from the vast extent of possible ML algorithms, which one is the optimal model to predict the target variable? What are the hyperparameters…

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

In this work, we present some applications of random matrix theory for the training of deep neural networks. Recently, random matrix theory (RMT) has been applied to the overfitting problem in deep learning. Specifically, it has been shown…

Machine Learning · Computer Science 2023-03-17 Yitzchak Shmalo , Jonathan Jenkins , Oleksii Krupchytskyi

Recovering the T2 distribution from multi-echo T2 magnetic resonance (MR) signals is challenging but has high potential as it provides biomarkers characterizing the tissue micro-structure, such as the myelin water fraction (MWF). In this…

Modern technologies are producing datasets with complex intrinsic structures, and they can be naturally represented as matrices instead of vectors. To preserve the latent data structures during processing, modern regression approaches…

Machine Learning · Computer Science 2016-11-16 Hang Zhang , Fengyuan Zhu , Shixin Li

Resting state functional MRI (rs-fMRI) is a widespread and powerful tool for investigating functional connectivity and brain disorders. However, functional connectivity analysis can be seriously affected by random and structured noise from…

Neurons and Cognition · Quantitative Biology 2021-04-01 Yujian Diao , Ting Yin , Rolf Gruetter , Ileana O. Jelescu

Randomized algorithms for very large matrix problems have received a great deal of attention in recent years. Much of this work was motivated by problems in large-scale data analysis, and this work was performed by individuals from many…

Data Structures and Algorithms · Computer Science 2011-11-16 Michael W. Mahoney

Resting-state functional magnetic resonance imaging (rs-fMRI) is a noninvasive technique pivotal for understanding human neural mechanisms of intricate cognitive processes. Most rs-fMRI studies compute a single static functional…

Neurons and Cognition · Quantitative Biology 2025-02-25 Bishal Thapaliya , Robyn Miller , Jiayu Chen , Yu-Ping Wang , Esra Akbas , Ram Sapkota , Bhaskar Ray , Pranav Suresh , Santosh Ghimire , Vince Calhoun , Jingyu Liu

Aim: To review how machine learning (ML) is applied to imaging biomarkers in neuro-oncology, in particular for diagnosis, prognosis, and treatment response monitoring. Materials and Methods: The PubMed and MEDLINE databases were searched…

Quantitative Methods · Quantitative Biology 2019-10-17 Thomas Booth , Matthew Williams , Aysha Luis , Jorge Cardoso , Ashkan Keyoumars , Haris Shuaib

Functional magnetic resonance imaging (fMRI) is one of the most popular methods for studying the human brain. Task-related fMRI data processing aims to determine which brain areas are activated when a specific task is performed and is…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Paris A. Karakasis , Athanasios P. Liavas , Nicholas D. Sidiropoulos , Panagiotis G. Simos , Efrosini Papadaki

It is described how one comes to the Wigner-Dyson random matrix theory (RMT) starting from a model of a disordered metal. The lectures start with a historical introduction where basic ideas of the RMT and theory of disordered metals are…

Mesoscale and Nanoscale Physics · Physics 2007-05-23 K. B. Efetov

Catastrophic forgetting in neural networks is a significant problem for continual learning. A majority of the current methods replay previous data during training, which violates the constraints of an ideal continual learning system.…

Machine Learning · Computer Science 2021-02-24 Prakhar Kaushik , Alex Gain , Adam Kortylewski , Alan Yuille