English
Related papers

Related papers: Sleep Deprivation in the Forward-Forward Algorithm

200 papers

Efficiently identifying sleep stages is crucial for unraveling the intricacies of sleep in both preclinical and clinical research. The labor-intensive nature of manual sleep scoring, demanding substantial expertise, has prompted a surge of…

Machine Learning · Computer Science 2024-12-23 Shadi Sartipi , Mie Andersen , Natalie Hauglund , Celia Kjaerby , Verena Untiet , Maiken Nedergaard , Mujdat Cetin

Recently, the influence of leakage delay on the dynamics of integer-order neural networks has been investigated extensively. It has been confirmed that fractional calculus can depict the memory and hereditary attributes of neural networks…

Dynamical Systems · Mathematics 2019-07-24 Jiazhe Lin , Rui Xu , Liangchen Li , Xiaohong Tian

Sleep is considered to play an essential role in memory reorganization. Despite its importance, classical theoretical models did not focus on some sleep characteristics. Here, we review recent theoretical approaches investigating their…

Neurons and Cognition · Quantitative Biology 2023-10-23 Kensuke Yoshida , Taro Toyoizumi

Prioritizing fairness is of central importance in artificial intelligence (AI) systems, especially for those societal applications, e.g., hiring systems should recommend applicants equally from different demographic groups, and risk…

Machine Learning · Computer Science 2022-03-04 Zhibo Wang , Xiaowei Dong , Henry Xue , Zhifei Zhang , Weifeng Chiu , Tao Wei , Kui Ren

Quantum computing is advancing rapidly, yet substantial gaps separate today's noisy intermediate-scale quantum (NISQ) devices from tomorrow's fault-tolerant application-scale quantum (FASQ) machines. We identify four related hurdles along…

Quantum Physics · Physics 2026-05-22 Jens Eisert , John Preskill

The Forward-Forward algorithm eliminates backpropagation's memory constraints and biological implausibility through dual forward passes with positive and negative data. However, conventional implementations suffer from critical inter-layer…

Machine Learning · Computer Science 2025-12-23 Salar Beigzad

We compare scaling properties of the cardiac dynamics during sleep and wake periods for healthy individuals, cosmonauts during orbital flight, and subjects with severe heart disease. For all three groups, we find a greater degree of…

The paper proposes a new algorithm called SymBa that aims to achieve more biologically plausible learning than Back-Propagation (BP). The algorithm is based on the Forward-Forward (FF) algorithm, which is a BP-free method for training…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Heung-Chang Lee , Jeonggeun Song

Algorithm research focuses primarily on how many operations processors need to do (time complexity). But for many problems, both the runtime and energy used are dominated by memory accesses. In this paper, we present the first broad survey…

Data Structures and Algorithms · Computer Science 2025-12-01 Hayden Rome , Jayson Lynch , Jeffery Li , Chirag Falor , Neil Thompson

Sleep has a profound influence on the physiology of body systems and biological processes. Molecular studies have shown circadian-regulated shifts in protein expression patterns across human tissues, further emphasizing the unique…

Quantitative Methods · Quantitative Biology 2021-02-11 Nitai Bar , Jonathan A. Sobel , Thomas Penzel , Yosi Shamay , Joachim A. Behar

The backpropagation algorithm, or backprop, is a widely utilized optimization technique in deep learning. While there's growing evidence suggesting that models trained with backprop can accurately explain neuronal data, no backprop-like…

Machine Learning · Computer Science 2024-05-28 Gananath R

This research is concerned with evolution equations and their forward-backward discretizations. Our first contribution is an estimation for the distance between iterates of sequences generated by forward-backward schemes, useful in the…

Optimization and Control · Mathematics 2019-12-16 Andres Contreras , Juan Peypouquet

Models that employ latent variables to capture structure in observed data lie at the heart of many current unsupervised learning algorithms, but exact maximum-likelihood learning for powerful and flexible latent-variable models is almost…

Machine Learning · Statistics 2020-08-18 Li K. Wenliang , Theodore Moskovitz , Heishiro Kanagawa , Maneesh Sahani

We show that the influence of a subset of the training samples can be removed -- or "forgotten" -- from the weights of a network trained on large-scale image classification tasks, and we provide strong computable bounds on the amount of…

Machine Learning · Computer Science 2021-06-22 Aditya Golatkar , Alessandro Achille , Avinash Ravichandran , Marzia Polito , Stefano Soatto

Advances in neural computation have predominantly relied on the gradient backpropagation algorithm (BP). However, the recent shift towards non-stationary data modeling has highlighted the limitations of this heuristic, exposing that its…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Erik B. Terres-Escudero , Javier Del Ser , Pablo García-Bringas

Neural networks (NN) have demonstrated remarkable capabilities in various tasks, but their computation-intensive nature demands faster and more energy-efficient hardware implementations. Optics-based platforms, using technologies such as…

Automatic sleep staging is a challenging problem and state-of-the-art algorithms have not yet reached satisfactory performance to be used instead of manual scoring by a sleep technician. Much research has been done to find good feature…

Machine Learning · Computer Science 2018-05-15 Martin Längkvist , Amy Loutfi

Electroencephalography (EEG) has been widely used to study the relationship between naps and working memory, yet the effects of naps on distinct working memory tasks remain unclear. Here, participants performed word-pair and visuospatial…

Neurons and Cognition · Quantitative Biology 2023-11-16 Gi-Hwan Shin , Young-Seok Kweon , Heon-Gyu Kwak , Ha-Na Jo , Seong-Whan Lee

Sleep is particularly important to the health of infants, children, and adolescents, and sleep scoring is the first step to accurate diagnosis and treatment of potentially life-threatening conditions. But pediatric sleep is severely…

Signal Processing · Electrical Eng. & Systems 2022-10-27 Harlin Lee , Aaqib Saeed

We present a study of the phase diagram of a random optimization problem in presence of quantum fluctuations. Our main result is the characterization of the nature of the phase transition, which we find to be a first-order quantum phase…

Disordered Systems and Neural Networks · Physics 2010-05-24 T. Jorg , F. Krzakala , G. Semerjian , F. Zamponi