English
Related papers

Related papers: Using CODEQ to Train Feed-forward Neural Networks

200 papers

Q-learning is a widely used reinforcement learning technique for solving path planning problems. It primarily involves the interaction between an agent and its environment, enabling the agent to learn an optimal strategy that maximizes…

Robotics · Computer Science 2024-12-18 Yiming Ji , Kaijie Yun , Yang Liu , Zongwu Xie , Hong Liu

We propose a new training method for a feedforward neural network having the activation functions with the geometric contraction property. The method consists of constructing a new functional that is less nonlinear in comparison with the…

Neural and Evolutionary Computing · Computer Science 2018-08-14 Petre Birtea , Cosmin Cernazanu-Glavan , Alexandru Sisu

As neural networks grow in scale, their training becomes both computationally demanding and rich in dynamics. Amidst the flourishing interest in these training dynamics, we present a novel observation: Parameters during training exhibit…

Machine Learning · Computer Science 2024-07-24 Jonathan Brokman , Roy Betser , Rotem Turjeman , Tom Berkov , Ido Cohen , Guy Gilboa

This work proposes the first strategy to make distributed training of neural networks resilient to computing errors, a problem that has remained unsolved despite being first posed in 1956 by von Neumann. He also speculated that the…

Information Theory · Computer Science 2019-03-05 Sanghamitra Dutta , Ziqian Bai , Tze Meng Low , Pulkit Grover

The gradients used to train neural networks are typically computed using backpropagation. While an efficient way to obtain exact gradients, backpropagation is computationally expensive, hinders parallelization, and is biologically…

Machine Learning · Computer Science 2026-01-14 Katharina Flügel , Daniel Coquelin , Marie Weiel , Charlotte Debus , Achim Streit , Markus Götz

Artificial intelligence is one of the drivers of modern technological development. The current approach to the development of intelligent systems is data-centric. It has several limitations: it is fundamentally impossible to collect data…

Artificial Intelligence · Computer Science 2021-12-10 Kirill Krinkin , Yulia Shichkina , Andrey Ignatyev

Advances in optical and electrophysiological recording technologies have made it possible to record the dynamics of thousands of neurons, opening up new possibilities for interpreting and controlling large neural populations in behaving…

Neurons and Cognition · Quantitative Biology 2023-11-20 Fatih Dinc , Adam Shai , Mark Schnitzer , Hidenori Tanaka

Combining Reinforcement Learning (RL) with a prior controller can yield the best out of two worlds: RL can solve complex nonlinear problems, while the control prior ensures safer exploration and speeds up training. Prior work largely blends…

Machine Learning · Computer Science 2024-07-02 Emma Cramer , Bernd Frauenknecht , Ramil Sabirov , Sebastian Trimpe

Deep neural networks can achieve great successes when presented with large data sets and sufficient computational resources. However, their ability to learn new concepts quickly is limited. Meta-learning is one approach to address this…

Machine Learning · Computer Science 2021-04-22 Mike Huisman , Jan N. van Rijn , Aske Plaat

Quantum machine learning, focusing on quantum neural networks (QNNs), remains a vastly uncharted field of study. Current QNN models primarily employ variational circuits on an ansatz or a quantum feature map, often requiring multiple…

Quantum Physics · Physics 2024-02-02 Utkarsh Singh , Aaron Z. Goldberg , Khabat Heshami

forqs is a forward-in-time simulation of recombination, quantitative traits, and selection. It was designed to investigate haplotype patterns resulting from scenarios where substantial evolutionary change has taken place in a small number…

Populations and Evolution · Quantitative Biology 2013-10-14 Darren Kessner , John Novembre

Quantum neural networks combine quantum computing with advanced data-driven methods, offering promising applications in quantum machine learning. However, the optimal paradigm for balancing trainability and expressivity in QNNs remains an…

Quantum Physics · Physics 2025-08-05 Hongshun Yao , Xia Liu , Mingrui Jing , Guangxi Li , Xin Wang

In this paper, we introduce a collaborative training algorithm of balanced random forests with convolutional neural networks for domain adaptation tasks. In real scenarios, most domain adaptation algorithms face the challenges from noisy,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Jongbin Ryu , Jiun Bae , Jongwoo Lim

We present an end-to-end deep network for fine-grained visual categorization called Collaborative Convolutional Network (CoCoNet). The network uses a collaborative layer after the convolutional layers to represent an image as an optimal…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Tapabrata Chakraborti , Brendan McCane , Steven Mills , Umapada Pal

The Forward-Forward Learning (FFL) algorithm is a recently proposed solution for training neural networks without needing memory-intensive backpropagation. During training, labels accompany input data, classifying them as positive or…

Machine Learning · Computer Science 2024-05-22 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

Machine Learning algorithms have been extensively researched throughout the last decade, leading to unprecedented advances in a broad range of applications, such as image classification and reconstruction, object recognition, and text…

Artificial Intelligence · Computer Science 2022-12-20 Gustavo H. de Rosa , Mateus Roder , João Paulo Papa , Claudio F. G. dos Santos

Federated learning enables training a global model from data located at the client nodes, without data sharing and moving client data to a centralized server. Performance of federated learning in a multi-access edge computing (MEC) network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-11 Saurav Prakash , Sagar Dhakal , Mustafa Akdeniz , Yair Yona , Shilpa Talwar , Salman Avestimehr , Nageen Himayat

This research is to search for alternatives to the resolution of complex medical diagnosis where human knowledge should be apprehended in a general fashion. Successful application examples show that human diagnostic capabilities are…

Neural and Evolutionary Computing · Computer Science 2010-09-28 Abu Bakar Siddiquee , Md. Ehsanul Hoque Mazumder , S. M. Kamruzzaman

With the prosperity of mobile devices, the distributed learning approach enabling model training with decentralized data has attracted wide research. However, the lack of training capability for edge devices significantly limits the energy…

Machine Learning · Computer Science 2021-05-14 Ziyang Hong , C. Patrick Yue

Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive…

Neural and Evolutionary Computing · Computer Science 2011-08-10 Daohang Sha , Vladimir B. Bajic