English
Related papers

Related papers: Physical deep learning based on optimal control of…

200 papers

Deep learning relies on a very specific kind of neural networks: those superposing several neural layers. In the last few years, deep learning achieved major breakthroughs in many tasks such as image analysis, speech recognition, natural…

Artificial Intelligence · Computer Science 2018-02-01 Lê Nguyên Hoang , Rachid Guerraoui

Dynamic neural network is an emerging research topic in deep learning. Compared to static models which have fixed computational graphs and parameters at the inference stage, dynamic networks can adapt their structures or parameters to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Yizeng Han , Gao Huang , Shiji Song , Le Yang , Honghui Wang , Yulin Wang

Continual Learning is a learning paradigm where learning systems are trained with sequential or streaming tasks. Two notable directions among the recent advances in continual learning with neural networks are ($i$) variational Bayes based…

Machine Learning · Computer Science 2020-02-24 Abhishek Kumar , Sunabha Chatterjee , Piyush Rai

Most deep learning backbones are evaluated on ImageNet. Using scenery images as an example, we conducted extensive experiments to demonstrate the widely accepted principles in network design may result in dramatic performance differences…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Zhinan Qiao , Xiaohui Yuan

Deep learning has arguably achieved tremendous success in recent years. In simple words, deep learning uses the composition of many nonlinear functions to model the complex dependency between input features and labels. While neural networks…

Machine Learning · Statistics 2019-04-16 Jianqing Fan , Cong Ma , Yiqiao Zhong

In recent years, deep learning has been connected with optimal control as a way to define a notion of a continuous underlying learning problem. In this view, neural networks can be interpreted as a discretization of a parametric Ordinary…

Optimization and Control · Mathematics 2020-07-07 Joubine Aghili , Olga Mula

Intelligent communication is gradually considered as the mainstream direction in future wireless communications. As a major branch of machine learning, deep learning (DL) has been applied in physical layer communications and has…

Information Theory · Computer Science 2019-02-26 Hengtao He , Shi Jin , Chao-Kai Wen , Feifei Gao , Geoffrey Ye Li , Zongben Xu

Deep learning is a branch of artificial intelligence where networks of simple interconnected units are used to extract patterns from data in order to solve complex problems. Deep learning algorithms have shown groundbreaking performance in…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Maciej A. Mazurowski , Mateusz Buda , Ashirbani Saha , Mustafa R. Bashir

Deep learning has proved itself to be a powerful tool to develop data-driven signal processing algorithms for challenging engineering problems. By learning the key features and characteristics of the input signals, instead of requiring a…

Information Theory · Computer Science 2021-01-05 Emil Björnson , Pontus Giselsson

We demonstrate that deep reinforcement learning (deep RL) provides a highly effective strategy for the control and self-tuning of optical systems. Deep RL integrates the two leading machine learning architectures of deep neural networks and…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Chang Sun , Eurika Kaiser , Steven L. Brunton , J. Nathan Kutz

Advancements in artificial intelligence call for a deeper understanding of the fundamental mechanisms underlying deep learning. In this work, we propose a theoretical framework to analyze learning dynamics through the lens of dynamical…

Machine Learning · Computer Science 2025-10-13 Yuchen Lin , Yong Zhang , Sihan Feng , Hong Zhao

Neural networks are known to be effective function approximators. Recently, deep neural networks have proven to be very effective in pattern recognition, classification tasks and human-level control to model highly nonlinear realworld…

Neural and Evolutionary Computing · Computer Science 2016-10-06 Olalekan Ogunmolu , Xuejun Gu , Steve Jiang , Nicholas Gans

The fields of artificial intelligence and neuroscience have a long history of fertile bi-directional interactions. On the one hand, important inspiration for the development of artificial intelligence systems has come from the study of…

Neurons and Cognition · Quantitative Biology 2019-11-21 Eilif B. Muller , Philippe Beaudoin

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter

Deep learning has been the most popular machine learning method in the last few years. In this chapter, we present the application of deep learning and physics-informed neural networks concerning structural mechanics and vibration problems.…

Machine Learning · Computer Science 2022-02-23 Ehsan Haghighat , Ali Can Bekar , Erdogan Madenci , Ruben Juanes

We develop a data-driven, model-free approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator for the purpose of control. In particular, DNN…

Machine Learning · Computer Science 2020-10-16 Yiqiang Han , Wenjian Hao , Umesh Vaidya

Neural Networks sequentially build high-level features through their successive layers. We propose here a new neural network model where each layer is associated with a set of candidate mappings. When an input is processed, at each layer,…

Machine Learning · Computer Science 2014-10-03 Ludovic Denoyer , Patrick Gallinari

Effective inclusion of physics-based knowledge into deep neural network models of dynamical systems can greatly improve data efficiency and generalization. Such a-priori knowledge might arise from physical principles (e.g., conservation…

Machine Learning · Computer Science 2022-12-13 Franck Djeumou , Cyrus Neary , Eric Goubault , Sylvie Putot , Ufuk Topcu

Deep learning (DL) is a high dimensional data reduction technique for constructing high-dimensional predictors in input-output models. DL is a form of machine learning that uses hierarchical layers of latent features. In this article, we…

Machine Learning · Statistics 2018-08-06 Nicholas G. Polson , Vadim O. Sokolov

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian