English
Related papers

Related papers: Controlling Neural Networks via Energy Dissipation

200 papers

Deep learning has excelled in image recognition tasks through neural networks inspired by the human brain. However, the necessity for large models to improve prediction accuracy introduces significant computational demands and extended…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taigo Sakai , Kazuhiro Hotta

While the depth of convolutional neural networks has attracted substantial attention in the deep learning research, the width of these networks has recently received greater interest. The width of networks, defined as the size of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Peng Liu , Xiaoxiao Zhou , Yangjunyi Li , El Basha Mohammad D , Ruogu Fang

Microstructural evolution is a key aspect of understanding and exploiting the structure-property-performance relation of materials. Modeling microstructure evolution usually relies on coarse-grained simulations with evolution principles…

Materials Science · Physics 2020-09-01 Kaiqi Yang , Yifan Cao , Youtian Zhang , Ming Tang , Daniel Aberg , Babak Sadigh , Fei Zhou

Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require…

Neural and Evolutionary Computing · Computer Science 2022-12-05 Ying Bi , Bing Xue , Mengjie Zhang

Most existing methods usually formulate the non-blind deconvolution problem into a maximum-a-posteriori framework and address it by manually designing kinds of regularization terms and data terms of the latent clear images. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Pin-Hung Kuo , Jinshan Pan , Shao-Yi Chien , Ming-Hsuan Yang

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

We propose a new method that uses deep learning techniques to solve the inverse problems. The inverse problem is cast in the form of learning an end-to-end mapping from observed data to the ground-truth. Inspired by the splitting strategy…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Kai Fan , Qi Wei , Wenlin Wang , Amit Chakraborty , Katherine Heller

Consider an unknown nonlinear dynamical system that is known to be dissipative. The objective of this paper is to learn a neural dynamical model that approximates this system, while preserving the dissipativity property in the model. In…

Machine Learning · Computer Science 2024-04-09 Yuezhu Xu , S. Sivaranjani

The structure and performance of neural networks are intimately connected, and by use of evolutionary algorithms, neural network structures optimally adapted to a given task can be explored. Guiding such neuroevolution with additional…

Neural and Evolutionary Computing · Computer Science 2019-04-24 Kai Olav Ellefsen , Joost Huizinga , Jim Torresen

Predictive maintenance is an effective tool for reducing maintenance costs. Its effectiveness relies heavily on the ability to predict the future state of health of the system, and for this survival models have shown to be very useful. Due…

Systems and Control · Electrical Eng. & Systems 2023-02-02 Olov Holmer , Erik Frisk , Mattias Krysander

Motivated by the fact that forward and backward passes of a deep network naturally form symmetric mappings between input and output representations, we introduce a simple yet effective self-supervised vision model pretraining framework…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Ze Wang , Jiang Wang , Zicheng Liu , Qiang Qiu

Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Davis Gilton , Gregory Ongie , Rebecca Willett

This paper presents a new variational inference framework for image restoration and a convolutional neural network (CNN) structure that can solve the restoration problems described by the proposed framework. Earlier CNN-based image…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Jae Woong Soh , Nam Ik Cho

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

A method to control results of gradient descent unsupervised learning in a deep neural network by using evolutionary algorithm is proposed. To process crossover of unsupervisedly trained models, the algorithm evaluates pointwise fitness of…

Machine Learning · Statistics 2018-03-29 Takeshi Inagaki

Conventional compressive sensing (CS) reconstruction is very slow for its characteristic of solving an optimization problem. Convolu- tional neural network can realize fast processing while achieving compa- rable results. While CS image…

Computer Vision and Pattern Recognition · Computer Science 2017-10-04 Xuemei Xie , Yuxiang Wang , Guangming Shi , Chenye Wang , Jiang Du , Zhifu Zhao

We show that neural networks trained by evolutionary reinforcement learning can enact efficient molecular self-assembly protocols. Presented with molecular simulation trajectories, networks learn to change temperature and chemical potential…

Statistical Mechanics · Physics 2020-06-01 Stephen Whitelam , Isaac Tamblyn

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

Machine Learning · Computer Science 2019-07-09 Reinhard Heckel

The rapid advancements of computing technology facilitate the development of diverse deep learning applications. Unfortunately, the efficiency of parallel computing infrastructures varies widely with neural network models, which hinders the…

Machine Learning · Computer Science 2020-12-04 Chuan-Chi Wang , Ying-Chiao Liao , Chia-Heng Tu , Ming-Chang Kao , Wen-Yew Liang , Shih-Hao Hung

Deep Convolution Neural Networks (CNN) have achieved significant performance on single image super-resolution (SR) recently. However, existing CNN-based methods use artificially synthetic low-resolution (LR) and high-resolution (HR) image…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Tianyu Zhao , Wenqi Ren , Changqing Zhang , Dongwei Ren , Qinghua Hu