English
Related papers

Related papers: Deep Subspace Encoders for Nonlinear System Identi…

200 papers

Based on neural network and adaptive subspace approximation method, we propose a new machine learning method for solving partial differential equations. The neural network is adopted to build the basis of the finite dimensional subspace.…

Numerical Analysis · Mathematics 2024-12-04 Zhongshuo Lin , Yifan Wang , Hehu Xie

Machine learning is currently a trending topic in various science and engineering disciplines, and the field of geophysics is no exception. With the advent of powerful computers, it is now possible to train the machine to learn complex…

Computational Engineering, Finance, and Science · Computer Science 2018-05-02 Debjani Bhowmick , Deepak K. Gupta , Saumen Maiti , Uma Shankar

Mixed-signal artificial neural networks (ANNs) that employ analog matrix-multiplication accelerators can achieve higher speed and improved power efficiency. Though analog computing is known to be susceptible to noise and device…

Signal Processing · Electrical Eng. & Systems 2021-07-01 Joseph Ulseth , Zheyuan Zhu , Guifang Li , Shuo Pang

Deep convolutional neural networks (CNNs) are broadly considered to be state-of-the-art generic end-to-end image classification systems. However, they are known to underperform when training data are limited and thus require data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Mohammad Shifat E Rabbi , Yan Zhuang , Shiying Li , Abu Hasnat Mohammad Rubaiyat , Xuwang Yin , Gustavo K. Rohde

Auto-Encoder (AE)-based deep subspace clustering (DSC) methods have achieved impressive performance due to the powerful representation extracted using deep neural networks while prioritizing categorical separability. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Juncheng Lv , Zhao Kang , Xiao Lu , Zenglin Xu

This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification…

Systems and Control · Electrical Eng. & Systems 2022-06-02 Hongpeng Zhou , Chahine Ibrahim , Wei Xing Zheng , Wei Pan

We present the discriminative recurrent sparse auto-encoder model, comprising a recurrent encoder of rectified linear units, unrolled for a fixed number of iterations, and connected to two linear decoders that reconstruct the input and…

Machine Learning · Computer Science 2013-03-20 Jason Tyler Rolfe , Yann LeCun

Although various linear log-distance path loss models have been developed, advanced models are requiring to more accurately and flexibly represent the path loss for complex environments such as the urban area. This letter proposes an…

Machine Learning · Computer Science 2019-04-05 Chanshin Park , Daniel K. Tettey , Han-Shin Jo

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi

Artificial neural networks (ANNs) have been successfully applied to solve a variety of classification and function approximation problems. Although ANNs can generally predict better than decision trees for pattern classification problems,…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

The paper investigates nonlinear system identification using system output data at various linearized operating points. A feed-forward multi-layer Artificial Neural Network (ANN) based approach is used for this purpose and tested for two…

Systems and Control · Computer Science 2016-11-17 Sayan Saha , Saptarshi Das , Anish Acharya , Abhishek Kumar , Sumit Mukherjee , Indranil Pan , Amitava Gupta

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

Anomaly detection is to identify samples that do not conform to the distribution of the normal data. Due to the unavailability of anomalous data, training a supervised deep neural network is a cumbersome task. As such, unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , John Taylor Jewell , Yalda Mohsenzadeh

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

Finding a reduction of complex, high-dimensional dynamics to its essential, low-dimensional "heart" remains a challenging yet necessary prerequisite for designing efficient numerical approaches. Machine learning methods have the potential…

Dynamical Systems · Mathematics 2022-06-15 Przemyslaw Zielinski , Jan S. Hesthaven

Convolutional neural networks (CNNs) are reported to be overparametrized. The search for optimal (minimal) and sufficient architecture is an NP-hard problem as the hyperparameter space for possible network configurations is vast. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tin Barisin , Illia Horenko

Analog computing has reemerged as a promising avenue for accelerating deep neural networks (DNNs) due to its potential to overcome the energy efficiency and scalability challenges posed by traditional digital architectures. However,…

Emerging Technologies · Computer Science 2024-06-17 Cansu Demirkiran , Lakshmi Nair , Darius Bunandar , Ajay Joshi

Semantic image segmentation is one of the most important tasks in medical image analysis. Most state-of-the-art deep learning methods require a large number of accurately annotated examples for model training. However, accurate annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Ning Zhang , Susan Francis , Rayaz Malik , Xin Chen

Phonotactic constraints can be employed to distinguish languages by representing a speech utterance as a multinomial distribution or phone events. In the present study, we propose a new learning mechanism based on subspace-based…

Sound · Computer Science 2022-03-30 Hung-Shin Lee , Yu Tsao , Shyh-Kang Jeng , Hsin-Min Wang

This paper considers the problem of data-driven prediction of partially observed systems using a recurrent neural network. While neural network based dynamic predictors perform well with full-state training data, prediction with partial…

Systems and Control · Electrical Eng. & Systems 2023-04-07 Debdipta Goswami