English
Related papers

Related papers: Learning hidden elasticity with deep neural networ…

200 papers

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

We introduce a method for learning provably stable deep neural network based dynamic models from observed data. Specifically, we consider discrete-time stochastic dynamic models, as they are of particular interest in practical applications…

Machine Learning · Computer Science 2021-03-30 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , Johan U. Backström , R. Bhushan Gopaluni

We contrast the distinct frameworks of materials design and physical learning in creating elastic networks with desired stable states. In design, the desired states are specified in advance and material parameters can be optimized on a…

Soft Condensed Matter · Physics 2020-09-02 Menachem Stern , Matthew B. Pinson , Arvind Murugan

Deep networks are commonly used to model dynamical systems, predicting how the state of a system will evolve over time (either autonomously or in response to control inputs). Despite the predictive power of these systems, it has been…

Machine Learning · Computer Science 2020-01-20 Gaurav Manek , J. Zico Kolter

In this work we propose a framework for improving the performance of any deep neural network that may suffer from vanishing gradients. To address the vanishing gradient issue, we study a framework, where we insert an intermediate output…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Yi Zhou , Yue Bai , Shuvra S. Bhattacharyya , Heikki Huttunen

Feature selection is an important and active research area in statistics and machine learning. The Elastic Net is often used to perform selection when the features present non-negligible collinearity or practitioners wish to incorporate…

Machine Learning · Statistics 2020-06-09 Tobia Boschi , Matthew Reimherr , Francesca Chiaromonte

When neural networks are used to model dynamics, properties such as stability of the dynamics are generally not guaranteed. In contrast, there is a recent method for learning the dynamics of autonomous systems that guarantees global…

Machine Learning · Computer Science 2022-03-21 Kenji Kashima , Ryota Yoshiuchi , Yu Kawano

Deploying neural networks to different devices or platforms is in general challenging, especially when the model size is large or model complexity is high. Although there exist ways for model pruning or distillation, it is typically…

Machine Learning · Computer Science 2023-12-07 Kai Li , Yi Luo

In this paper, we propose embedding sparsity into the structure of deep neural networks, where model parameters can be exactly zero during training with the stochastic gradient descent. Thus, it can learn the sparsified structure and the…

Machine Learning · Computer Science 2020-06-25 Yongjin Lee

In this paper, we adapt Recurrent Neural Networks with Stochastic Layers, which are the state-of-the-art for generating text, music and speech, to the problem of acoustic novelty detection. By integrating uncertainty into the hidden states,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-24 Duong Nguyen , Oliver S. Kirsebom , Fábio Frazão , Ronan Fablet , Stan Matwin

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

Extra-large deformations in ultra-soft elastic materials are ubiquitous, yet systematic studies and methods to understand the mechanics of such huge strains are lacking. Here we investigate this complex problem systematically with a simple…

Materials Science · Physics 2017-01-04 Aditi Chakrabarti , Manoj K. Chaudhury , Serge Mora , Yves Pomeau

In this paper, we consider the problem of exploring structural regularities of networks by dividing the nodes of a network into groups such that the members of each group have similar patterns of connections to other groups. Specifically,…

Physics and Society · Physics 2015-05-30 Hua-Wei Shen , Xue-Qi Cheng , Jia-Feng Guo

Ultrasound-based elasticity imaging is a non-invasive technique for estimating tissue stiffness fields from displacement fields obtained by comparing ultrasound signals before and after compression. While recent deep learning approaches…

Medical Physics · Physics 2026-01-22 Heekyu Kim , Hugon LEe , Minwoo Park , Seunghwa Ryu

Prestress in amorphous solids bears the memory of their formation, and plays a profound role in their mechanical properties, from stiffening or softening elastic moduli to shifting frequencies of vibrational modes, as well as directing…

Soft Condensed Matter · Physics 2021-10-15 Shang Zhang , Ethan Stanifer , Vishwas Vasisht , Leyou Zhang , Emanuela Del Gado , Xiaoming Mao

We introduce a method to reconstruct the kinematics of neutral-current deep inelastic scattering (DIS) using a deep neural network (DNN). Unlike traditional methods, it exploits the full kinematic information of both the scattered electron…

High Energy Physics - Experiment · Physics 2022-01-03 Miguel Arratia , Daniel Britzger , Owen Long , Benjamin Nachman

Deep learning techniques have shown their success in medical image segmentation since they are easy to manipulate and robust to various types of datasets. The commonly used loss functions in the deep segmentation task are pixel-wise loss…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Yuan Lan , Yang Xiang , Luchan Zhang

Deep neural networks have become invaluable tools for supervised machine learning, e.g., classification of text or images. While often offering superior results over traditional techniques and successfully expressing complicated patterns in…

Machine Learning · Computer Science 2019-02-19 Eldad Haber , Lars Ruthotto

In this paper, we consider a numerical homogenization of the poroelasticity problem with stochastic properties. The proposed method based on the construction of the deep neural network (DNN) for fast calculation of the effective properties…

Numerical Analysis · Mathematics 2018-10-04 Maria Vasilyeva , Aleksey Tyrylgin

Deep networks realize complex mappings that are often understood by their locally linear behavior at or around points of interest. For example, we use the derivative of the mapping with respect to its inputs for sensitivity analysis, or to…

Machine Learning · Computer Science 2019-07-09 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola