English
Related papers

Related papers: Deep Residual Learning and PDEs on Manifold

200 papers

Road extraction from aerial images has been a hot research topic in the field of remote sensing image analysis. In this letter, a semantic segmentation neural network which combines the strengths of residual learning and U-Net is proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Zhengxin Zhang , Qingjie Liu , Yunhong Wang

We analyze the input-output behavior of residual networks from a dynamical system point of view by disentangling the residual dynamics from the output activities before the classification stage. For a network with simple skip connections…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 Fereshteh Lagzi

Recently, deep residual networks have been successfully applied in many computer vision and natural language processing tasks, pushing the state-of-the-art performance with deeper and wider architectures. In this work, we interpret deep…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Bo Chang , Lili Meng , Eldad Haber , Lars Ruthotto , David Begert , Elliot Holtham

This paper proposes a deep learning architecture based on Residual Network that dynamically adjusts the number of executed layers for the regions of the image. This architecture is end-to-end trainable, deterministic and problem-agnostic.…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Michael Figurnov , Maxwell D. Collins , Yukun Zhu , Li Zhang , Jonathan Huang , Dmitry Vetrov , Ruslan Salakhutdinov

In this paper, we propose a novel method for the challenging problem of guided depth map super-resolution, called PAGNet. It is based on residual dense networks and involves the attention mechanism to suppress the texture copying problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Arpit Bansal , Sankaraganesh Jonna , Rajiv R. Sahay

The problem of extending a function $f$ defined on a training data $\mathcal{C}$ on an unknown manifold $\mathbb{X}$ to the entire manifold and a tubular neighborhood of this manifold is considered in this paper. For $\mathbb{X}$ embedded…

Machine Learning · Computer Science 2016-07-26 Charles K. Chui , H. N. Mhaskar

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data…

Numerical Analysis · Mathematics 2021-04-21 Cheng Chang , Liu Liu , Tieyong Zeng

We study the multiple manifold problem, a binary classification task modeled on applications in machine vision, in which a deep fully-connected neural network is trained to separate two low-dimensional submanifolds of the unit sphere. We…

Machine Learning · Statistics 2021-05-07 Sam Buchanan , Dar Gilboa , John Wright

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li

In this paper, we propose DeepMartNet - a Martingale based deep neural network learning method for solving Dirichlet boundary value problems (BVPs) and eigenvalue problems for elliptic partial differential equations (PDEs) in high…

Numerical Analysis · Mathematics 2023-12-22 Wei Cai , Andrew He , Daniel Margolis

This paper introduces a neural network approach for solving two-dimensional traveltime tomography (TT) problems based on the eikonal equation. The mathematical problem of TT is to recover the slowness field of a medium based on the boundary…

Numerical Analysis · Mathematics 2019-11-27 Yuwei Fan , Lexing Ying

Implementing deep neural networks for learning the solution maps of parametric partial differential equations (PDEs) turns out to be more efficient than using many conventional numerical methods. However, limited theoretical analyses have…

Numerical Analysis · Mathematics 2022-08-31 Zhen Lei , Lei Shi , Chenyu Zeng

Based on the numerical manifold method principle, we developed a mathematical framework of a neural network manifold: Deep Manifold and discovered that neural networks: 1) is numerical computation combining forward and inverse; 2) have near…

Machine Learning · Computer Science 2024-09-27 Max Y. Ma , Gen-Hua Shi

Deep learning approaches to 3D shape segmentation are typically formulated as a multi-class labeling problem. Existing models are trained for a fixed set of labels, which greatly limits their flexibility and adaptivity. We opt for top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Fenggen Yu , Kun Liu , Yan Zhang , Chenyang Zhu , Kai Xu

Very deep convolutional neural networks offer excellent recognition results, yet their computational expense limits their impact for many real-world applications. We introduce BlockDrop, an approach that learns to dynamically choose which…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Zuxuan Wu , Tushar Nagarajan , Abhishek Kumar , Steven Rennie , Larry S. Davis , Kristen Grauman , Rogerio Feris

Deep learning has emerged as a compelling framework for scientific and engineering computing, motivating growing interest in neural network-based solvers for partial differential equations (PDEs). Within this landscape, network…

Numerical Analysis · Mathematics 2026-04-06 Tao Cheng , Lili Ju , Zhonghua Qiao , Xiaoping Zhang

Effectively detecting anomalous nodes in attributed networks is crucial for the success of many real-world applications such as fraud and intrusion detection. Existing approaches have difficulties with three major issues: sparsity and…

Machine Learning · Computer Science 2020-10-01 Yulong Pei , Tianjin Huang , Werner van Ipenburg , Mykola Pechenizkiy

Learning-based methods for inverse problems, adapting to the data's inherent structure, have become ubiquitous in the last decade. Besides empirical investigations of their often remarkable performance, an increasing number of works…

Numerical Analysis · Mathematics 2023-07-21 Clemens Arndt , Sören Dittmer , Nick Heilenkötter , Meira Iske , Tobias Kluth , Judith Nickel

In this paper, we propose a deep neural network architecture for object recognition based on recurrent neural networks. The proposed network, called ReNet, replaces the ubiquitous convolution+pooling layer of the deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2015-07-24 Francesco Visin , Kyle Kastner , Kyunghyun Cho , Matteo Matteucci , Aaron Courville , Yoshua Bengio

The connection between Residual Neural Networks (ResNets) and continuous-time control systems (known as NeurODEs) has led to a mathematical analysis of neural networks which has provided interesting results of both theoretical and practical…

Optimization and Control · Mathematics 2025-03-19 Cristina Cipriani , Massimo Fornasier , Alessandro Scagliotti