English
Related papers

Related papers: Interpolation between Residual and Non-Residual Ne…

200 papers

Traditional algorithms for compressive sensing recovery are computationally expensive and are ineffective at low measurement rates. In this work, we propose a data driven non-iterative algorithm to overcome the shortcomings of earlier…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Suhas Lohit , Kuldeep Kulkarni , Ronan Kerviche , Pavan Turaga , Amit Ashok

With the rapid development of science and technology, the problem of energy load monitoring and decomposition of electrical equipment has been receiving widespread attention from academia and industry. For the purpose of improving the…

Signal Processing · Electrical Eng. & Systems 2021-09-14 Xinxin Zhou , Jingru Feng , Yang Li

Recurrent neural networks (RNNs) have shown the ability to improve scene parsing through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Heng Fan , Peng Chu , Longin Jan Latecki , Haibin Ling

Nowadays, denoising diffusion probabilistic models have been adapted for many image segmentation tasks. However, existing end-to-end models have already demonstrated remarkable capabilities. Rather than using denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shi Zhenning , Dong Changsheng , Xie Xueshuo , Pan Bin , He Along , Li Tao

Convolutional Neural Networks have become the norm in image classification. Nevertheless, their difficulty to maintain high accuracy across datasets has become apparent in the past few years. In order to utilize such models in real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Aristotelis Ballas , Christos Diou

Computer vision systems in real-world applications need to be robust to partial occlusion while also being explainable. In this work, we show that black-box deep convolutional neural networks (DCNNs) have only limited robustness to partial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Adam Kortylewski , Qing Liu , Angtian Wang , Yihong Sun , Alan Yuille

In the field of fusing multi-spectral and panchromatic images (Pan-sharpening), the impressive effectiveness of deep neural networks has been recently employed to overcome the drawbacks of traditional linear models and boost the fusing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Yancong Wei , Qiangqiang Yuan , Huanfeng Shen , Liangpei Zhang

The combination of ordinary differential equations and neural networks, i.e., neural ordinary differential equations (Neural ODE), has been widely studied from various angles. However, deciphering the numerical integration in Neural ODE is…

Machine Learning · Computer Science 2022-06-16 Aiqing Zhu , Pengzhan Jin , Beibei Zhu , Yifa Tang

This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The…

Neural and Evolutionary Computing · Computer Science 2019-11-04 Yiwei Fu , Samer Saab , Asok Ray , Michael Hauser

We introduce a new family of deep neural network models. Instead of specifying a discrete sequence of hidden layers, we parameterize the derivative of the hidden state using a neural network. The output of the network is computed using a…

Machine Learning · Computer Science 2019-12-17 Ricky T. Q. Chen , Yulia Rubanova , Jesse Bettencourt , David Duvenaud

Convolutional Neural Networks (CNNs) filter the input data using spatial convolution operators with compact stencils. Commonly, the convolution operators couple features from all channels, which leads to immense computational cost in the…

Machine Learning · Computer Science 2019-05-17 Jonathan Ephrath , Lars Ruthotto , Eldad Haber , Eran Treister

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

Reconstruction of biochemical reaction networks is a central topic in systems biology which raises crucial theoretical challenges in system identification. Nonlinear Ordinary Differential Equations (ODEs) that involve polynomial and…

Systems and Control · Computer Science 2016-11-18 Wei Pan , Ye Yuan , Guy-Bart Stan

Open-set recognition and adversarial defense study two key aspects of deep learning that are vital for real-world deployment. The objective of open-set recognition is to identify samples from open-set classes during testing, while…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Rui Shao , Pramuditha Perera , Pong C. Yuen , Vishal M. Patel

Compressive sensing (CS) is a technique that enables the recovery of sparse signals using fewer measurements than traditional sampling methods. To address the computational challenges of CS reconstruction, our objective is to develop an…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Youhao Yu , Richard M. Dansereau

Diffusion, a fundamental internal mechanism emerging in many physical processes, describes the interaction among different objects. In many learning tasks with limited training samples, the diffusion connects the labeled and unlabeled data…

Machine Learning · Computer Science 2023-05-02 Tangjun Wang , Zehao Dou , Chenglong Bao , Zuoqiang Shi

To derive the hidden dynamics from observed data is one of the fundamental but also challenging problems in many different fields. In this study, we propose a new type of interpretable network called the ordinary differential equation…

Dynamical Systems · Mathematics 2020-10-19 Pipi Hu , Wuyue Yang , Yi Zhu , Liu Hong

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

Coordinate transformation models often fail to account for nonlinear and spatially dependent distortions, leading to significant residual errors in geospatial applications. Here we propose a residual-based neural correction strategy, in…