English
Related papers

Related papers: Fully reversible neural networks for large-scale s…

200 papers

Deep neural networks are widely used in various domains. However, the nature of computations at each layer of the deep networks is far from being well understood. Increasing the interpretability of deep neural networks is thus important.…

Machine Learning · Computer Science 2018-12-19 Haiping Huang

Deep neural networks have emerged as powerful tools for learning operators defined over infinite-dimensional function spaces. However, existing theories frequently encounter difficulties related to dimensionality and limited…

Machine Learning · Computer Science 2026-05-12 Jianfei Li , Shuo Huang , Han Feng , Ding-Xuan Zhou , Gitta Kutyniok

The promise of compressive sensing (CS) has been offset by two significant challenges. First, real-world data is not exactly sparse in a fixed basis. Second, current high-performance recovery algorithms are slow to converge, which limits CS…

Machine Learning · Statistics 2017-01-17 Ali Mousavi , Richard G. Baraniuk

Training networks to perform metric relocalization traditionally requires accurate image correspondences. In practice, these are obtained by restricting domain coverage, employing additional sensors, or capturing large multi-view datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Mike Kasper , Fernando Nobre , Christoffer Heckman , Nima Keivan

Aerial remote sensing using multispectral and RGB imagers has provided a critical impetus to precision agriculture. Analysis of the hyperspectral images with limited or no labels is challenging. This paper focuses on self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Moqsadur Rahman , Saurav Kumar , Santosh S. Palmate , M. Shahriar Hossain

Geophysical inversion attempts to estimate the distribution of physical properties in the Earth's interior from observations collected at or above the surface. Inverse problems are commonly posed as least-squares optimization problems in…

Geophysics · Physics 2019-05-22 Vladimir Puzyrev

There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Sayantan Bhadra , Mark A. Anastasio

Semantic segmentation is pixel-wise classification which retains critical spatial information. The "feature map reuse" has been commonly adopted in CNN based approaches to take advantage of feature maps in the early layers for the later…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Mingmin Zhen , Jinglu Wang , Lei Zhou , Tian Fang , Long Quan

The mining and utilization of features directly affect the classification performance of models used in the classification and recognition of hyperspectral remote sensing images. Traditional models usually conduct feature mining from a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yunsong Zhao , Yin Li , Zhihan Chen , Tianchong Qiu , Guojin Liu

Hyperspectral compressive imaging takes advantage of compressive sensing theory to achieve coded aperture snapshot measurement without temporal scanning, and the entire three-dimensional spatial-spectral data is captured by a…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Yubao Sun , Ying Yang , Qingshan Liu , Mohan Kankanhalli

Deep residual networks (ResNets) have significantly pushed forward the state-of-the-art on image classification, increasing in performance as networks grow both deeper and wider. However, memory consumption becomes a bottleneck, as one…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Aidan N. Gomez , Mengye Ren , Raquel Urtasun , Roger B. Grosse

Despite impressive performance as evaluated on i.i.d. holdout data, deep neural networks depend heavily on superficial statistics of the training data and are liable to break under distribution shift. For example, subtle changes to the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Haohan Wang , Zexue He , Zachary C. Lipton , Eric P. Xing

Deep Neural networks forget previously learnt tasks when they are faced with learning new tasks. This is called catastrophic forgetting. Rehearsing the neural network with the training data of the previous task can protect the network from…

Machine Learning · Computer Science 2020-04-29 Bhasker Sri Harsha Suri , Kalidas Yeturu

We study model recovery for data classification, where the training labels are generated from a one-hidden-layer neural network with sigmoid activations, also known as a single-layer feedforward network, and the goal is to recover the…

Machine Learning · Statistics 2020-05-07 Haoyu Fu , Yuejie Chi , Yingbin Liang

In recent years, deep neural networks have emerged as a solution for inverse imaging problems. These networks are generally trained using pairs of images: one degraded and the other of high quality, the latter being called 'ground truth'.…

Information Retrieval · Computer Science 2025-10-01 Victor Sechaud , Patrice Abry , Laurent Jacques , Julián Tachella

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Deep neural networks for time series must capture complex temporal patterns, to effectively represent dynamic data. Self- and semi-supervised learning methods show promising results in pre-training large models, which -- when finetuned for…

Machine Learning · Computer Science 2025-08-15 Yuhan Xie , William Cappelletti , Mahsa Shoaran , Pascal Frossard

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

Hyper-spectral images are images captured from a satellite that gives spatial and spectral information of specific region.A Hyper-spectral image contains much more number of channels as compared to a RGB image, hence containing more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Uphar Singh , Tushar Musale , Ranjana Vyas , O. P. Vyas

Many machine learning methods operate by inverting a neural network at inference time, which has become a popular technique for solving inverse problems in computer vision, robotics, and graphics. However, these methods often involve…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ruoshi Liu , Chengzhi Mao , Purva Tendulkar , Hao Wang , Carl Vondrick