English
Related papers

Related papers: ASCAI: Adaptive Sampling for acquiring Compact AI

200 papers

Deep learning based methods have recently pushed the state-of-the-art on the problem of Single Image Super-Resolution (SISR). In this work, we revisit the more traditional interpolation-based methods, that were popular before, now with the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Xu Jia , Hong Chang , Tinne Tuytelaars

Deep neural networks have achieved great success in many data processing applications. However, the high computational complexity and storage cost makes deep learning hard to be used on resource-constrained devices, and it is not…

Machine Learning · Computer Science 2023-03-27 Xinwei Ou , Zhangxin Chen , Ce Zhu , Yipeng Liu

The SPARKLING algorithm was originally developed for accelerated 2D magnetic resonance imaging (MRI) in the compressed sensing (CS) context. It yields non-Cartesian sampling trajectories that jointly fulfill a target sampling density while…

Signal Processing · Electrical Eng. & Systems 2021-06-01 Chaithya G R , Zaccharie Ramzi , Philippe Ciuciu

Recently, deep learning-based compressive imaging (DCI) has surpassed the conventional compressive imaging in reconstruction quality and faster running time. While multi-scale has shown superior performance over single-scale, research in…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Thuong Nguyen Canh , Byeungwoo Jeon

Recent accelerated MRI reconstruction models have used Deep Neural Networks (DNNs) to reconstruct relatively high-quality images from highly undersampled k-space data, enabling much faster MRI scanning. However, these techniques sometimes…

Image and Video Processing · Electrical Eng. & Systems 2021-04-12 Itzik Malkiel , Sangtae Ahn , Valentina Taviani , Anne Menini , Lior Wolf , Christopher J. Hardy

The recent advancements in point cloud learning have enabled intelligent vehicles and robots to comprehend 3D environments better. However, processing large-scale 3D scenes remains a challenging problem, such that efficient downsampling…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hongcheng Yang , Dingkang Liang , Dingyuan Zhang , Zhe Liu , Zhikang Zou , Xingyu Jiang , Yingying Zhu

Accelerated MRI protocols routinely involve a predefined sampling pattern that undersamples the k-space. Finding an optimal pattern can enhance the reconstruction quality, however this optimization is a challenging task. To address this…

Image and Video Processing · Electrical Eng. & Systems 2024-08-30 Cagan Alkan , Morteza Mardani , Congyu Liao , Zhitao Li , Shreyas S. Vasanawala , John M. Pauly

Training a neural network (NN) typically relies on some type of curve-following method, such as gradient descent (GD) (and stochastic gradient descent (SGD)), ADADELTA, ADAM or limited memory algorithms. Convergence for these algorithms…

Machine Learning · Computer Science 2023-05-08 Michael A Kouritzin , Stephen Styles , Beatrice-Helen Vritsiou

Designing an optimal deep neural network for a given task is important and challenging in many machine learning applications. To address this issue, we introduce a self-adaptive algorithm: the adaptive network enhancement (ANE) method,…

Numerical Analysis · Mathematics 2022-03-02 Zhiqiang Cai , Jingshuang Chen , Min Liu

In this work we propose a deep adaptive sampling (DAS) method for solving partial differential equations (PDEs), where deep neural networks are utilized to approximate the solutions of PDEs and deep generative models are employed to…

Numerical Analysis · Mathematics 2022-07-06 Kejun Tang , Xiaoliang Wan , Chao Yang

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

Deep neural networks have gained great success due to the increasing amounts of data, and diverse effective neural network designs. However, it also brings a heavy computing burden as the amount of training data is proportional to the…

Machine Learning · Computer Science 2023-10-19 Peng Yao , Chao Liao , Jiyuan Jia , Jianchao Tan , Bin Chen , Chengru Song , Di Zhang

Convolutional neural networks excel in a number of computer vision tasks. One of their most crucial architectural elements is the effective receptive field size, that has to be manually set to accommodate a specific task. Standard solutions…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Domen Tabernik , Matej Kristan , Aleš Leonardis

Deep neural nets (DNNs) compression is crucial for adaptation to mobile devices. Though many successful algorithms exist to compress naturally trained DNNs, developing efficient and stable compression algorithms for robustly trained DNNs…

Machine Learning · Computer Science 2020-03-03 Thu Dinh , Bao Wang , Andrea L. Bertozzi , Stanley J. Osher

Deep neural networks (DNNs) have been proven to have many redundancies. Hence, many efforts have been made to compress DNNs. However, the existing model compression methods treat all the input samples equally while ignoring the fact that…

Machine Learning · Computer Science 2018-07-05 Zhisheng Wang , Fangxuan Sun , Jun Lin , Zhongfeng Wang , Bo Yuan

This paper introduces Associative Compression Networks (ACNs), a new framework for variational autoencoding with neural networks. The system differs from existing variational autoencoders (VAEs) in that the prior distribution used to model…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Alex Graves , Jacob Menick , Aaron van den Oord

Recent years have witnessed the success of deep networks in compressed sensing (CS), which allows for a significant reduction in sampling cost and has gained growing attention since its inception. In this paper, we propose a new practical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Bin Chen , Jian Zhang

Pruning the weights of neural networks is an effective and widely-used technique for reducing model size and inference complexity. We develop and test a novel method based on compressed sensing which combines the pruning and training into a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Jonathan W. Siegel , Jianhong Chen , Pengchuan Zhang , Jinchao Xu

Compressed sensing (CS) MRI relies on adequate undersampling of the k-space to accelerate the acquisition without compromising image quality. Consequently, the design of optimal sampling patterns for these k-space coefficients has received…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Ruud J. G. van Sloun

Explainable artificial intelligence (xAI) has gained significant attention in recent years. Among other things, explainablility for deep neural networks has been a topic of intensive research due to the meteoric rise in prominence of deep…

Artificial Intelligence · Computer Science 2026-01-08 Ly Ly Trieu , Tran Cao Son