English
Related papers

Related papers: Memory-efficient deep end-to-end posterior network…

200 papers

With the goal of recovering high-quality image content from its degraded version, image restoration enjoys numerous applications, such as in surveillance, computational photography, medical imaging, and remote sensing. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Syed Waqas Zamir , Aditya Arora , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang , Ling Shao

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

Magnetic Resonance Imaging allows high resolution data acquisition with the downside of motion sensitivity due to relatively long acquisition times. Even during the acquisition of a single 2D slice, motion can severely corrupt the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Mathias S. Feinler , Bernadette N. Hahn

Normalization techniques are important in different advanced neural networks and different tasks. This work investigates a novel dynamic learning-to-normalize (L2N) problem by proposing Exemplar Normalization (EN), which is able to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Ruimao Zhang , Zhanglin Peng , Lingyun Wu , Zhen Li , Ping Luo

Ensemble learning is a meta-learning approach that combines the predictions of multiple learners, demonstrating improved accuracy and robustness. Nevertheless, ensembling models like Convolutional Neural Networks (CNNs) result in high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Le Zhang , Onat Gungor , Flavio Ponzina , Tajana Rosing

Most traditional algorithms for compressive sensing image reconstruction suffer from the intensive computation. Recently, deep learning-based reconstruction algorithms have been reported, which dramatically reduce the time complexity than…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Hantao Yao , Feng Dai , Dongming Zhang , Yike Ma , Shiliang Zhang , Yongdong Zhang , Qi Tian

In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation).…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xenju Xu , Guanghui Wang , Alan Sullivan , Ziming Zhang

Deep learning has shown successful application in visual recognition and certain artificial intelligence tasks. Deep learning is also considered as a powerful tool with high flexibility to approximate functions. In the present work,…

Machine Learning · Computer Science 2021-12-23 Ayan Chakraborty , Thomas Wick , Xiaoying Zhuang , Timon Rabczuk

In the realm of image processing and computer vision (CV), machine learning (ML) architectures are widely applied. Convolutional neural networks (CNNs) solve a wide range of image processing issues and can solve image compression problem.…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Sonain Jamil , Md. Jalil Piran , MuhibUrRahman

In compressed sensing MRI (CS-MRI), k-space measurements are under-sampled to achieve accelerated scan times. CS-MRI presents two fundamental problems: (1) where to sample and (2) how to reconstruct an under-sampled scan. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Cagla D. Bahadir , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

End-to-end (E2E) automatic speech recognition (ASR) with sequence-to-sequence models has gained attention because of its simple model training compared with conventional hidden Markov model based ASR. Recently, several studies report the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-21 Yuya Fujita , Aswin Shanmugam Subramanian , Motoi Omachi , Shinji Watanabe

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Tiny deep learning on microcontroller units (MCUs) is challenging due to the limited memory size. We find that the memory bottleneck is due to the imbalanced memory distribution in convolutional neural network (CNN) designs: the first…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ji Lin , Wei-Ming Chen , Han Cai , Chuang Gan , Song Han

The non-uniform sampling is a powerful approach to enable fast acquisition but requires sophisticated reconstruction algorithms. Faithful reconstruction from partial sampled exponentials is highly expected in general signal processing and…

Leveraging powerful deep learning techniques, the end-to-end (E2E) learning of communication system is able to outperform the classical communication system. Unfortunately, this communication system cannot be trained by deep learning…

Information Theory · Computer Science 2022-04-04 Hao Jiang , Shuangkaisheng Bi , Linglong Dai , Hao Wang , Jiankun Zhang

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Wenjie Kang , Lize Jiskoot , Peter De Deyn , Geert Biessels , Huiberdina Koek , Jurgen Claassen , Huub Middelkoop , Wiesje Flier , Willemijn J. Jansen , Stefan Klein , Esther Bron

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He