English
Related papers

Related papers: Butterfly-Net2: Simplified Butterfly-Net and Fouri…

200 papers

Convolutional Neural Networks (CNNs) are pivotal in image classification tasks due to their robust feature extraction capabilities. However, their high computational and memory requirements pose challenges for deployment in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Nathan Isong

Deep neural networks achieve state-of-the-art performance for a range of classification and inference tasks. However, the use of stochastic gradient descent combined with the nonconvexity of the underlying optimization problems renders…

Machine Learning · Computer Science 2020-01-29 Ramina Ghods , Andrew S. Lan , Tom Goldstein , Christoph Studer

Network coding allows distributed information sources such as sensors to efficiently compress and transmit data to distributed receivers across a bandwidth-limited network. Classical network coding is largely task-agnostic -- the coding…

Information Theory · Computer Science 2022-11-02 Jiangnan Cheng , Sandeep Chinchali , Ao Tang

Machine learning as a service has been widely deployed to utilize deep neural network models to provide prediction services. However, this raises privacy concerns since clients need to send sensitive information to servers. In this paper,…

Cryptography and Security · Computer Science 2018-11-21 Shaohua Li , Kaiping Xue , Chenkai Ding , Xindi Gao , David S L Wei , Tao Wan , Feng Wu

A problem with Convolutional Neural Networks (CNNs) is that they require large datasets to obtain adequate robustness; on small datasets, they are prone to overfitting. Many methods have been proposed to overcome this shortcoming with CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Loris Nanni , Michelangelo Paci , Sheryl Brahnam , Alessandra Lumini

We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory…

Machine Learning · Computer Science 2017-12-01 Xiaofan Lin , Cong Zhao , Wei Pan

In this paper, we present an application of 2-D convolutional neural networks (2-D CNNs) designed to perform both feature extraction and classification stages as a single organism to solve the highlighted problems. The method uses a network…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Shahin Ghazvineh , Gholamreza Nouri , Seyed Hossein Hosseini Lavassani , Vahidreza Gharehbaghi , Andy Nguyen

Unsupervised image registration commonly adopts U-Net style networks to predict dense displacement fields in the full-resolution spatial domain. For high-resolution volumetric image data, this process is however resource-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Xi Jia , Joseph Bartlett , Wei Chen , Siyang Song , Tianyang Zhang , Xinxing Cheng , Wenqi Lu , Zhaowen Qiu , Jinming Duan

We present an improved neural field architecture for solving partial differential equations (PDEs). Current physics-informed neural networks (PINNs) provide a flexible framework for solving PDEs, but they struggle to achieve highly accurate…

Machine Learning · Computer Science 2026-05-26 Brandon Zhao , Yixuan Wang , Jonathan T. Barron , Katherine L. Bouman , Dor Verbin , Pratul P. Srinivasan

Two-dimensional Fourier transform plays a significant role in a variety of image processing problems, such as medical image processing, digital holography, correlation pattern recognition, hybrid digital optical processing, optical…

Hardware Architecture · Computer Science 2018-10-17 Atin Mukherjee , Debesh Choudhury

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

Learning convolutional neural networks (CNNs) with low bitwidth is challenging because performance may drop significantly after quantization. Prior arts often discretize the network weights by carefully tuning hyper-parameters of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chaofan Tao , Rui Lin , Quan Chen , Zhaoyang Zhang , Ping Luo , Ngai Wong

Modern Convolutional Neural Networks (CNNs) are complex, encompassing millions of parameters. Their deployment exerts computational, storage and energy demands, particularly on embedded platforms. Existing approaches to prune or sparsify…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Amir H. Ashouri , Tarek S. Abdelrahman , Alwyn Dos Remedios

Distributing quantum state and entanglement between distant nodes is a crucial task in distributed quantum information processing on large-scale quantum networks. Quantum network coding provides an alternative solution for quantum state…

Quantum Physics · Physics 2019-11-05 He Lu , Zheng-Da Li , Xu-Fei Yin , Rui Zhang , Xiao-Xu Fang , Li Li , Nai-Le Liu , Feihu Xu , Yu-Ao Chen , Jian-Wei Pan

Bayesian neural networks (BNNs) have become a principal approach to alleviate overconfident predictions in deep learning, but they often suffer from scaling issues due to a large number of distribution parameters. In this paper, we discover…

Machine Learning · Computer Science 2021-12-14 Shiye Lei , Zhuozhuo Tu , Leszek Rutkowski , Feng Zhou , Li Shen , Fengxiang He , Dacheng Tao

Over four decades, the majority addresses the problem of optical flow estimation using variational methods. With the advance of machine learning, some recent works have attempted to address the problem using convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Tak-Wai Hui , Xiaoou Tang , Chen Change Loy

In this work, we present BasisNet which combines recent advancements in efficient neural network architectures, conditional computation, and early termination in a simple new form. Our approach incorporates a lightweight model to preview…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mingda Zhang , Chun-Te Chu , Andrey Zhmoginov , Andrew Howard , Brendan Jou , Yukun Zhu , Li Zhang , Rebecca Hwa , Adriana Kovashka

Multi-task learning improves generalization performance by sharing knowledge among related tasks. Existing models are for task combinations annotated on the same dataset, while there are cases where multiple datasets are available for each…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Seiichiro Fukuda , Ryota Yoshihashi , Rei Kawakami , Shaodi You , Makoto Iida , Takeshi Naemura

Deep convolutional neural networks (CNNs) are powerful tools for a wide range of vision tasks, but the enormous amount of memory and compute resources required by CNNs pose a challenge in deploying them on constrained devices. Existing…

Machine Learning · Computer Science 2019-10-30 Yiren Zhao , Xitong Gao , Daniel Bates , Robert Mullins , Cheng-Zhong Xu

Convolutional Neural Networks (CNNs) filter the input data using a series of spatial convolution operators with compactly supported stencils and point-wise nonlinearities. Commonly, the convolution operators couple features from all…

Numerical Analysis · Computer Science 2018-10-04 Eran Treister , Lars Ruthotto , Michal Sharoni , Sapir Zafrani , Eldad Haber