English
Related papers

Related papers: Depth-13 Sorting Networks for 28 Channels

200 papers

Recent advances in deep neural networks (DNNs) lead to tremendously growing network parameters, making the deployments of DNNs on platforms with limited resources extremely difficult. Therefore, various pruning methods have been developed…

Machine Learning · Computer Science 2020-05-22 Yucong Shen , Li Shen , Hao-Zhi Huang , Xuan Wang , Wei Liu

Depth separation results propose a possible theoretical explanation for the benefits of deep neural networks over shallower architectures, establishing that the former possess superior approximation capabilities. However, there are no known…

Machine Learning · Computer Science 2023-02-03 Itay Safran , Jason D. Lee

This work proposes deep network models and learning algorithms for unsupervised and supervised binary hashing. Our novel network design constrains one hidden layer to directly output the binary codes. This addresses a challenging issue in…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Thanh-Toan Do , Anh-Dzung Doan , Ngai-Man Cheung

We consider the task of detecting a salient cluster in a sensor network, that is, an undirected graph with a random variable attached to each node. Motivated by recent research in environmental statistics and the drive to compete with the…

Statistics Theory · Mathematics 2013-03-22 Ery Arias-Castro , Geoffrey R. Grimmett

In this paper, we propose a novel multi-task learning method based on the deep convolutional network. The proposed deep network has four convolutional layers, three max-pooling layers, and two parallel fully connected layers. To adjust the…

Machine Learning · Computer Science 2019-04-17 Fang Su , Hai-Yang Shang , Jing-Yan Wang

A common approach for compressing NLP networks is to encode the embedding layer as a matrix $A\in\mathbb{R}^{n\times d}$, compute its rank-$j$ approximation $A_j$ via SVD, and then factor $A_j$ into a pair of matrices that correspond to…

Machine Learning · Computer Science 2020-10-12 Alaa Maalouf , Harry Lang , Daniela Rus , Dan Feldman

When imaging through a semi-reflective medium such as glass, the reflection of another scene can often be found in the captured images. It degrades the quality of the images and affects their subsequent analyses. In this paper, a novel deep…

Image and Video Processing · Electrical Eng. & Systems 2022-08-11 Tingtian Li , Yuk-Hee Chan , Daniel P. K. Lun

Model compression has gained significant popularity as a means to alleviate the computational and memory demands of machine learning models. Each compression technique leverages unique features to reduce the size of neural networks.…

Machine Learning · Computer Science 2024-08-20 Yingtao Shen , Minqing Sun , Jianzhe Lin , Jie Zhao , An Zou

We present three multi-scale similarity learning architectures, or DeepSim networks. These models learn pixel-level matching with a contrastive loss and are agnostic to the geometry of the considered scene. We establish a middle ground…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mohamed Ali Chebbi , Ewelina Rupnik , Marc Pierrot-Deseilligny , Paul Lopes

Recent works have highlighted scale invariance or symmetry present in the weight space of a typical deep network and the adverse effect it has on the Euclidean gradient based stochastic gradient descent optimization. In this work, we show…

Machine Learning · Computer Science 2015-11-04 Vijay Badrinarayanan , Bamdev Mishra , Roberto Cipolla

We introduce a novel technique for designing color filter metasurfaces using a data-driven approach based on deep learning. Our innovative approach employs inverse design principles to identify highly efficient designs that outperform all…

The feed-forward architectures of recently proposed deep super-resolution networks learn representations of low-resolution inputs, and the non-linear mapping from those to high-resolution output. However, this approach does not fully…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Muhammad Haris , Greg Shakhnarovich , Norimichi Ukita

Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of neural networks. There has been a flurry of algorithms that try to solve this practical problem, each being claimed effective in some ways. Yet, a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Yawei Li , Kamil Adamczewski , Wen Li , Shuhang Gu , Radu Timofte , Luc Van Gool

Deep neural networks have demonstrated state-of-the-art performance in a variety of real-world applications. In order to obtain performance gains, these networks have grown larger and deeper, containing millions or even billions of…

Machine Learning · Computer Science 2018-02-27 Wenqi Wang , Yifan Sun , Brian Eriksson , Wenlin Wang , Vaneet Aggarwal

This paper presents a novel compressed sensing (CS) approach to high dimensional wireless channel estimation by optimizing the input to a deep generative network. Channel estimation using generative networks relies on the assumption that…

Signal Processing · Electrical Eng. & Systems 2020-06-25 Eren Balevi , Akash Doshi , Ajil Jalal , Alexandros Dimakis , Jeffrey G. Andrews

A family of super deep networks, referred to as residual networks or ResNet, achieved record-beating performance in various visual tasks such as image recognition, object detection, and semantic segmentation. The ability to train very deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Xin Yu , Zhiding Yu , Srikumar Ramalingam

This paper proposes a novel model for the rating prediction task in recommender systems which significantly outperforms previous state-of-the art models on a time-split Netflix data set. Our model is based on deep autoencoder with 6 layers…

Machine Learning · Statistics 2017-10-12 Oleksii Kuchaiev , Boris Ginsburg

We use convolutional neural networks to recover images optically down-sampled by $6.7\times$ using coherent aperture synthesis over a 16 camera array. Where conventional ptychography relies on scanning and oversampling, here we apply…

Image and Video Processing · Electrical Eng. & Systems 2022-02-09 Chengyu Wang , Minghao Hu , Yuzuru Takashima , Timothy J. Schulz , David J. Brady

Coherent network error correction is the error-control problem in network coding with the knowledge of the network codes at the source and sink nodes. With respect to a given set of local encoding kernels defining a linear network code, we…

Information Theory · Computer Science 2013-01-01 Shenghao Yang , Raymond W. Yeung , Chi-Kin Ngai

It has been shown that perfectly trained networks exhibit drastic reduction in performance when presented with distorted images. Streaming Network (STNet) is a novel architecture capable of robust classification of the distorted images…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Sergey Tarasenko