English
Related papers

Related papers: Finding Non-Uniform Quantization Schemes using Mul…

200 papers

The performance of multi-task learning in Convolutional Neural Networks (CNNs) hinges on the design of feature sharing between tasks within the architecture. The number of possible sharing patterns are combinatorial in the depth of the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Felix J. S. Bragman , Ryutaro Tanno , Sebastien Ourselin , Daniel C. Alexander , M. Jorge Cardoso

Convolutional Neural Networks (CNNs) have shown to be powerful classification tools in tasks that range from check reading to medical diagnosis, reaching close to human perception, and in some cases surpassing it. However, the problems to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-08 Jose Marques , Gabriel Falcao , Luís A. Alexandre

Convolutional neural networks require significant memory bandwidth and storage for intermediate computations, apart from substantial computing resources. Neural network quantization has significant benefits in reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Ron Banner , Yury Nahshan , Elad Hoffer , Daniel Soudry

Machine learning models deployed on medical imaging tasks must be equipped with out-of-distribution detection capabilities in order to avoid erroneous predictions. It is unsure whether out-of-distribution detection models reliant on deep…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sebastian G. Popescu , David J. Sharp , James H. Cole , Konstantinos Kamnitsas , Ben Glocker

Depth factorization and quantization have emerged as two of the principal strategies for designing efficient deep convolutional neural network (CNN) architectures tailored for low-power inference on the edge. However, there is still little…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Stone Yun , Alexander Wong

Although weight and activation quantization is an effective approach for Deep Neural Network (DNN) compression and has a lot of potentials to increase inference speed leveraging bit-operations, there is still a noticeable gap in terms of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Dongqing Zhang , Jiaolong Yang , Dongqiangzi Ye , Gang Hua

Incomplete multi-view clustering has become one of the important research problems due to the extensive missing multi-view data in the real world. Although the existing methods have made great progress, there are still some problems: 1)…

Machine Learning · Computer Science 2025-02-27 Guoqing Chao , Kaixin Xu , Xijiong Xie , Yongyong Chen

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Fully convolutional U-shaped neural networks have largely been the dominant approach for pixel-wise image segmentation. In this work, we tackle two defects that hinder their deployment in real-world applications: 1) Predictions lack…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Martin Ferianc , Divyansh Manocha , Hongxiang Fan , Miguel Rodrigues

Cascade prediction aims at modeling information diffusion in the network. Most previous methods concentrate on mining either structural or sequential features from the network and the propagation path. Recent efforts devoted to combining…

Machine Learning · Computer Science 2021-12-08 Yansong Wang , Xiaomeng Wang , Tao Jia

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

While offering a principled framework for uncertainty quantification in deep learning, the employment of Bayesian Neural Networks (BNNs) is still constrained by their increased computational requirements and the convergence difficulties…

Machine Learning · Computer Science 2025-05-26 Moule Lin , Shuhao Guan , Weipeng Jing , Goetz Botterweck , Andrea Patane

Neural Architecture Search (NAS) has been quite successful in constructing state-of-the-art models on a variety of tasks. Unfortunately, the computational cost can make it difficult to scale. In this paper, we make the first attempt to…

Machine Learning · Computer Science 2019-11-18 Albert Shaw , Wei Wei , Weiyang Liu , Le Song , Bo Dai

Image classification is a fundamental task in computer vision with diverse applications, ranging from autonomous systems to medical imaging. The CIFAR-10 dataset is a widely used benchmark to evaluate the performance of classification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

Machine Learning · Computer Science 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis

Recent studies using four-point correlations suggest a parity violation in the galaxy distribution, though the significance of these detections is sensitive to the choice of simulation used to model the noise properties of the galaxy…

Instrumentation and Methods for Astrophysics · Physics 2024-05-24 Matthew Craigie , Peter L. Taylor , Yuan-Sen Ting , Carolina Cuesta-Lazaro , Rossana Ruggeri , Tamara M. Davis

There is a constant need for high-performing and computationally efficient neural network models for image super-resolution: computationally efficient models can be used via low-capacity devices and reduce carbon footprints. One way to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Egor Shvetsov , Dmitry Osin , Alexey Zaytsev , Ivan Koryakovskiy , Valentin Buchnev , Ilya Trofimov , Evgeny Burnaev

Classical neural networks with random initialization famously behave as Gaussian processes in the limit of many neurons, which allows one to completely characterize their training and generalization behavior. No such general understanding…

Quantum Physics · Physics 2025-02-07 Eric R. Anschuetz

Current model quantization methods have shown their promising capability in reducing storage space and computation complexity. However, due to the diversity of quantization forms supported by different hardware, one limitation of existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Ke Xu , Lei Han , Ye Tian , Shangshang Yang , Xingyi Zhang