中文
相关论文

相关论文: Designed Dithering Sign Activation for Binary Neur…

200 篇论文

Binary Neural Networks (BNNs) have emerged as a promising solution for reducing the memory footprint and compute costs of deep neural networks, but they suffer from quality degradation due to the lack of freedom as activations and weights…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Changhun Lee , Hyungjun Kim , Eunhyeok Park , Jae-Joon Kim

A variety of deep neural network (DNN)-based image denoising methods have been proposed for use with medical images. These methods are typically trained by minimizing loss functions that quantify a distance between the denoised image, or a…

图像与视频处理 · 电气工程与系统科学 2022-11-28 Kaiyan Li , Hua Li , Mark A. Anastasio

We propose methods to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models that are specifically friendly to mobile devices with limited power capacity and computation…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Peng Chen , Lingqiao Liu , Ian Reid

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time and when computing the parameters' gradient at train-time. We conduct two sets of experiments, each based on a…

机器学习 · 计算机科学 2016-03-11 Itay Hubara , Daniel Soudry , Ran El Yaniv

Traffic signs support road safety and managing the flow of traffic, hence are an integral part of any vision system for autonomous driving. While the use of deep learning is well-known in traffic signs classification due to the high…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Andreea Postovan , Mădălina Eraşcu

Binary optimization, a representative subclass of discrete optimization, plays an important role in mathematical optimization and has various applications in computer vision and machine learning. Usually, binary optimization problems are…

最优化与控制 · 数学 2021-05-18 Huan Xiong , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

Supervised hashing aims to map the original features to compact binary codes that are able to preserve label based similarity in the Hamming space. Non-linear hash functions have demonstrated the advantage over linear ones due to their…

计算机视觉与模式识别 · 计算机科学 2016-11-17 Guosheng Lin , Chunhua Shen , Qinfeng Shi , Anton van den Hengel , David Suter

Deep neural networks can suffer from the exploding and vanishing activation problem, in which the networks fail to train properly because the neural signals either amplify or attenuate across the layers and become saturated. While other…

机器学习 · 计算机科学 2021-08-24 Hao-Yuan Chang , Kang L. Wang

In this article, we establish a precise connection between binarized neural networks (BNNs) and Sugeno integrals. The advantage of the Sugeno integral is that it provides a framework for representing the importance of inputs and their…

人工智能 · 计算机科学 2026-04-21 Ismaïl Baaj , Henri Prade

Compact neural networks are essential for affordable and power efficient deep learning solutions. Binary Neural Networks (BNNs) take compactification to the extreme by constraining both weights and activations to two levels, $\{+1, -1\}$.…

机器学习 · 计算机科学 2020-06-16 Vishnu Raj , Nancy Nayak , Sheetal Kalyani

Vision Transformers (ViTs) have emerged as the fundamental architecture for most computer vision fields, but the considerable memory and computation costs hinders their application on resource-limited devices. As one of the most powerful…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Junrui Xiao , Zhikai Li , Lianwei Yang , Qingyi Gu

Blind image deblurring remains a topic of enduring interest. Learning based approaches, especially those that employ neural networks have emerged to complement traditional model based methods and in many cases achieve vastly enhanced…

图像与视频处理 · 电气工程与系统科学 2019-05-30 Yuelong Li , Mohammad Tofighi , Junyi Geng , Vishal Monga , Yonina C. Eldar

For binary neural networks (BNNs) to become the mainstream on-device computer vision algorithm, they must achieve a superior speed-vs-accuracy tradeoff than 8-bit quantization and establish a similar degree of general applicability in…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Guhong Nie , Lirui Xiao , Menglong Zhu , Dongliang Chu , Yue Shen , Peng Li , Kang Yang , Li Du , Bo Chen

Binary Neural Networks (BNNs) show promising progress in reducing computational and memory costs but suffer from substantial accuracy degradation compared to their real-valued counterparts on large-scale datasets, e.g., ImageNet. Previous…

机器学习 · 计算机科学 2019-06-21 Joseph Bethge , Haojin Yang , Marvin Bornstein , Christoph Meinel

Numerous methods have been proposed to transform color and grayscale images to their single bit-per-pixel binary counterparts. Commonly, the goal is to enhance specific attributes of the original image to make it more amenable for analysis.…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Shumeet Baluja

Applications of Binary Neural Networks (BNNs) are promising for embedded systems with hard constraints on computing power. Contrary to conventional neural networks with the floating-point datatype, BNNs use binarized weights and activations…

新兴技术 · 计算机科学 2022-11-14 Mahdi Zahedi , Taha Shahroodi , Stephan Wong , Said Hamdioui

Quasi-bimodal objects, such as text, road signs, and barcodes, play a basic yet vital role in daily visual communication. By boiling these down to clear silhouettes, binarization uses a minimal language to convey essential vision cues for…

图像与视频处理 · 电气工程与系统科学 2026-05-19 Pei Zhang , Shijie Lin , Zhou Ge , Jinpeng Chen , Wei Pu

Accelerating deep neural network (DNN) inference on resource-limited devices is one of the most important barriers to ensuring a wider and more inclusive adoption. To alleviate this, DNN binary quantization for faster convolution and memory…

机器学习 · 计算机科学 2021-08-24 Meshia Cédric Oveneke

This work presents an adaptive activation method for neural networks that exploits the interdependency of features. Each pixel, node, and layer is assigned with a polynomial activation function, whose coefficients are provided by an…

计算机视觉与模式识别 · 计算机科学 2018-11-22 Jinhyeok Jang , Jaehong Kim , Jaeyeon Lee , Seungjoon Yang

Signal decomposition is a classical problem in signal processing, which aims to separate an observed signal into two or more components each with its own property. Usually each component is described by its own subspace or dictionary.…

计算机视觉与模式识别 · 计算机科学 2018-12-27 Shervin Minaee , Yao Wang