English
Related papers

Related papers: GAAF: Searching Activation Functions for Binary Ne…

200 papers

Binarized Neural Networks (BNNs) can significantly reduce the inference latency and energy consumption in resource-constrained devices due to their pure-logical computation and fewer memory accesses. However, training BNNs is difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Ruizhou Ding , Ting-Wu Chin , Zeye Liu , Diana Marculescu

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

Machine Learning · Computer Science 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

Binary convolutional neural networks (BCNNs) provide a potential solution to reduce the memory requirements and computational costs associated with deep neural networks (DNNs). However, achieving a trade-off between performance and…

Machine Learning · Computer Science 2024-05-15 Po-Hsun Chu , Ching-Han Chen

Binary Neural Networks (BNNs) can significantly accelerate the inference time of a neural network by replacing its expensive floating-point arithmetic with bitwise operations. Most existing solutions, however, do not fully optimize data…

Machine Learning · Computer Science 2023-04-04 L. Vorabbi , D. Maltoni , S. Santi

Binary neural networks leverage $\mathrm{Sign}$ function to binarize weights and activations, which require gradient estimators to overcome its non-differentiability and will inevitably bring gradient errors during backpropagation. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yefei He , Luoming Zhang , Weijia Wu , Hong Zhou

In recent years, machine learning has seen an increasing presencein a large variety of fields, especially in health care and bioinformatics.More specifically, the field where machine learning algorithms have found most applications is…

Neural and Evolutionary Computing · Computer Science 2020-08-21 Mekaal Swerhun , Jasmine Foley , Brandon Massop , Vijay Mago

In massive multi-input multi-output (MIMO) systems, the main bottlenecks of location- and orientation-assisted beam alignment using deep neural networks (DNNs) are large training overhead and significant performance degradation. This paper…

Signal Processing · Electrical Eng. & Systems 2026-01-21 Yuzhu Lei , Qiqi Xiao , Yinghui He , Guanding Yu

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

For binary neural networks (BNNs) to become the mainstream on-device computer vision algorithm, they must achieve a superior speed-vs-accuracy tradeoff than 8-bit quantization and establish a similar degree of general applicability in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Guhong Nie , Lirui Xiao , Menglong Zhu , Dongliang Chu , Yue Shen , Peng Li , Kang Yang , Li Du , Bo Chen

Anomaly detection is a critical challenge across various research domains, aiming to identify instances that deviate from normal data distributions. This paper explores the application of Generative Adversarial Networks (GANs) in fraud…

Machine Learning · Computer Science 2024-02-16 Mengran Zhu , Yulu Gong , Yafei Xiang , Hanyi Yu , Shuning Huo

Generative adversarial networks (GANs) are able to model the complex highdimensional distributions of real-world data, which suggests they could be effective for anomaly detection. However, few works have explored the use of GANs for the…

Machine Learning · Computer Science 2019-05-03 Houssam Zenati , Chuan Sheng Foo , Bruno Lecouat , Gaurav Manek , Vijay Ramaseshan Chandrasekhar

Recently, more and more works have proposed to drive evolutionary algorithms using machine learning models.Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

Neural and Evolutionary Computing · Computer Science 2020-04-08 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

Network architecture search (NAS) achieves state-of-the-art results in various tasks such as classification and semantic segmentation. Recently, a reinforcement learning-based approach has been proposed for Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Sivan Doveh , Raja Giryes

Active Appearance Models (AAMs) are a well-established technique for fitting deformable models to images, but they are limited by linear appearance assumptions and can struggle with complex variations. In this paper, we explore if the AAM…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Anurag Awasthi

Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, we observe that the…

Machine Learning · Computer Science 2021-04-13 Hanchen Wang , Defu Lian , Ying Zhang , Lu Qin , Xiangjian He , Yiguang Lin , Xuemin Lin

Efficient inference of Deep Neural Networks (DNNs) is essential to making AI ubiquitous. Two important algorithmic techniques have shown promise for enabling efficient inference - sparsity and binarization. These techniques translate into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Sachit Kuhar , Alexey Tumanov , Judy Hoffman

Modern hardware design trends have shifted towards specialized hardware acceleration for computationally intensive tasks like machine learning and computer vision. While these complex workloads can be accelerated by commercial GPUs,…

Hardware Architecture · Computer Science 2021-08-06 Caleb Terrill , Fred Chu

Generative Adversarial Networks (GANs) have shown impressive results in various image synthesis tasks. Vast studies have demonstrated that GANs are more powerful in feature and expression learning compared to other generative models and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Omar De Mitri , Ruyu Wang , Marco F. Huber

Dense prediction is a critical task in computer vision. However, previous methods often require extensive computational resources, which hinders their real-world application. In this paper, we propose BiDense, a generalized binary neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Rui Yin , Haotong Qin , Yulun Zhang , Wenbo Li , Yong Guo , Jianjun Zhu , Cheng Wang , Biao Jia

Unraveling the complexities of Gene Regulatory Networks (GRNs) is crucial for understanding cellular processes and disease mechanisms. Traditional computational methods often struggle with the dynamic nature of these networks. This study…

Machine Learning · Computer Science 2025-03-04 Hakan T. Otal , Abdulhamit Subasi , Furkan Kurt , M. Abdullah Canbaz , Yasin Uzun