English
Related papers

Related papers: Information-Bottleneck Driven Binary Neural Networ…

200 papers

Information bottleneck is an information-theoretic principle of representation learning that aims to learn a maximally compressed representation that preserves as much information about labels as possible. Under this principle, two…

Information Theory · Computer Science 2023-11-08 Yuyan Ni , Yanyan Lan , Ao Liu , Zhiming Ma

Binary Code Similarity Detection (BCSD) plays a crucial role in numerous fields, including vulnerability detection, malware analysis, and code reuse identification. As IoT devices proliferate and rapidly evolve, their highly heterogeneous…

Software Engineering · Computer Science 2024-10-25 Xiuwei Shang , Li Hu , Shaoyin Cheng , Guoqiang Chen , Benlong Wu , Weiming Zhang , Nenghai Yu

Concept Bottleneck Models (CBMs) aim to deliver interpretable predictions by routing decisions through a human-understandable concept layer, yet they often suffer reduced accuracy and concept leakage that undermines faithfulness. We…

Machine Learning · Computer Science 2026-02-17 Karim Galliamov , Syed M Ahsan Kazmi , Adil Khan , Adín Ramírez Rivera

It is challenging to bridge the performance gap between Binary CNN (BCNN) and Floating point CNN (FCNN). We observe that, this performance gap leads to substantial residuals between intermediate feature maps of BCNN and FCNN. To minimize…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Jianming Ye , Shiliang Zhang , Jingdong Wang

Binary Neural Networks (BNNs), known to be one among the effectively compact network architectures, have achieved great outcomes in the visual tasks. Designing efficient binary architectures is not trivial due to the binary nature of the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Hai Phan , Zechun Liu , Dang Huynh , Marios Savvides , Kwang-Ting Cheng , Zhiqiang Shen

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

Machine Learning · Computer Science 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

Existing part-aware person re-identification methods typically employ two separate steps: namely, body part detection and part-level feature extraction. However, part detection introduces an additional computational cost and is inherently…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Kan Wang , Pengfei Wang , Changxing Ding , Dacheng Tao

Deep neural networks (DNNs) have demonstrated remarkable performance across various domains, but their inherent complexity makes them challenging to interpret. This is especially true for temporal graph regression tasks due to the complex…

Machine Learning · Computer Science 2025-12-30 Ali Royat , Seyed Mohamad Moghadas , Lesley De Cruz , Adrian Munteanu

Dendrites are crucial structures for computation of an individual neuron. It has been shown that the dynamics of a biological neuron with dendrites can be approximated by artificial neural networks (ANN) with deep structure. However, it…

Neurons and Cognition · Quantitative Biology 2023-05-23 Jingyang Ma , Songting Li , Douglas Zhou

Many approaches for verifying input-output properties of neural networks have been proposed recently. However, existing algorithms do not scale well to large networks. Recent work in the field of model compression studied binarized neural…

Machine Learning · Computer Science 2022-03-15 Christopher Lazarus , Mykel J. Kochenderfer

Traditional network embedding primarily focuses on learning a continuous vector representation for each node, preserving network structure and/or node content information, such that off-the-shelf machine learning algorithms can be easily…

Social and Information Networks · Computer Science 2023-01-02 Daokun Zhang , Jie Yin , Xingquan Zhu , Chengqi Zhang

Change detection encompasses a variety of task types, and the goal of building change detection (BCD) tasks is to accurately locate buildings and distinguish changed building areas. In recent years, various deep learning-based BCD methods…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 ChengMing Wang

We address the question of characterizing and finding optimal representations for supervised learning. Traditionally, this question has been tackled using the Information Bottleneck, which compresses the inputs while retaining information…

Machine Learning · Computer Science 2021-07-19 Yann Dubois , Douwe Kiela , David J. Schwab , Ramakrishna Vedantam

In this study, we proposed a model for skin disease classification using a Bilinear Convolutional Neural Network (BCNN) with a Constrained Triplet Network (CTN). BCNN can capture rich spatial interactions between features in image data.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Belal Ahmad , Mohd Usama , Tanvir Ahmad , Adnan Saeed , Shabnam Khatoon , Long Hu

Due to the superior performance of Graph Neural Networks (GNNs) in various domains, there is an increasing interest in the GNN explanation problem "\emph{which fraction of the input graph is the most crucial to decide the model's…

Machine Learning · Computer Science 2022-07-04 Qinghua Zheng , Jihong Wang , Minnan Luo , Yaoliang Yu , Jundong Li , Lina Yao , Xiaojun Chang

Camouflaged object detection (COD) aims to identify objects in images that are well hidden in the environment due to their high similarity to the background in terms of texture and color. However, existing most boundary-guided camouflage…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Junmin Cai , Han Sun , Ningzhong Liu

The information bottleneck (IB) approach is popular to improve the generalization, robustness and explainability of deep neural networks. Essentially, it aims to find a minimum sufficient representation $\mathbf{t}$ by striking a trade-off…

Machine Learning · Computer Science 2024-04-30 Shujian Yu , Xi Yu , Sigurd Løkse , Robert Jenssen , Jose C. Principe

Driveable area detection is a key component for various applications in the field of autonomous driving (AD), such as ground-plane detection, obstacle detection and maneuver planning. Additionally, bulky and over-parameterized networks can…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Alexander Frickenstein , Manoj Rohit Vemparala , Jakob Mayr , Naveen Shankar Nagaraja , Christian Unger , Federico Tombari , Walter Stechele

How to effectively approximate real-valued parameters with binary codes plays a central role in neural network binarization. In this work, we reveal an important fact that binarizing different layers has a widely-varied effect on the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Lixue Zhuang , Yi Xu , Bingbing Ni , Hongteng Xu

Real-world image recognition is often challenged by the variability of visual styles including object textures, lighting conditions, filter effects, etc. Although these variations have been deemed to be implicitly handled by more training…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Hyeonseob Nam , Hyo-Eun Kim