English
Related papers

Related papers: Locally Testing Model Detections for Semantic Glob…

200 papers

Concept Bottleneck Models (CBMs) offer interpretable alternatives to black-box predictors by introducing human-relatable concepts before the final output. However, existing CBMs struggle to verify whether predicted concepts correspond to…

Machine Learning · Computer Science 2026-05-15 Yingying Fang , Haijie Xu , Shuang Wu , Mariathasan Anish , Guang Yang

Deep neural networks (DNNs) are at the forefront of cutting-edge technology, and have been achieving remarkable performance in a variety of complex tasks. Nevertheless, their integration into safety-critical systems, such as in the…

Machine Learning · Computer Science 2023-12-29 Natan Levy , Raz Yerushalmi , Guy Katz

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several…

Machine Learning · Computer Science 2021-02-24 Jianlin Li , Pengfei Yang , Jiangchao Liu , Liqian Chen , Xiaowei Huang , Lijun Zhang

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

Machine Learning · Computer Science 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Deep learning (DL) has gained popularity in recent years as an effective tool for classifying the current health and predicting the future of industrial equipment. However, most DL models have black-box components with an underlying…

Machine Learning · Computer Science 2023-08-22 Hao Lu , Austin M. Bray , Chao Hu , Andrew T. Zimmerman , Hongyi Xu

We propose an efficient method to learn deep local descriptors for instance-level recognition. The training only requires examples of positive and negative image pairs and is performed as metric learning of sum-pooled global image…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Giorgos Tolias , Tomas Jenicek , Ondřej Chum

Combining RGB images and the corresponding depth maps in semantic segmentation proves the effectiveness in the past few years. Existing RGB-D modal fusion methods either lack the non-linear feature fusion ability or treat both modal images…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Lizhi Bai , Jun Yang , Chunqi Tian , Yaoru Sun , Maoyu Mao , Yanjun Xu , Weirong Xu

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN models fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma , Mengjie Zhang

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

Machine Learning · Computer Science 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

The design of interpretable deep learning models working in relational domains poses an open challenge: interpretable deep learning methods, such as Concept Bottleneck Models (CBMs), are not designed to solve relational problems, while…

Machine Learning · Computer Science 2024-10-28 Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Recently, Graph Neural Network (GNN)-based vulnerability detection systems have achieved remarkable success. However, the lack of explainability poses a critical challenge to deploy black-box models in security-related domains. For this…

Cryptography and Security · Computer Science 2024-01-29 Sicong Cao , Xiaobing Sun , Xiaoxue Wu , David Lo , Lili Bo , Bin Li , Wei Liu

We present a novel framework for applying deep neural networks (DNN) to soft decoding of linear codes at arbitrary block lengths. Unlike other approaches, our framework allows unconstrained DNN design, enabling the free application of…

Information Theory · Computer Science 2018-02-27 Amir Bennatan , Yoni Choukroun , Pavel Kisilev

Deep Neural Networks (DNNs), with its promising performance, are being increasingly used in safety critical applications such as autonomous driving, cancer detection, and secure authentication. With growing importance in deep learning,…

Machine Learning · Computer Science 2019-11-19 Senthil Mani , Anush Sankaran , Srikanth Tamilselvam , Akshay Sethi

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

Semantic segmentation requires a detailed labeling of image pixels by object category. Information derived from local image patches is necessary to describe the detailed shape of individual objects. However, this information is ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Hexiang Hu , Zhiwei Deng , Guang-Tong Zhou , Fei Sha , Greg Mori

Large multimodal models (LMMs) combine unimodal encoders and large language models (LLMs) to perform multimodal tasks. Despite recent advancements towards the interpretability of these models, understanding internal representations of LMMs…

Machine Learning · Computer Science 2024-12-03 Jayneel Parekh , Pegah Khayatan , Mustafa Shukor , Alasdair Newson , Matthieu Cord

Large Language Models (LLMs) possess vast amounts of knowledge within their parameters, prompting research into methods for locating and editing this knowledge. Previous work has largely focused on locating entity-related (often…

Computation and Language · Computer Science 2026-05-08 Lihu Chen , Adam Dejl , Francesca Toni

Explaining the output of a complicated machine learning model like a deep neural network (DNN) is a central challenge in machine learning. Several proposed local explanation methods address this issue by identifying what dimensions of a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Julius Adebayo , Justin Gilmer , Ian Goodfellow , Been Kim

High-density object counting in surveillance scenes is challenging mainly due to the drastic variation of object scales. The prevalence of deep learning has largely boosted the object counting accuracy on several benchmark datasets.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Muming Zhao , Jian Zhang , Chongyang Zhang , Wenjun Zhang