English
Related papers

Related papers: Gradient entropy (GradEn): The two dimensional ver…

200 papers

The Graph Convolutional Networks (GCN) proposed by Kipf and Welling is an effective model for semi-supervised learning, but faces the obstacle of over-smoothing, which will weaken the representation ability of GCN. Recently some works are…

Machine Learning · Computer Science 2022-05-20 Xue Liu , Dan Sun , Wei Wei

The von Neumann graph entropy is a measure of graph complexity based on the Laplacian spectrum. It has recently found applications in various learning tasks driven by networked data. However, it is computational demanding and hard to…

Social and Information Networks · Computer Science 2022-01-07 Xuecheng Liu , Luoyi Fu , Xinbing Wang , Chenghu Zhou

The explication of Convolutional Neural Networks (CNN) through xAI techniques often poses challenges in interpretation. The inherent complexity of input features, notably pixels extracted from images, engenders complex correlations.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Caroline Mazini Rodrigues , Nicolas Boutry , Laurent Najman

This paper proposes a new probabilistic non-extensive entropy feature for texture characterization, based on a Gaussian information measure. The highlights of the new entropy are that it is bounded by finite limits and that it is non…

Computer Vision and Pattern Recognition · Computer Science 2016-03-09 Seba Susan , Madasu Hanmandlu

Low-light image enhancement aims to improve an image's visibility while keeping its visual naturalness. Different from existing methods tending to accomplish the relighting task directly by ignoring the fidelity and naturalness recovery, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Kui Jiang , Zhongyuan Wang , Zheng Wang , Chen Chen , Peng Yi , Tao Lu , Chia-Wen Lin

Claude Shannon coined entropy to quantify the uncertainty of a random distribution for communication coding theory. We observe that the uncertainty nature of entropy also limits its direct usage in mathematical modeling. Therefore we…

Information Theory · Computer Science 2023-04-26 Arthur Jun Zhang

As a training and analysis strategy for convolutional neural networks (CNNs), we slice images into tiled segments and use, for training and prediction, segments that both satisfy a criterion of information diversity and contain sufficient…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Steven J. Frank , Andrea M. Frank

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of entropy, primarily…

Machine Learning · Computer Science 2024-04-22 Olga Cherednichenko , Dmytro Chernyshov , Dmytro Sytnikov , Polina Sytnikova

Texture recognition is a fundamental problem in computer vision and pattern recognition. Recent progress leverages feature aggregation into discriminative descriptions based on convolutional neural networks (CNNs). However, modeling…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Bo Peng , Jintao Chen , Mufeng Yao , Chenhao Zhang , Jianghui Zhang , Mingmin Chi , Jiang Tao

Quantifying the complexity of large graphs requires measures that extend beyond predefined structural features and scale efficiently with graph size. This work adopts a generative perspective, modeling large networks as exchangeable graphs…

Information Theory · Computer Science 2025-03-14 Anda Skeja , Sofia C. Olhede

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

Smoothing methods find signals in noisy data. A challenge for Statistical inference is the choice of smoothing parameter. SiZer addressed this challenge in one-dimension by detecting significant slopes across multiple scales, but was not a…

Statistics Theory · Mathematics 2025-11-03 Rui Liu , Jan Hannig , J. S. Marron

Estimating depth from a single RGB image is an ill-posed and inherently ambiguous problem. State-of-the-art deep learning methods can now estimate accurate 2D depth maps, but when the maps are projected into 3D, they lack local detail and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Jun Li , Reinhard Klein , Angela Yao

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 S. K. Katiyar , P. V. Arun

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu

In this paper we propose a score of an image to use for coreset selection in image classification and semantic segmentation tasks. The score is the entropy of an image as approximated by the bits-per-pixel of its compressed version. Thus…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Raghavendra Singh

The problem of active mapping aims to plan an informative sequence of sensing views given a limited budget such as distance traveled. This paper consider active occupancy grid mapping using a range sensor, such as LiDAR or depth camera.…

Robotics · Computer Science 2022-04-19 Arash Asgharivaskasi , Shumon Koga , Nikolay Atanasov

Entropy measures are effective features for time series classification problems. Traditional entropy measures, such as Shannon entropy, use probability distribution function. However, for the effective separation of time series, new entropy…

Machine Learning · Computer Science 2023-05-19 Andrei Velichko , Maksim Belyaev , Yuriy Izotov , Murugappan Murugappan , Hanif Heidari

Image forensics has become increasingly crucial in our daily lives. Among various types of forgeries, copy-move forgery detection has received considerable attention within the academic community. Keypoint-based algorithms, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Li Jiang , Zhaowei Lu