English
Related papers

Related papers: Applying information theory and entropy to elimina…

200 papers

In this paper we develop the concept of information transfer between the Borel-measurable sets for a dynamical system described by a measurable space and a non-singular transformation. The concept is based on how Shannon entropy is…

Systems and Control · Electrical Eng. & Systems 2019-10-01 Subhrajit Sinha , Umesh Vaidya , Enoch Yeung

Reliable data-driven estimation of Shannon entropy from small data sets, where the number of examples is potentially smaller than the number of possible outcomes, is a critical matter in several applications. In this paper, we introduce a…

Machine Learning · Computer Science 2025-12-12 Gabriel F. A. Bastos , Jugurta Montalvão

Information theory has been taken as a prospective tool for quantifying the complexity of complex networks. In this paper, we first study the information entropy or uncertainty of a path using the information theory. Then we apply the path…

Physics and Society · Physics 2016-05-04 Zhongqi Xu , Cunlai Pu , Jian Yang

In this paper have written the results of the information analysis of structures. The obtained information estimation (IE) are based on an entropy measure of C. Shannon. Obtained IE is univalent both for the non-isomorphic and for the…

Information Theory · Computer Science 2007-07-16 Alexander Shaydurov

Shannon Entropy is the preeminent tool for measuring the level of uncertainty (and conversely, information content) in a random variable. In the field of communications, entropy can be used to express the information content of given…

Information Theory · Computer Science 2024-11-06 Bill Kay , Audun Myers , Thad Boydston , Emily Ellwein , Cameron Mackenzie , Iliana Alvarez , Erik Lentz

Efficiency and ease of use are essential for practical applications of camera based eye/gaze-tracking. Gaze tracking involves estimating where a person is looking on a screen based on face images from a computer-facing camera. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Amogh Gudi , Xin Li , Jan van Gemert

In the research of the impact of gestures using by a lecturer, one challenging task is to infer the attention of a group of audiences. Two important measurements that can help infer the level of attention are eye movement data and…

Neural and Evolutionary Computing · Computer Science 2018-01-09 Qiangeng Xu , John Kender

We conclude a sequence of work by giving near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain…

Data Structures and Algorithms · Computer Science 2008-12-18 Nicholas J. A. Harvey , Jelani Nelson , Krzysztof Onak

A correlated many-body calculation is presented to characterize the Shannon information entropy of trapped interacting bosons. We reformulate the one-body Shannon information entropy in terms of the one-body probability density. The minimum…

Quantum Gases · Physics 2013-09-16 Sudip Kumar Haldar , Barnali Chakrabarti , Tapan Kumar Das , Anindya Biswas

Subtraction of aligned images is a means to assess changes in a wide variety of clinical applications. In this paper we explore the information theoretical origin of Mutual Information (MI), which is based on Shannon's entropy.However, the…

Computer Vision and Pattern Recognition · Computer Science 2007-06-19 W. Jacquet , P. de Groen

We introduce an algorithm to locate contours of functions that are expensive to evaluate. The problem of locating contours arises in many applications, including classification, constrained optimization, and performance analysis of…

Machine Learning · Statistics 2018-12-20 Alexandre N. Marques , Remi R. Lam , Karen E. Willcox

Information theory is a mathematical theory of learning with deep connections with topics as diverse as artificial intelligence, statistical physics, and biological evolution. Many primers on information theory paint a broad picture with…

Information Theory · Computer Science 2019-03-26 Philip Chodrow

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2023-12-05 Maurice Koch , Kuno Kurzhals , Michael Burch , Daniel Weiskopf

Eye tracking is an important tool with a wide range of applications in Virtual, Augmented, and Mixed Reality (VR/AR/MR) technologies. State-of-the-art eye tracking methods are either reflection-based and track reflections of sparse point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Tianfu Wang , Jiazhang Wang , Oliver Cossairt , Florian Willomitzer

Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Sahar Moradizeyveh , Mehnaz Tabassum , Sidong Liu , Robert Ahadizad Newport , Amin Beheshti , Antonio Di Ieva

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors. Achieving high accuracy typically requires labeled data from test users which may not be attainable in real…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Seonwook Park , Emre Aksan , Xucong Zhang , Otmar Hilliges

We demonstrate that Shannon's information entropy and the thermodynamic entropy of Boltzmann and Gibbs are quantitatively equivalent for real condensed-matter systems. By interpreting atomic configurations as information sources, we compute…

Statistical Mechanics · Physics 2025-12-03 Dallin Fisher , Qi-Jun Hong

This research paper delves into the innovative integration of Shannon entropy and rough set theory, presenting a novel approach to generalize the evaluation approach in machine learning. The conventional application of entropy, primarily…

Machine Learning · Computer Science 2024-04-22 Olga Cherednichenko , Dmytro Chernyshov , Dmytro Sytnikov , Polina Sytnikova

Eye gaze estimation has become increasingly significant in computer vision.In this paper,we systematically study the mainstream of eye gaze estimation methods,propose a novel methodology to estimate eye gaze points and eye gaze directions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yong Huang , Ben Chen , Daiming Qu
‹ Prev 1 3 4 5 6 7 10 Next ›