English
Related papers

Related papers: Entropy Approximation by Machine Learning Regressi…

200 papers

We introduce the first differentiable approximation of range-partition entropy, a complexity measure from computational geometry that directly bounds algorithmic runtime. Unlike architectural modifications, our method is a complementary…

Machine Learning · Computer Science 2025-11-20 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

We introduce Extrema-Segmented Entropy (ExSEnt), a feature-decomposed framework for quantifying time-series complexity that separates temporal from amplitude contributions. The method partitions a signal into monotonic segments by detecting…

Chaotic Dynamics · Physics 2025-09-30 Sara Kamali , Fabiano Baroni , Pablo Varona

Sequential recommender systems have achieved steady gains in offline accuracy, yet it remains unclear how close current models are to the intrinsic accuracy limit imposed by the data. A reliable, model-agnostic estimate of this ceiling…

Information Retrieval · Computer Science 2026-04-15 En Xu , Jingtao Ding , Yong Li

Longitudinal analysis has great potential to reveal developmental trajectories and monitor disease progression in medical imaging. This process relies on consistent and robust joint 4D segmentation. Traditional techniques are dependent on…

Machine Learning · Computer Science 2019-06-19 Malav Bateriwala , Pierrick Bourgeat

This paper proposes a learning method to construct an efficient sensing (measurement) matrix, having orthogonal rows, for compressed sensing of a class of signals. The learning scheme identifies the sensing matrix by maximizing the entropy…

Signal Processing · Electrical Eng. & Systems 2019-04-02 Gayatri Parthasarathy , G. Abhilash

Feature representation is an important aspect of remote-sensing based image classification. While deep convolutional neural networks are able to effectively amalgamate information, large numbers of parameters often make learned features…

Machine Learning · Computer Science 2022-03-07 Joshua Peeples , Sarah Walker , Connor McCurley , Alina Zare , James Keller , Weihuang Xu

Characterizing soil moisture (SM) around drip irrigation pipes is crucial for precise and optimized farming. Machine learning (ML) approaches are particularly suitable for this task as they can reduce uncertainties caused by soil conditions…

Image and Video Processing · Electrical Eng. & Systems 2024-06-07 Mohammad Ramezaninia , Mohammadreza Shams , Mohammad Zoofaghari

Long video understanding remains challenging for Multi-modal Large Language Models (MLLMs) due to high memory costs and context-length limits. Prior approaches mitigate this by scoring and selecting frames/tokens within short clips, but…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Haozhe Qi , Kevin Qu , Mahdi Rad , Rui Wang , Alexander Mathis , Marc Pollefeys

We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of quantum Monte Carlo data. With the sampled spectrum parametrized with delta-functions in continuous frequency space, a calculation of…

Strongly Correlated Electrons · Physics 2023-01-11 Hui Shao , Anders W. Sandvik

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

The paper introduces a new kernel-based Maximum Mean Discrepancy (MMD) statistic for measuring the distance between two distributions given finitely-many multivariate samples. When the distributions are locally low-dimensional, the proposed…

Machine Learning · Statistics 2018-09-03 Xiuyuan Cheng , Alexander Cloninger , Ronald R. Coifman

This study investigates the use of machine learning (ML) to correct the enthalpy of formation (Hf) from two separate DFT functionals, PBE and SCAN, to the experimental Hf across 1011 solid-state compounds. The ML model uses a set of 25…

Materials Science · Physics 2023-07-18 Santosh Adhikari , Christopher J. Bartel , Christopher Sutton

Distance metric learning aims to learn from the given training data a valid distance metric, with which the similarity between data samples can be more effectively evaluated for classification. Metric learning is often formulated as a…

Machine Learning · Computer Science 2015-02-03 Wangmeng Zuo , Faqiang Wang , David Zhang , Liang Lin , Yuchi Huang , Deyu Meng , Lei Zhang

The entropy of a quantum system is a measure of its randomness, and has applications in measuring quantum entanglement. We study the problem of measuring the von Neumann entropy, $S(\rho)$, and R\'enyi entropy, $S_\alpha(\rho)$ of an…

Quantum Physics · Physics 2022-04-19 Jayadev Acharya , Ibrahim Issa , Nirmal V. Shende , Aaron B. Wagner

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

The central goal of this paper is to establish two commonly available dimensionality reduction (DR) methods i.e. t-distributed Stochastic Neighbor Embedding (t-SNE) and Multidimensional Scaling (MDS) in Matlab and to observe their…

Machine Learning · Computer Science 2020-11-19 Shadman Sakib , Md. Abu Bakr Siddique , Md. Abdur Rahman

We introduce Multivariate Multiscale Graph-based Dispersion Entropy (mvDEG), a novel, computationally efficient method for analyzing multivariate time series data in graph and complex network frameworks, and demonstrate its application in…

Combinatorics · Mathematics 2024-05-02 John Stewart Fabila-Carrasco , Chao Tan , Javier Escudero

Machine learning (ML) models, such as SVM, for tasks like classification and clustering of sequences, require a definition of distance/similarity between pairs of sequences. Several methods have been proposed to compute the similarity…

Machine Learning · Computer Science 2022-09-13 Sarwan Ali , Bikram Sahoo , Muhammad Asad Khan , Alexander Zelikovsky , Imdad Ullah Khan , Murray Patterson

Full data acquisition in MRI is inherently slow, which limits clinical throughput and increases patient discomfort. Compressed Sensing MRI (CS-MRI) seeks to accelerate acquisition by reconstructing images from under-sampled k-space data,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Lev Ayzenberg , Shady Abu-Hussein , Raja Giryes , Hayit Greenspan

We propose a semantic similarity metric for image registration. Existing metrics like Euclidean Distance or Normalized Cross-Correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our…

Machine Learning · Computer Science 2021-04-21 Steffen Czolbe , Oswin Krause , Aasa Feragen