English
Related papers

Related papers: $\textit{sentropy}$: A Python Package for Revealin…

200 papers

While it is tempting in experimental practice to seek as high a data rate as possible, oversampling can become an issue if one takes measurements too densely. These effects can take many forms, some of which are easy to detect: e.g., when…

Information Theory · Computer Science 2021-03-03 Michael Neuder , Elizabeth Bradley , Edward Dlugokencky , James W. C. White , Joshua Garland

Summarizing data samples by quantitative measures has a long history, with descriptive statistics being a case in point. However, as natural language processing methods flourish, there are still insufficient characteristic metrics to…

Computation and Language · Computer Science 2020-03-20 Yi-An Lai , Xuan Zhu , Yi Zhang , Mona Diab

From human physiology to environmental evolution, important processes in nature often exhibit meaningful and strong periodic or quasi-periodic changes. Due to their inherent label scarcity, learning useful representations for periodic tasks…

Machine Learning · Computer Science 2023-02-22 Yuzhe Yang , Xin Liu , Jiang Wu , Silviu Borac , Dina Katabi , Ming-Zher Poh , Daniel McDuff

Evaluating whether large language models (LLMs) capture the structure of natural language beyond local fluency remains an open challenge. Existing evaluation methods, largely based on task performance or short-context behavior, provide…

Computation and Language · Computer Science 2026-05-26 Kumiko Tanaka-Ishii

The level set tree approach of Hartigan (1975) provides a probabilistically based and highly interpretable encoding of the clustering behavior of a dataset. By representing the hierarchy of data modes as a dendrogram of the level sets of a…

Methodology · Statistics 2013-08-01 Brian P. Kent , Alessandro Rinaldo , Timothy Verstynen

In this paper, we pay attention to the issue which is usually overlooked, i.e., \textit{similarity should be determined from different perspectives}. To explore this issue, we release a Multi-Perspective Text Similarity (MPTS) dataset, in…

Computation and Language · Computer Science 2022-02-15 Weijie Liu , Tao Zhu , Weiquan Mao , Zhe Zhao , Weigang Guo , Xuefeng Yang , Qi Ju

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

General-purpose Large Language Models (LLMs) are frequently fine-tuned through supervised fine-tuning (SFT) to enhance performance in specific domains. Better results can be achieved by distilling the chain-of-thought of a larger model at…

Machine Learning · Computer Science 2026-03-24 Andrey Goncharov , Daniil Vyazhev , Petr Sychev , Edvard Khalafyan , Alexey Zaytsev

Process metrics, valued for their language independence and ease of collection, have been shown to outperform product metrics in defect prediction. Among these, change entropy (Hassan, 2009) is widely used at the file level and has proven…

Software Engineering · Computer Science 2025-04-28 Ethari Hrishikesh , Amit Kumar , Meher Bhardwaj , Sonali Agarwal

Early diagnosis of plant diseases is critical for global food safety, yet most AI solutions lack the generalization required for real-world agricultural diversity. These models are typically constrained to specific species, failing to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Saif Ur Rehman Khan , Muhammad Nabeel Asim , Sebastian Vollmer , Andreas Dengel

Data samples collected for training machine learning models are typically assumed to be independent and identically distributed (iid). Recent research has demonstrated that this assumption can be problematic as it simplifies the manifold of…

Machine Learning · Computer Science 2019-10-16 Kaixuan Zhang , Qinglong Wang , Xue Liu , C. Lee Giles

This paper introduces Sparklen, a statistical learning toolkit for Hawkes processes in Python, designed to bring together efficiency and ease of use. The purpose of this package is to provide the Python community with a complete suite of…

Methodology · Statistics 2025-03-31 Romain Edmond Lacoste

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter

This paper presents a novel method for finding features in the analysis of variable distributions stemming from time series. We apply the methodology to the case of submitted and accepted papers in peer-reviewed journals. We provide a…

Digital Libraries · Computer Science 2019-10-15 Marcel Ausloos , Olgica Nedic , Aleksandar Dekanski

The distribution of subpopulations is an important property hidden within a dataset. Uncovering and analyzing the subpopulation distribution within datasets provides a comprehensive understanding of the datasets, standing as a powerful tool…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Yulin Luo , Ruichuan An , Bocheng Zou , Yiming Tang , Jiaming Liu , Shanghang Zhang

Semantic text similarity plays an important role in software engineering tasks in which engineers are requested to clarify the semantics of descriptive labels (e.g., business terms, table column names) that are often consists of too short…

Computation and Language · Computer Science 2023-10-31 Toshihiro Takahashi , Takaaki Tateishi , Michiaki Tatsubori

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

Recent advances in image-level self-supervised learning (SSL) have made significant progress, yet learning dense representations for patches remains challenging. Mainstream methods encounter an over-dispersion phenomenon that patches from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Peisong Wen , Qianqian Xu , Siran Dai , Runmin Cong , Qingming Huang

Quantifying the complexity and irregularity of time series data is a primary pursuit across various data-scientific disciplines. Sample entropy (SampEn) is a widely adopted metric for this purpose, but its reliability is sensitive to the…

Applications · Statistics 2024-05-13 Zachary Blanks , Donald E. Brown

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis