English
Related papers

Related papers: Scikit-dimension: a Python package for intrinsic d…

200 papers

scikit-multilearn is a Python library for performing multi-label classification. The library is compatible with the scikit/scipy ecosystem and uses sparse matrices for all internal operations. It provides native Python implementations of…

Machine Learning · Computer Science 2018-12-11 Piotr Szymański , Tomasz Kajdanowicz

Imbalance in classification tasks is commonly quantified by the cardinalities of examples across classes. This, however, disregards the presence of redundant examples and inherent differences in the learning difficulties of classes.…

Machine Learning · Computer Science 2026-01-22 Çağrı Eser , Zeynep Sonat Baltacı , Emre Akbaş , Sinan Kalkan

It is a standard assumption that datasets in high dimension have an internal structure which means that they in fact lie on, or near, subsets of a lower dimension. In many instances it is important to understand the real dimension of the…

Machine Learning · Statistics 2025-07-21 James A. D. Binnie , Paweł Dłotko , John Harvey , Jakub Malinowski , Ka Man Yim

Additive models offer accurate and interpretable predictions for tabular data, a critical tool for statistical modeling. Recent advances in Neural Additive Models (NAMs) allow these models to handle complex machine learning tasks, including…

Machine Learning · Computer Science 2025-03-12 Mike Van Ness , Madeleine Udell

One of the founding paradigms of machine learning is that a small number of variables is often sufficient to describe high-dimensional data. The minimum number of variables required is called the intrinsic dimension (ID) of the data.…

Machine Learning · Statistics 2020-07-14 Michele Allegra , Elena Facco , Francesco Denti , Alessandro Laio , Antonietta Mira

Selecting third-party software packages in open-source ecosystems like Python is challenging due to the large number of alternatives and limited transparent evidence for comparison. Generative AI tools are increasingly used in development…

Information theory, i.e. the mathematical analysis of information and of its processing, has become a tenet of modern science; yet, its use in real-world studies is usually hindered by its computational complexity, the lack of coherent…

Physics and Society · Physics 2025-08-18 Carlson Moses Büth , Kishor Acharya , Massimiliano Zanin

The intrinsic dimensionality refers to the ``true'' dimensionality of the data, as opposed to the dimensionality of the data representation. For example, when attributes are highly correlated, the intrinsic dimensionality can be much lower…

Machine Learning · Statistics 2020-11-30 Erik Thordsen , Erich Schubert

This paper introduces Sparklen, a statistical learning toolkit for Hawkes processes in Python, designed to bring together efficiency and ease of use. The purpose of this package is to provide the Python community with a complete suite of…

Methodology · Statistics 2025-03-31 Romain Edmond Lacoste

The generative AI technology offers an increasing variety of tools for generating entirely synthetic images that are increasingly indistinguishable from real ones. Unlike methods that alter portions of an image, the creation of completely…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Manos Schinas , Symeon Papadopoulos

PyOD is an open-source Python toolbox for performing scalable outlier detection on multivariate data. Uniquely, it provides access to a wide range of outlier detection algorithms, including established outlier ensembles and more recent…

Machine Learning · Computer Science 2019-06-12 Yue Zhao , Zain Nasrullah , Zheng Li

This paper describes PyOED, a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit…

Mathematical Software · Computer Science 2023-12-20 Abhijit Chowdhary , Shady E. Ahmed , Ahmed Attia

Reliable parameter extraction from experimental data is central to quantitative analysis in spectroscopy, diffraction, photoluminescence, chromatography, microscopy, and time-resolved measurements. We present FitED, a Python-based desktop…

Data Analysis, Statistics and Probability · Physics 2026-05-04 Mustafa Mahmoud Aboulsaad

We present nbodykit, an open-source, massively parallel Python toolkit for analyzing large-scale structure (LSS) data. Using Python bindings of the Message Passing Interface (MPI), we provide parallel implementations of many commonly used…

Instrumentation and Methods for Astrophysics · Physics 2018-10-31 Nick Hand , Yu Feng , Florian Beutler , Yin Li , Chirag Modi , Uros Seljak , Zachary Slepian

High-dimensional data commonly lies on low-dimensional submanifolds, and estimating the local intrinsic dimension (LID) of a datum -- i.e. the dimension of the submanifold it belongs to -- is a longstanding problem. LID can be understood as…

Machine Learning · Computer Science 2024-10-28 Hamidreza Kamkari , Brendan Leigh Ross , Rasa Hosseinzadeh , Jesse C. Cresswell , Gabriel Loaiza-Ganem

We present a Python package for ground-state preparation based on the probabilistic imaginary-time evolution algorithm, with particular focus on its state-vector-based implementation. A standard shot-based simulation is also supported, and…

Quantum Physics · Physics 2026-05-19 Pascal Sievers , Satoshi Ejima

Pythonic code is idiomatic code that follows guiding principles and practices within the Python community. Offering performance and readability benefits, Pythonic code is claimed to be widely adopted by experienced Python developers, but…

Modern large-scale datasets are frequently said to be high-dimensional. However, their data point clouds frequently possess structures, significantly decreasing their intrinsic dimensionality (ID) due to the presence of clusters, points…

Machine Learning · Computer Science 2019-01-21 Luca Albergante , Jonathan Bac , Andrei Zinovyev

The local intrinsic dimension (LID) of data is a fundamental quantity in signal processing and learning theory, but quantifying the LID of high-dimensional, complex data has been a historically challenging task. Recent works have discovered…

Machine Learning · Computer Science 2025-11-27 Eric Yeats , Aaron Jacobson , Darryl Hannan , Yiran Jia , Timothy Doster , Henry Kvinge , Scott Mahan

This paper presents a systematic review of Python packages with a focus on time series analysis. The objective is to provide (1) an overview of the different time series analysis tasks and preprocessing methods implemented, and (2) an…

Mathematical Software · Computer Science 2021-06-23 Julien Siebert , Janek Groß , Christof Schroth