English
Related papers

Related papers: An Ensemble Classification Algorithm Based on Info…

200 papers

Detecting drifts in data is essential for machine learning applications, as changes in the statistics of processed data typically has a profound influence on the performance of trained models. Most of the available drift detection methods…

Machine Learning · Computer Science 2024-10-28 Andrea Castellani , Sebastian Schmitt , Barbara Hammer

Existing clustering algorithms such as K-means often need to preset parameters such as the number of categories K, and such parameters may lead to the failure to output objective and consistent clustering results. This paper introduces a…

Machine Learning · Computer Science 2022-09-15 Shaodong Deng , Long Sheng , Jiayi Nie , Fuyi Deng

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. Many unsupervised…

Machine Learning · Computer Science 2022-02-22 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Non-stationarity of an underlying data generating process that leads to distributional changes over time is a key characteristic of Data Streams. This phenomenon, commonly referred to as Concept Drift, has been intensively studied, and…

Machine Learning · Computer Science 2026-02-09 Brandon Gower-Winter , Misja Groen , Georg Krempl

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of…

Information Theory · Computer Science 2015-11-24 Patricia Wollstadt , Mario Martínez-Zarzuela , Raul Vicente , Francisco J. Díaz-Pernas , Michael Wibral

Predictive services nowadays play an important role across all business sectors. However, deployed machine learning models are challenged by changing data streams over time which is described as concept drift. Prediction quality of models…

Machine Learning · Computer Science 2020-12-09 Lucas Baier , Josua Reimold , Niklas Kühl

Continuous learning from streaming data is among the most challenging topics in the contemporary machine learning. In this domain, learning algorithms must not only be able to handle massive volumes of rapidly arriving data, but also adapt…

Machine Learning · Computer Science 2020-09-22 Łukasz Korycki , Bartosz Krawczyk

Recommending appropriate algorithms to a classification problem is one of the most challenging issues in the field of data mining. The existing algorithm recommendation models are generally constructed on only one kind of meta-features by…

Information Retrieval · Computer Science 2021-06-08 Guangtao Wang , Qinbao Song , Xiaoyan Zhu

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

As machine learning models increasingly replace traditional business logic in the production system, their lifecycle management is becoming a significant concern. Once deployed into production, the machine learning models are constantly…

Machine Learning · Computer Science 2022-11-24 Lorena Poenaru-Olaru , Luis Cruz , Arie van Deursen , Jan S. Rellermeyer

Due to recent advances in data collection techniques, massive amounts of data are being collected at an extremely fast pace. Also, these data are potentially unbounded. Boundless streams of data collected from sensors, equipments, and other…

Databases · Computer Science 2012-03-12 T Soni Madhulatha

In a data stream environment, classification models must handle concept drift efficiently and effectively. Ensemble methods are widely used for this purpose; however, the ones available in the literature either use a large data chunk to…

Machine Learning · Computer Science 2023-03-15 Sepehr Bakhshi , Pouya Ghahramanian , Hamed Bonab , Fazli Can

Click-through rate (CTR) prediction is a crucial task in web search, recommender systems, and online advertisement displaying. In practical application, CTR models often serve with high-speed user-generated data streams, whose underlying…

Information Retrieval · Computer Science 2023-02-24 Congcong Liu , Yuejiang Li , Fei Teng , Xiwei Zhao , Changping Peng , Zhangang Lin , Jinghe Hu , Jingping Shao

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

Classifiers deployed in the real world operate in a dynamic environment, where the data distribution can change over time. These changes, referred to as concept drift, can cause the predictive performance of the classifier to drop over…

Machine Learning · Statistics 2017-04-04 Tegjyot Singh Sethi , Mehmed Kantardzic

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Very large databases are required to store massive amounts of data that are continuously inserted and queried. Analyzing huge data sets and extracting valuable pattern in many applications are interesting for researchers. We can identify…

Databases · Computer Science 2010-06-29 Madjid Khalilian , Norwati Mustapha

In the modern era of digital transformation, the evolution of the fifth-generation (5G) wireless network has played a pivotal role in revolutionizing communication technology and accelerating the growth of smart technology applications.…

Cryptography and Security · Computer Science 2023-05-19 Yafeng Wu , Lan Liu , Yongjie Yu , Guiming Chen , Junhan Hu

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson