English
Related papers

Related papers: Constructing Decision Trees from Data Streams

200 papers

Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational…

Data Structures and Algorithms · Computer Science 2024-03-04 Matthew Andres Moreno , Santiago Rodriguez Papa , Emily Dolson

Decision Tree (DT) Learning is a fundamental problem in Interpretable Machine Learning, yet it poses a formidable optimisation challenge. Practical algorithms have recently emerged, primarily leveraging Dynamic Programming and Branch &…

Machine Learning · Computer Science 2025-05-13 Ayman Chaouki , Jesse Read , Albert Bifet

Partitioning a set of elements into an unknown number of mutually exclusive subsets is essential in many machine learning problems. However, assigning elements, such as samples in a dataset or neurons in a network layer, to an unknown and…

Machine Learning · Computer Science 2023-11-10 Thomas M. Sutter , Alain Ryser , Joram Liebeskind , Julia E. Vogt

Sampling is often a necessary evil to reduce the processing and storage costs of distributed tracing. In this work, we describe a scalable and adaptive sampling approach that can preserve events of interest better than the widely used…

Data Structures and Algorithms · Computer Science 2021-07-19 Otmar Ertl

Split learning (SL) is a promising approach for training artificial intelligence (AI) models, in which devices collaborate with a server to train an AI model in a distributed manner, based on a same fixed split point. However, due to the…

Machine Learning · Computer Science 2025-03-14 Zuguang Li , Wen Wu , Shaohua Wu , Wei Wang

Frequency estimation in data streams is one of the classical problems in streaming algorithms. Following much research, there are now almost matching upper and lower bounds for the trade-off needed between the number of samples and the…

Computational Complexity · Computer Science 2023-01-16 Shachar Lovett , Jiapeng Zhang

We present a novel and systematic method, called Superfast Selection, for selecting the "optimal split" for decision tree and feature selection algorithms over tabular data. The method speeds up split selection on a single feature by…

Machine Learning · Computer Science 2024-06-05 Huaduo Wang , Gopal Gupta

We study nonlinear regression of real valued data in an individual sequence manner, where we provide results that are guaranteed to hold without any statistical assumptions. We address the convergence and undertraining issues of…

Machine Learning · Computer Science 2014-10-08 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

Inspired by the feedforward multilayer perceptron (FF-MLP), decision tree (DT) and extreme learning machine (ELM), a new classification model, called the subspace learning machine (SLM), is proposed in this work. SLM first identifies a…

Machine Learning · Computer Science 2022-05-12 Hongyu Fu , Yijing Yang , Vinod K. Mishra , C. -C. Jay Kuo

Finding sparse cuts is an important tool in analyzing large-scale distributed networks such as the Internet and Peer-to-Peer networks, as well as large-scale graphs such as the web graph, online social communities, and VLSI circuits. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-22 Atish Das Sarma , Anisur Rahaman Molla , Gopal Pandurangan

In the following paper we present a new type of optimization algorithms adapted for neural network training. These algorithms are based upon sequential operator splitting technique for some associated dynamical systems. Furthermore, we…

Machine Learning · Computer Science 2020-03-24 Cristian Daniel Alecsa , Titus Pinta , Imre Boros

Predicting students' academic performance has been a research area of interest in recent years with many institutions focusing on improving the students' performance and the education quality. The analysis and prediction of students'…

Computers and Society · Computer Science 2020-06-11 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

In this article, we propose the approach to procedural optimization of a neural network, based on the combination of information theory and braid theory. The network studied in the article implemented with the intersections between the…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Olga Lukyanova , Oleg Nikitin , Alex Kunin

In this paper we provide a thorough, rigorous theoretical framework to assess optimality guarantees of sampling-based algorithms for drift control systems: systems that, loosely speaking, can not stop instantaneously due to momentum. We…

Robotics · Computer Science 2015-10-28 Edward Schmerling , Lucas Janson , Marco Pavone

We consider the minimum spanning tree problem with predictions, using the weight-arrival model, i.e., the graph is given, together with predictions for the weights of all edges. Then the actual weights arrive one at a time and an…

Data Structures and Algorithms · Computer Science 2023-02-24 Magnus Berg , Joan Boyar , Lene M. Favrholdt , Kim S. Larsen

We study sublinear algorithms for two fundamental graph problems, MAXCUT and correlation clustering. Our focus is on constructing core-sets as well as developing streaming algorithms for these problems. Constant space algorithms are known…

Data Structures and Algorithms · Computer Science 2018-02-21 Aditya Bhaskara , Samira Daruki , Suresh Venkatasubramanian

To improve decision-making and planning efficiency in back-end centralized redundant supply chains, this paper proposes a decision model integrating deep learning with intelligent particle swarm optimization. A distributed node deployment…

Machine Learning · Computer Science 2025-11-04 Shiman Zhang , Jinghan Zhou , Zhoufan Yu , Ningai Leng

Class imbalance poses new challenges when it comes to classifying data streams. Many algorithms recently proposed in the literature tackle this problem using a variety of data-level, algorithm-level, and ensemble approaches. However, there…

Machine Learning · Computer Science 2023-07-19 Gabriel Aguiar , Bartosz Krawczyk , Alberto Cano

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee