English
Related papers

Related papers: Multitask Efficiencies in the Decision Tree Model

200 papers

Can deep learning solve multiple tasks simultaneously, even when they are unrelated and very different? We investigate how the representations of the underlying tasks affect the ability of a single neural network to learn them jointly. We…

Machine Learning · Computer Science 2021-03-30 Atish Agarwala , Abhimanyu Das , Brendan Juba , Rina Panigrahy , Vatsal Sharan , Xin Wang , Qiuyi Zhang

A decision tree looks like a simple directed acyclic computational graph, where only the leaf nodes specify the output values and the non-terminals specify their tests or split conditions. From the numerical perspective, we express decision…

Machine Learning · Computer Science 2024-11-07 Jinxiong Zhang

We propose a procedure to build a decision tree which approximates the performance of complex machine learning models. This single approximation tree can be used to interpret and simplify the predicting pattern of random forests (RFs) and…

Methodology · Statistics 2016-10-31 Yichen Zhou , Giles Hooker

The problem of deciding whether CSP instances admit solutions has been deeply studied in the literature, and several structural tractability results have been derived so far. However, constraint satisfaction comes in practice as a…

Artificial Intelligence · Computer Science 2013-07-19 Gianluigi Greco , Francesco Scarcello

The zeta and Moebius transforms over the subset lattice of $n$ elements and the so-called subset convolution are examples of unary and binary operations on set functions. While their direct computation requires $O(3^n)$ arithmetic…

Data Structures and Algorithms · Computer Science 2020-09-02 Mikko Koivisto , Antti Röyskö

Deep reinforcement learning (DRL) techniques have become increasingly used in various fields for decision-making processes. However, a challenge that often arises is the trade-off between both the computational efficiency of the…

Machine Learning · Computer Science 2023-08-21 Anthony Kobanda , Valliappan C. A. , Joshua Romoff , Ludovic Denoyer

We investigate the direct-sum problem in the context of differentially private PAC learning: What is the sample complexity of solving $k$ learning tasks simultaneously under differential privacy, and how does this cost compare to that of…

Data Structures and Algorithms · Computer Science 2015-11-30 Mark Bun , Kobbi Nissim , Uri Stemmer

We define a semantic complexity class based on the model of quantum computing with just one pure qubit (as introduced by Knill and Laflamme) and discuss its computational power in terms of the problem of estimating the trace of a large…

Quantum Physics · Physics 2007-05-23 Dan Shepherd

We propose a model-based clustering algorithm for a general class of functional data for which the components could be curves or images. The random functional data realizations could be measured with error at discrete, and possibly random,…

Machine Learning · Statistics 2022-03-14 Steven Golovkine , Nicolas Klutchnikoff , Valentin Patilea

Phase transitions in combinatorial problems have recently been shown to be useful in locating "hard" instances of combinatorial problems. The connection between computational complexity and the existence of phase transitions has been…

Computational Complexity · Computer Science 2016-11-17 Gabriel Istrate

This is the full version of a paper submitted to the Computability in Europe (CiE 2023) conference, with all proofs omitted there. In 2012 P. D. Azar and S. Micali introduced a new model of interactive proofs, called "Rational Interactive…

Computational Complexity · Computer Science 2023-05-09 Daniil Musatov , Georgii Potapov

In this article, we generalize the recent Discrete Time Random Walk (DTRW) algorithm, which was introduced for the computation of probability densities of fractional diffusion. Although it has the same computational complexity and shares…

Computational Physics · Physics 2018-08-20 Gurtek Gill , Peter Straka

Constraint programming is known for being an efficient approach for solving combinatorial problems. Important design choices in a solver are the branching heuristics, which are designed to lead the search to the best solutions in a minimum…

Artificial Intelligence · Computer Science 2024-04-17 Tom Marty , Tristan François , Pierre Tessier , Louis Gauthier , Louis-Martin Rousseau , Quentin Cappart

Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of…

Machine Learning · Computer Science 2024-04-04 Alberto Argente-Garrido , Cristina Zuheros , M. Victoria Luzón , Francisco Herrera

Succinct data structures give space-efficient representations of large amounts of data without sacrificing performance. They rely one cleverly designed data representations and algorithms. We present here the formalization in Coq/SSReflect…

Programming Languages · Computer Science 2019-07-03 Reynald Affeldt , Jacques Garrigue , Xuanrui Qi , Kazunari Tanaka

A major limitation of exact inference algorithms for probabilistic graphical models is their extensive memory usage, which often puts real-world problems out of their reach. In this paper we show how we can extend inference algorithms,…

Artificial Intelligence · Computer Science 2012-03-19 Kalev Kask , Rina Dechter , Andrew E. Gelfand

In this paper we explore several approaches for sampling weight vectors in the context of weighted sum scalarisation approaches for solving multi-criteria decision making (MCDM) problems. This established method converts a multi-objective…

Optimization and Control · Mathematics 2025-04-18 Aled Williams , Yilun Cai

We present an output-sensitive algorithm for evaluating an acyclic Conjunctive Regular Path Query (CRPQ). Its complexity is written in terms of the input size, the output size, and a well-known parameter of the query that is called the…

Databases · Computer Science 2026-03-17 Mahmoud Abo Khamis , Alexandru-Mihai Hurjui , Ahmet Kara , Dan Olteanu , Dan Suciu

Simple conceptual graphs are considered as the kernel of most knowledge representation formalisms built upon Sowa's model. Reasoning in this model can be expressed by a graph homomorphism called projection, whose semantics is usually given…

Artificial Intelligence · Computer Science 2011-06-10 J. F. Baget , M. L. Mugnier

Decision trees and systems of decision rules are widely used as classifiers, as a means for knowledge representation, and as algorithms. They are among the most interpretable models for data analysis. The study of the relationships between…

Artificial Intelligence · Computer Science 2023-05-04 Kerven Durdymyradov , Mikhail Moshkov