English
Related papers

Related papers: Optimal Rates for Learning Hidden Tree Structures

200 papers

We initiate the study of tree structures in the context of scenario-based robust optimization. Specifically, we study Binary Search Trees (BSTs) and Huffman coding, two fundamental techniques for efficiently managing and encoding data based…

Data Structures and Algorithms · Computer Science 2024-08-22 Spyros Angelopoulos , Christoph Dürr , Alex Elenter , Georgii Melidi

In recent years, significant progress has been made on algorithms for learning optimal decision trees, primarily in the context of binary features. Extending these methods to continuous features remains substantially more challenging due to…

Machine Learning · Computer Science 2026-01-22 Harold Kiossou , Pierre Schaus , Siegfried Nijssen

Sparse connectivity is an important factor behind the success of convolutional neural networks and recurrent neural networks. In this paper, we consider the problem of learning sparse connectivity for feedforward neural networks (FNNs). The…

Machine Learning · Computer Science 2018-07-18 Xiaopeng Li , Zhourong Chen , Nevin L. Zhang

Causal discovery from observational data is an important but challenging task in many scientific fields. Recently, a method with non-combinatorial directed acyclic constraint, called NOTEARS, formulates the causal structure learning problem…

Machine Learning · Computer Science 2023-10-31 Weilin Chen , Jie Qiao , Ruichu Cai , Zhifeng Hao

Herein, we investigate the zero-error randomized complexity, which is the least cost against the worst input, of AND-OR tree computation by imposing various restrictions on the algorithm to find the Boolean value of the root of that tree…

Artificial Intelligence · Computer Science 2025-05-26 Fuki Ito , Toshio Suzuki

Motivated by applications, the last few years have witnessed tremendous interest in understanding the structure as well as the behavior of dynamics for inhomogeneous random graph models. In this study we analyze the maximal components at…

Probability · Mathematics 2016-08-02 Shankar Bhamidi , Sanchayan Sen , Xuan Wang

Consider jointly Gaussian random variables whose conditional independence structure is specified by a graphical model. If we observe realizations of the variables, we can compute the covariance matrix, and it is well known that the support…

Machine Learning · Statistics 2019-01-28 Ashish Katiyar , Jessica Hoffmann , Constantine Caramanis

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

Training deep neural networks with noise and data heterogeneity is a major challenge. We introduce Lightweight Learnable Adaptive Weighting (LiLAW), a method that dynamically adjusts the loss weight of each training sample based on its…

Machine Learning · Computer Science 2026-05-14 Abhishek Moturu , Muhammad Muzammil , Anna Goldenberg , Babak Taati

Inspired by the idea of Positive-incentive Noise (Pi-Noise or $\pi$-Noise) that aims at learning the reliable noise beneficial to tasks, we scientifically investigate the connection between contrastive learning and $\pi$-noise in this…

Machine Learning · Computer Science 2026-05-11 Hongyuan Zhang , Yanchen Xu , Sida Huang , Xuelong Li

In the context of statistical supervised learning, the noiseless linear model assumes that there exists a deterministic linear relation $Y = \langle \theta_*, X \rangle$ between the random output $Y$ and the random feature vector $\Phi(U)$,…

Machine Learning · Computer Science 2020-10-28 Raphaël Berthier , Francis Bach , Pierre Gaillard

We propose a novel tree-like curvilinear structure reconstruction algorithm based on supervised learning and graph theory. In this work we analyze image patches to obtain the local major orientations and the rankings that correspond to the…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Seong-Gyun Jeong , Yuliya Tarabalka , Nicolas Nisse , Josiane Zerubia

Bayesian network structure learning is the notoriously difficult problem of discovering a Bayesian network that optimally represents a given set of training data. In this paper we study the computational worst-case complexity of exact…

Artificial Intelligence · Computer Science 2014-02-05 Sebastian Ordyniak , Stefan Szeider

We consider the problem of learning classification trees that are robust to distribution shifts between training and testing/deployment data. This problem arises frequently in high stakes settings such as public health and social work where…

Machine Learning · Computer Science 2025-08-27 Nathan Justin , Sina Aghaei , Andrés Gómez , Phebe Vayanos

This article offers a modification of Chow and Liu's learning algorithm in the context of handwritten digit recognition. The modified algorithm directs the user to group digits into several classes consisting of digits that are hard to…

Machine Learning · Computer Science 2013-03-25 Dan Geiger

Numerous researches have proved that deep neural networks (DNNs) can fit everything in the end even given data with noisy labels, and result in poor generalization performance. However, recent studies suggest that DNNs tend to gradually…

Machine Learning · Computer Science 2021-04-07 Hao Yang , Youzhi Jin , Ziyin Li , Deng-Bao Wang , Lei Miao , Xin Geng , Min-Ling Zhang

Order finding is the core subroutine of Shor's algorithm. On NISQ hardware, phase estimation output distributions are often distorted by noise, making correct order recovery difficult. We study recoverability in noisy order finding: given a…

Quantum Physics · Physics 2026-05-18 Qingxin Yang , Stefano Markidis

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner

We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a…

Methodology · Statistics 2025-11-27 Xiaozhu Zhang , Nir Keret , Ali Shojaie , Armeen Taeb

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by Poisson noise. A proper data fidelity term (log-likelihood) is introduced to reflect the Poisson statistics of the noise. On…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck