English
Related papers

Related papers: High-dimensional consistency in score-based and hy…

200 papers

In this paper, we derive optimality results for greedy Bayesian-network search algorithms that perform single-edge modifications at each step and use asymptotically consistent scoring criteria. Our results extend those of Meek (1997) and…

Artificial Intelligence · Computer Science 2013-01-07 David Maxwell Chickering , Christopher Meek

This work considers methods for imposing sparsity in Bayesian regression with applications in nonlinear system identification. We first review automatic relevance determination (ARD) and analytically demonstrate the need to additional…

Machine Learning · Statistics 2021-02-24 Samuel H. Rudy , Themistoklis P. Sapsis

The widespread use of machine learning algorithms calls for automatic change detection algorithms to monitor their behavior over time. As a machine learning algorithm learns from a continuous, possibly evolving, stream of data, it is…

Machine Learning · Statistics 2021-06-29 Lang Liu , Joseph Salmon , Zaid Harchaoui

Statistical tasks such as density estimation and approximate Bayesian inference often involve densities with unknown normalising constants. Score-based methods, including score matching, are popular techniques as they are free of…

Machine Learning · Statistics 2021-12-22 Li K. Wenliang , Heishiro Kanagawa

Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic…

Machine Learning · Statistics 2016-03-23 Sohail Bahmani , Petros T. Boufounos , Bhiksha Raj

As data sets grow in size, the ability of learning methods to find structure in them is increasingly hampered by the time needed to search the large spaces of possibilities and generate a score for each that takes all of the observed data…

Machine Learning · Computer Science 2012-07-03 Benjamin Yackley , Terran Lane

In the design of greedy algorithms for the maximum cardinality matching problem the utilization of degree information when selecting the next edge is a well established and successful approach. We define the class of "degree sensitive"…

Data Structures and Algorithms · Computer Science 2016-12-21 Bert Besser , Bastian Werth

We propose a framework to analyze stability for a class of linear non-autonomous hybrid systems, where the continuous evolution of solutions is governed by an ordinary differential equation and the instantaneous changes are governed by a…

Optimization and Control · Mathematics 2023-01-24 Adnane Saoud , Mohamed Maghenem , Antonio Loría , Ricardo G. Sanfelice

A popular approach to semi-supervised learning proceeds by endowing the input data with a graph structure in order to extract geometric information and incorporate it into a Bayesian framework. We introduce new theory that gives appropriate…

Machine Learning · Statistics 2020-01-14 Nicolas Garcia Trillos , Zachary Kaplan , Thabo Samakhoana , Daniel Sanz-Alonso

Several learning applications require solving high-dimensional regression problems where the relevant features belong to a small number of (overlapping) groups. For very large datasets and under standard sparsity constraints, hard…

Machine Learning · Statistics 2016-05-30 Prateek Jain , Nikhil Rao , Inderjit Dhillon

We study the generalization error of randomized learning algorithms -- focusing on stochastic gradient descent (SGD) -- using a novel combination of PAC-Bayes and algorithmic stability. Importantly, our generalization bounds hold for all…

Machine Learning · Computer Science 2020-06-23 Ben London

Hybrid Approximate Nearest Neighbor Search (Hybrid ANNS) is a foundational search technology for large-scale heterogeneous data and has gained significant attention in both academia and industry. However, current approaches overlook the…

Information Retrieval · Computer Science 2026-04-03 Qianyun Yang , Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Liqiang Nie

This paper studies the discovery of approximate rules in property graphs. We propose a semantically meaningful measure of error for mining graph entity dependencies (GEDs) at almost hold, to tolerate errors and inconsistencies that exist in…

The discovery of structure from time series data is a key problem in fields of study working with complex systems. Most identifiability results and learning algorithms assume the underlying dynamics to be discrete in time. Comparatively…

Machine Learning · Statistics 2022-02-04 Alexis Bellot , Kim Branson , Mihaela van der Schaar

A test is adaptive when its sequence and number of questions is dynamically tuned on the basis of the estimated skills of the taker. Graphical models, such as Bayesian networks, are used for adaptive tests as they allow to model the…

Artificial Intelligence · Computer Science 2021-09-29 Alessandro Antonucci , Francesca Mangili , Claudio Bonesana , Giorgia Adorni

The generalized eigenvalue problem (GEP) serves as a cornerstone in a wide range of applications in numerical linear algebra and scientific computing. However, traditional approaches that aim to maximize the classical Rayleigh quotient…

Optimization and Control · Mathematics 2025-07-04 Xiaozhi Liu , Yong Xia

Since real-world objects and their interactions are often multi-modal and multi-typed, heterogeneous networks have been widely used as a more powerful, realistic, and generic superclass of traditional homogeneous networks (graphs).…

Social and Information Networks · Computer Science 2020-12-18 Carl Yang , Yuxin Xiao , Yu Zhang , Yizhou Sun , Jiawei Han

Gaussian graphical models are relevant tools to learn conditional independence structure between variables. In this class of models, Bayesian structure learning is often done by search algorithms over the graph space. The conjugate prior…

Statistics Theory · Mathematics 2021-07-19 Reza Mohammadi , Helene Massam , Gerard Letac

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

Machine Learning · Computer Science 2025-08-14 Zijun Sun , Yanning Shen

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien