English
Related papers

Related papers: Bayesian Hierarchical Models for Quantitative Esti…

200 papers

Model uncertainty is a central challenge in statistical models for binary outcomes such as logistic regression, arising when it is unclear which predictors should be included in the model. Many methods have been proposed to address this…

This paper introduces a novel parameter estimation method for the probability tables of Bayesian network classifiers (BNCs), using hierarchical Dirichlet processes (HDPs). The main result of this paper is to show that improved parameter…

Machine Learning · Computer Science 2018-05-09 Francois Petitjean , Wray Buntine , Geoffrey I. Webb , Nayyar Zaidi

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few…

Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains…

Machine Learning · Computer Science 2026-01-14 Md Shafiqul Islam , Shakti Prasad Padhy , Douglas Allaire , Raymundo Arróyave

Standard Bayesian Optimization (BO) assumes uniform smoothness across the search space an assumption violated in multi-regime problems such as molecular conformation search through distinct energy basins or drug discovery across…

Machine Learning · Computer Science 2026-01-29 Yan Zhang , Xuefeng Liu , Sipeng Chen , Sascha Ranftl , Chong Liu , Shibo Li

In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction of increasingly…

Information Retrieval · Computer Science 2021-05-12 Daniel Cohen , Bhaskar Mitra , Oleg Lesota , Navid Rekabsaz , Carsten Eickhoff

Optimizing discrete black-box functions is key in several domains, e.g. protein engineering and drug design. Due to the lack of gradient information and the need for sample efficiency, Bayesian optimization is an ideal candidate for these…

Discovering novel materials with desired properties is essential for driving innovation. Industry 4.0 and smart manufacturing have promised transformative advances in this area through real-time data integration and automated production…

Machine Learning · Computer Science 2025-04-08 Avijit Saha Asru , Hamed Khosravi , Imtiaz Ahmed , Abdullahil Azeem

As Large Language Models (LLMs) and other AI systems evolve, robustly estimating their capabilities from inherently stochastic outputs while systematically quantifying uncertainty in these estimates becomes increasingly important. Further,…

Artificial Intelligence · Computer Science 2025-07-15 Lennart Luettgau , Harry Coppock , Magda Dubois , Christopher Summerfield , Cozmin Ududec

Scientific discovery is increasingly constrained by costly experiments and limited resources, underscoring the need for efficient optimization in AI for science. Bayesian Optimization (BO), though widely adopted for balancing exploration…

Artificial Intelligence · Computer Science 2026-05-19 Xinzhe Yuan , Zhuo Chen , Jianshu Zhang , Huan Xiong , Nanyang Ye , Yuqiang Li , Qinying Gu

Compound AI systems (CASs) that employ LLMs as agents to accomplish knowledge-intensive tasks via interactions with tools and data retrievers have garnered significant interest within database and AI communities. While these systems have…

Databases · Computer Science 2024-06-04 Yanlin Feng , Sajjadur Rahman , Aaron Feng , Vincent Chen , Eser Kandogan

The probabilistic surrogates used by Bayesian optimizers make them popular methods when function evaluations are noisy or expensive to evaluate. While Bayesian optimizers are traditionally used for global optimization, their benefits are…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

Quasi-Newton methods are ubiquitous in deterministic local search due to their efficiency and low computational cost. This class of methods uses the history of gradient evaluations to approximate second-order derivatives. However, only…

Optimization and Control · Mathematics 2025-11-24 André Carlon , Luis Espath , Raúl Tempone

High-fidelity complex engineering simulations are highly predictive, but also computationally expensive and often require substantial computational efforts. The mitigation of computational burden is usually enabled through parallelism in…

Machine Learning · Statistics 2021-02-08 Anh Tran , Mike Eldred , Tim Wildey , Scott McCann , Jing Sun , Robert J. Visintainer

The paper continues the study of partitioning based inference of heuristics for search in the context of solving the Most Probable Explanation task in Bayesian Networks. We compare two systematic Branch and Bound search algorithms, BBBT…

Artificial Intelligence · Computer Science 2012-12-12 Radu Marinescu , Kalev Kask , Rina Dechter

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

The complex regulatory dynamics of a biological network can be succinctly captured using discrete logic models. Given even sparse time-course data from the system of interest, previous work has shown that global optimization schemes are…

Molecular Networks · Quantitative Biology 2026-04-22 Joyce Reimer , Pranta Saha , Chris Chen , Neeraj Dhar , Brook Byrns , Steven Rayan , Gordon Broderick

Learning Bayesian Networks (BNs) from high-dimensional data is a complex and time-consuming task. Although there are approaches based on horizontal (instances) or vertical (variables) partitioning in the literature, none can guarantee the…

Machine Learning · Computer Science 2024-09-23 Jorge D. Laborda , Pablo Torrijos , José M. Puerta , José A. Gámez

This paper aims to explore models based on the extreme gradient boosting (XGBoost) approach for business risk classification. Feature selection (FS) algorithms and hyper-parameter optimizations are simultaneously considered during model…

Machine Learning · Statistics 2019-01-25 Yan Wang , Xuelei Sherry Ni