English
Related papers

Related papers: Boosting Variational Inference With Locally Adapti…

200 papers

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

Machine Learning · Computer Science 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Variational inference has become a widely used method to approximate posteriors in complex latent variables models. However, deriving a variational inference algorithm generally requires significant model-specific analysis, and these…

Machine Learning · Statistics 2014-01-03 Rajesh Ranganath , Sean Gerrish , David M. Blei

Variational inference algorithms such as belief propagation have had tremendous impact on our ability to learn and use graphical models, and give many insights for developing or understanding exact and approximate inference. However,…

Artificial Intelligence · Computer Science 2012-10-19 Qiang Liu , Alexander T. Ihler

Deep-Learning-based video recognition has shown promising improvements along with the development of large-scale datasets and spatiotemporal network architectures. In image recognition, learning spatially invariant features is a key factor…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Taeoh Kim , Hyeongmin Lee , MyeongAh Cho , Ho Seong Lee , Dong Heon Cho , Sangyoun Lee

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

Learning feature representation from discriminative local regions plays a key role in fine-grained visual classification. Employing attention mechanisms to extract part features has become a trend. However, there are two major limitations…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Jianwei Song , Ruoyu Yang

We propose Booster, a novel accelerator for gradient boosting trees based on the unique characteristics of gradient boosting models. We observe that the dominant steps of gradient boosting training (accounting for 90-98% of training time)…

Hardware Architecture · Computer Science 2020-11-06 Mingxuan He , T. N. Vijaykumar , Mithuna Thottethodi

Multi-step time-series prediction is an essential supportive step for decision-makers in several industrial areas. Artificial intelligence techniques, which use a neural network component in various forms, have recently frequently been used…

Machine Learning · Computer Science 2025-12-11 Tony Salloom , Okyay Kaynak , Xinbo Yub , Wei He

We present VBPI-Mixtures, an algorithm designed to enhance the accuracy of phylogenetic posterior distributions, particularly for tree-topology and branch-length approximations. Despite the Variational Bayesian Phylogenetic Inference…

Machine Learning · Computer Science 2023-10-03 Oskar Kviman , Ricky Molén , Jens Lagergren

Boosting methods are among the best general-purpose and off-the-shelf machine learning approaches, gaining widespread popularity. In this paper, we seek to develop a boosting method that yields comparable accuracy to popular AdaBoost and…

Machine Learning · Statistics 2021-09-21 Mohammad Taha Toghani , Genevera I. Allen

The effects of different parametrizations on the convergence of Bayesian computational algorithms for hierarchical models are well explored. Techniques such as centering, noncentering and partial noncentering can be used to accelerate…

Computation · Statistics 2015-03-20 Linda S. L. Tan , David J. Nott

Statistical boosting algorithms have triggered a lot of research during the last decade. They combine a powerful machine-learning approach with classical statistical modelling, offering various practical advantages like automated variable…

Despite their theoretical appealingness, Bayesian neural networks (BNNs) are left behind in real-world adoption, mainly due to persistent concerns on their scalability, accessibility, and reliability. In this work, we develop the…

Machine Learning · Computer Science 2022-10-14 Zhijie Deng , Jun Zhu

As a computational alternative to Markov chain Monte Carlo approaches, variational inference (VI) is becoming more and more popular for approximating intractable posterior distributions in large-scale Bayesian models due to its comparable…

Machine Learning · Statistics 2023-06-05 Anirban Bhattacharya , Debdeep Pati , Yun Yang

We introduce a bottleneck method for learning data representations based on information deficiency, rather than the more traditional information sufficiency. A variational upper bound allows us to implement this method efficiently. The…

Information Theory · Computer Science 2020-11-05 Pradeep Kr. Banerjee , Guido Montúfar

As modern neural networks get more complex, specifying a model with high predictive performance and sound uncertainty quantification becomes a more challenging task. Despite some promising theoretical results on the true posterior…

Machine Learning · Computer Science 2025-06-18 Alisa Sheinkman , Sara Wade

This paper introduces a boosted conformal procedure designed to tailor conformalized prediction intervals toward specific desired properties, such as enhanced conditional coverage or reduced interval length. We employ machine learning…

Methodology · Statistics 2024-11-12 Ran Xie , Rina Foygel Barber , Emmanuel J. Candès

Recent advances in coreset methods have shown that a selection of representative datapoints can replace massive volumes of data for Bayesian inference, preserving the relevant statistical information and significantly accelerating…

Machine Learning · Statistics 2023-01-18 Dionysis Manousakas , Hippolyt Ritter , Theofanis Karaletsos

Many methods that build powerful variational distributions based on unadjusted Langevin transitions exist. Most of these were developed using a wide range of different approaches and techniques. Unfortunately, the lack of a unified analysis…

Machine Learning · Computer Science 2023-03-24 Tomas Geffner , Justin Domke