English
Related papers

Related papers: Incremental Sparse Bayesian Ordinal Regression

200 papers

Dense embedding models are commonly deployed in commercial search engines, wherein all the document vectors are pre-computed, and near-neighbor search (NNS) is performed with the query vector to find relevant documents. However, the…

Machine Learning · Computer Science 2020-09-01 Tharun Medini , Beidi Chen , Anshumali Shrivastava

Despite impressive advances in simultaneous localization and mapping, dense robotic mapping remains challenging due to its inherent nature of being a high-dimensional inference problem. In this paper, we propose a dense semantic robotic…

Robotics · Computer Science 2017-09-26 Lu Gan , Maani Ghaffari Jadidi , Steven A. Parkison , Ryan M. Eustice

Sparse regression has emerged as a popular technique for learning dynamical systems from temporal data, beginning with the SINDy (Sparse Identification of Nonlinear Dynamics) framework proposed by arXiv:1509.03580. Quantifying the…

Methodology · Statistics 2023-08-21 Sara Venkatraman , Sumanta Basu , Martin T. Wells

Standard (network) meta-analysis methods for medical test accuracy evaluation analyse the data separately for each test threshold - wasting data - unless every study reports all thresholds. Previously proposed "multiple threshold" models…

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

Isotonic distributional regression (IDR) is a powerful nonparametric technique for the estimation of conditional distributions under order restrictions. In a nutshell, IDR learns conditional distributions that are calibrated, and…

Methodology · Statistics 2021-09-29 Alexander Henzi , Johanna F. Ziegel , Tilmann Gneiting

Supervised learning models are challenged by the intrinsic complexities of training data such as outliers and minority subpopulations and intentional attacks at inference time with adversarial samples. While traditional robust learning…

Machine Learning · Computer Science 2023-09-12 Shu Hu , Zhenhuan Yang , Xin Wang , Yiming Ying , Siwei Lyu

We propose a novel approach to sequential Bayesian inference based on variational Bayes (VB). The key insight is that, in the online setting, we do not need to add the KL term to regularize to the prior (which comes from the posterior at…

Machine Learning · Statistics 2024-11-01 Matt Jones , Peter Chang , Kevin Murphy

Ordinal learning (OL) is a type of machine learning models with broad utility in health care applications such as diagnosis of different grades of a disease (e.g., mild, modest, severe) and prediction of the speed of disease progression…

Machine Learning · Computer Science 2023-12-18 Lujia Wang , Hairong Wang , Yi Su , Fleming Lure , Jing Li

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

As the pursuit of synergy between Artificial Intelligence (AI) and Operations Research (OR) gains momentum in handling complex inventory systems, a critical challenge persists: how to effectively reconcile AI's adaptive perception with OR's…

Artificial Intelligence · Computer Science 2026-01-07 Lingjie Zhao , Xue Yu , Yongzhi Qi , Hao Hu , Jianshen Zhang , Yingzheng Ma , Shuyu Han , Wei Qi , Zuo-Jun Max Shen

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

Neural networks (NNs) are primarily developed within the frequentist statistical framework. Nevertheless, frequentist NNs lack the capability to provide uncertainties in the predictions, and hence their robustness can not be adequately…

Computational Engineering, Finance, and Science · Computer Science 2023-10-26 Nastaran Dabiran , Brandon Robinson , Rimple Sandhu , Mohammad Khalil , Dominique Poirel , Abhijit Sarkar

The main contribution of the paper is a new approach to subspace clustering that is significantly more computationally efficient and scalable than existing state-of-the-art methods. The central idea is to modify the regression technique in…

Machine Learning · Statistics 2018-07-11 Urvashi Oswal , Robert Nowak

Ordinal response model is a popular and commonly used regression for ordered categorical data in a wide range of fields such as medicine and social sciences. However, it is empirically known that the existence of ``outliers'', combinations…

Methodology · Statistics 2023-05-15 Tomotaka Momozaki , Tomoyuki Nakagawa

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

We introduce a dynamic sparse training algorithm based on linearized Bregman iterations / mirror descent that exploits the naturally incurred sparsity by alternating between periods of static and dynamic sparsity pattern updates. The key…

Machine Learning · Computer Science 2026-05-19 Yannick Lunk , Sebastian J. Scott , Leon Bungert

The use of the proportional odds (PO) model for ordinal regression is ubiquitous in the literature. If the assumption of parallel lines does not hold for the data, then an alternative is to specify a non-proportional odds (NPO) model, where…

Methodology · Statistics 2015-03-27 Trevelyan J. McKinley , Michelle Morters , James L. N. Wood

Spare representation of signals has received significant attention in recent years. Based on these developments, a sparse representation-based classification (SRC) has been proposed for a variety of classification and related tasks,…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Minshan Cui , Saurabh Prasad

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál