English
Related papers

Related papers: Convergence of Parameter Estimates for Regularized…

200 papers

This study evaluates metrics for tasks such as classification, regression, clustering, correlation analysis, statistical tests, segmentation, and image-to-image (I2I) translation. Metrics were compared across Python libraries, R packages,…

We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times.…

Machine Learning · Computer Science 2021-06-10 Aaron Ferber , Jialin Song , Bistra Dilkina , Yisong Yue

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

Machine Learning · Computer Science 2025-02-25 Muthu Chidambaram , Rong Ge

Despite recent advances in implicit neural representations (INRs), it remains challenging for a coordinate-based multi-layer perceptron (MLP) of INRs to learn a common representation across data instances and generalize it for unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Chiheon Kim , Doyup Lee , Saehoon Kim , Minsu Cho , Wook-Shin Han

We investigate a novel non-parametric regression-based clustering algorithm for longitudinal data analysis. Combining natural cubic splines with Gaussian mixture models (GMM), the algorithm can produce smooth cluster means that describe the…

Methodology · Statistics 2022-09-20 Peter Mlakar , Tapio Nummi , Polona Oblak , Jana Faganeli Pucer

In this paper, we propose a Bi-layer Predictionbased Reduction Branch (BP-RB) framework to speed up the process of finding a high-quality feasible solution for Mixed Integer Programming (MIP) problems. A graph convolutional network (GCN) is…

Optimization and Control · Mathematics 2022-09-28 Lingying Huang , Xiaomeng Chen , Wei Huo , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

We derive a new margin-based regularization formulation, termed multi-margin regularization (MMR), for deep neural networks (DNNs). The MMR is inspired by principles that were applied in margin analysis of shallow linear classifiers, e.g.,…

Machine Learning · Computer Science 2020-09-15 Berry Weinstein , Shai Fine , Yacov Hel-Or

This paper introduces a consistent estimator and rate of convergence for the precision matrix of asset returns in large portfolios using a non-linear factor model within the deep learning framework. Our estimator remains valid even in low…

Machine Learning · Statistics 2023-08-30 Mehmet Caner , Maurizio Daniele

Mixed-integer linear programming (MILP) is a powerful tool for addressing a wide range of real-world problems, but it lacks a clear structure for comparing instances. A reliable similarity metric could establish meaningful relationships…

Machine Learning · Computer Science 2025-07-16 Gwen Maudet , Grégoire Danoy

For identifying the non-Gaussian impulsive noise systems, normalized LMP (NLMP) has been proposed to combat impulsive-inducing instability. However, the standard algorithm is without considering the inherent sparse structure distribution of…

Information Theory · Computer Science 2015-03-04 Wentao Ma , Hua Qu , Jihong Zhao , Badong Chen , Guan Gui

Variable selection is an old and pervasive problem in regression analysis. One solution is to impose a lasso penalty to shrink parameter estimates toward zero and perform continuous model selection. The lasso-penalized mixture of linear…

Applications · Statistics 2016-05-04 Luke R. Lloyd-Jones , Hien D. Nguyen , Geoffrey J. McLachlan

Fast and accurate large-scale energy system models are needed to investigate the potential of storage to complement the fluctuating energy production of renewable energy systems. However, standard Mixed-Integer Programming (MIP) models that…

We consider the MAP-MRF inference task, that is, minimizing a function of discrete variables represented as a sum of unary and pairwise terms. A prominent approach for tackling this NP-hard problem in practice is to solve its natural LP…

Data Structures and Algorithms · Computer Science 2026-05-14 Asaf Lev-Ran , Pavel Arkhipov , Vladimir Kolmogorov

We consider the problem of clustering in the presence of noise. That is, when on top of cluster structure, the data also contains a subset of \emph{unstructured} points. Our goal is to detect the clusters despite the presence of many…

Machine Learning · Computer Science 2018-08-28 Shrinu Kushagra , Yaoliang Yu , Shai Ben-David

Recent advancements in Mixed Integer Optimization (MIO) algorithms, paired with hardware enhancements, have led to significant speedups in resolving MIO problems. These strategies have been utilized for optimal subset selection,…

Methodology · Statistics 2024-03-27 Madhav Sankaranarayanan , Intekhab Hossain , Tom Chen

Mixed integer nonlinear programs (MINLPs) are arguably among the hardest optimization problems, with a wide range of applications. MINLP solvers that are based on linear relaxations and spatial branching work similar as mixed integer…

Optimization and Control · Mathematics 2019-02-08 Jakob Witzig , Timo Berthold , Stefan Heinz

Selecting hyperparameters for unsupervised learning problems is challenging in general due to the lack of ground truth for validation. Despite the prevalence of this issue in statistics and machine learning, especially in clustering…

Machine Learning · Statistics 2020-02-04 Xinjie Fan , Yuguang Yue , Purnamrita Sarkar , Y. X. Rachel Wang

Zero-shot multi-label recognition (MLR) with Vision-Language Models (VLMs) faces significant challenges without training data, model tuning, or architectural modifications. Existing approaches require prompt tuning or architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Kevin Miller , Samarth Mishra , Aditya Gangrade , Kate Saenko , Venkatesh Saligrama

Mixed Integer Linear Programs (MILP) are well known to be NP-hard (Non-deterministic Polynomial-time hard) problems in general. Even though pure optimization-based methods, such as constraint generation, are guaranteed to provide an optimal…

Optimization and Control · Mathematics 2022-07-18 Asunción Jiménez-Cordero , Juan Miguel Morales , Salvador Pineda

In this paper, we consider orthogonal matching pursuit (OMP) algorithm for multiple measurement vectors (MMV) problem. The robustness of OMPMMV is studied under general perturbations---when the measurement vectors as well as the sensing…

Information Theory · Computer Science 2011-09-30 Jie Ding , Laming Chen , Yuantao Gu