English
Related papers

Related papers: Likelihood transform: making optimization and para…

200 papers

The Lottery Ticket Hypothesis (LTH) posits the existence of a sparse subnetwork (a.k.a. winning ticket) that can generalize comparably to its over-parameterized counterpart when trained from scratch. The common approach to finding a winning…

Machine Learning · Computer Science 2025-04-09 Junghun Oh , Sungyong Baik , Kyoung Mu Lee

Many recent efforts have been devoted to designing sophisticated deep learning structures, obtaining revolutionary results on benchmark datasets. The success of these deep learning methods mostly relies on an enormous volume of labeled…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Jiaji Huang , Qiang Qiu , Robert Calderbank , Guillermo Sapiro

In this work, we explore a possible application of a machine learning classifier for candidate events in a template-based search for gravitational-wave (GW) signals from various compact system sources. We analyze data from the O3a and O3b…

General Relativity and Quantum Cosmology · Physics 2026-03-31 Lorenzo Mobilia , Gianluca Maria Guidi

Multi-reference alignment entails estimating a signal in $\mathbb{R}^L$ from its circularly-shifted and noisy copies. This problem has been studied thoroughly in recent years, focusing on the finite-dimensional setting (fixed $L$).…

Information Theory · Computer Science 2021-10-01 Elad Romanov , Tamir Bendory , Or Ordentlich

This paper describes the most accurate analytical frequentist assessment to date of the uncertainties in the estimation of physical parameters from gravitational waves generated by non spinning binary systems and Earth-based networks of…

General Relativity and Quantum Cosmology · Physics 2013-05-29 Salvatore Vitale , Michele Zanolin

Many interesting and fundamentally practical optimization problems, ranging from optics, to signal processing, to radar and acoustics, involve constraints on the Fourier transform of a function. It is well-known that the {\em fast Fourier…

Optimization and Control · Mathematics 2012-09-05 Robert J. Vanderbei

Motivation: Gene selection has become a common task in most gene expression studies. The objective of such research is often to identify the smallest possible set of genes that can still achieve good predictive performance. The problem of…

As a technique to investigate link-level loss rates of a computer network with low operational cost, loss tomography has received considerable attentions in recent years. A number of parameter estimation methods have been proposed for loss…

Methodology · Statistics 2015-10-27 Ke Deng , Yang Li , Weiping Zhu , Jun S. Liu

Parameter-free stochastic optimization aims to design algorithms that are agnostic to the underlying problem parameters while still achieving convergence rates competitive with optimally tuned methods. While some parameter-free methods do…

Machine Learning · Computer Science 2026-04-21 Yuheng Zhao , Yu-Hu Yan , Amit Attia , Tomer Koren , Lijun Zhang , Peng Zhao

Nonlinear optimization methods are typically iterative and make use of gradient information to determine a direction of improvement and function information to effectively check for progress. When this information is corrupted by noise,…

Optimization and Control · Mathematics 2025-10-21 Albert S. Berahas , Michael J. O'Neill , Clément W. Royer

We investigate the problem of designing optimal classifiers in the strategic classification setting, where the classification is part of a game in which players can modify their features to attain a favorable classification outcome (while…

Machine Learning · Computer Science 2020-05-19 Mark Braverman , Sumegha Garg

This study addresses the predictive limitation of probabilistic circuits and introduces transformations as a remedy to overcome it. We demonstrate this limitation in robotic scenarios. We motivate that independent component analysis is a…

Machine Learning · Statistics 2023-10-09 Tom Schierenbeck , Vladimir Vutov , Thorsten Dickhaus , Michael Beetz

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

Composite likelihood has shown promise in settings where the number of parameters $p$ is large due to its ability to break down complex models into simpler components, thus enabling inference even when the full likelihood is not tractable.…

Methodology · Statistics 2021-07-21 Claudia Di Caterina , Davide Ferrari

Chirp signals have established diverse applications caused by the capable of producing time-dependent linear frequencies. Most feature extraction transformation methods for chirp signals focus on enhancing the performance of transform…

Signal Processing · Electrical Eng. & Systems 2024-01-11 Shuyi Gu , Zhenghua Luo , Lin Hu , Yilin Zhang , Junxiong Guo

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

When inferring parameters from a Gaussian-distributed data set by computing a likelihood, a covariance matrix is needed that describes the data errors and their correlations. If the covariance matrix is not known a priori, it may be…

Cosmology and Nongalactic Astrophysics · Physics 2016-01-27 Elena Sellentin , Alan F. Heavens

Template-based searches for gravitational waves are often limited by the computational cost associated with searching large parameter spaces. The study of efficient template banks, in the sense of using the smallest number of templates, is…

General Relativity and Quantum Cosmology · Physics 2010-04-15 C. Messenger , R. Prix , M. A. Papa

Tree search is a fundamental tool for planning, as many sequential decision-making problems can be framed as searching over tree-structured spaces. We propose an uncertainty-guided tree search algorithm for settings where the reward…

Machine Learning · Computer Science 2025-09-05 Julia Grosse , Ruotian Wu , Ahmad Rashid , Cheng Zhang , Philipp Hennig , Pascal Poupart , Agustinus Kristiadi

Probabilistic approach to Boolean matrix factorization can provide solutions robustagainst noise and missing values with linear computational complexity. However,the assumption about latent factors can be problematic in real world…

Machine Learning · Statistics 2019-05-31 Lifan Liang , Songjian Lu