English
Related papers

Related papers: Distance-Based Bias in Model-Directed Optimization…

200 papers

In applications with significant class imbalance or asymmetric costs, metrics such as the $F_\beta$-measure, AM measure, Jaccard similarity coefficient, and weighted accuracy offer more suitable evaluation criteria than standard binary…

Machine Learning · Computer Science 2025-12-30 Anqi Mao , Mehryar Mohri , Yutao Zhong

We present a practical approach to solving distance-based optimization problems using optical computing hardware. The objective is to minimize an energy function defined as the weighted sum of squared differences between measured distances…

Optics · Physics 2025-07-16 Guangyao Li , Richard Zhipeng Wang , Natalia G. Berloff

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

We introduce a novel bias-variance decomposition for a range of strictly convex margin losses, including the logistic loss (minimized by the classic LogitBoost algorithm), as well as the squared margin loss and canonical boosting loss.…

Machine Learning · Statistics 2022-04-27 Danny Wood , Tingting Mu , Gavin Brown

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

Metric learning aims to learn a distance metric such that semantically similar instances are pulled together while dissimilar instances are pushed away. Many existing methods consider maximizing or at least constraining a distance margin in…

Machine Learning · Statistics 2022-08-17 Xiaochen Yang , Yiwen Guo , Mingzhi Dong , Jing-Hao Xue

With the recent wave of digitalization, specifically in the context of safety-critical applications, there has been a growing need for computationally efficient, accurate, generalizable, and trustworthy models. Physics-based models have…

Numerical Analysis · Mathematics 2023-09-20 Sondre Sørbø , Sindre Stenen Blakseth , Adil Rasheed , Trond Kvamsdal , Omer San

Generally, multi-objective optimisation problems are solved exactly or approximated by solving a series of scalarisations, for example by dichotomic search. In this paper, we take a different approach and attempt to compute the set of all…

Optimization and Control · Mathematics 2026-01-28 Oliver Bachtler , Felix Fritz , Stefan Ruzika

The predict+optimize problem combines machine learning ofproblem coefficients with a combinatorial optimization prob-lem that uses the predicted coefficients. While this problemcan be solved in two separate stages, it is better to…

Machine Learning · Computer Science 2020-12-07 Ali Ugur Guler , Emir Demirovic , Jeffrey Chan , James Bailey , Christopher Leckie , Peter J. Stuckey

Personalized recommender systems are playing an increasingly important role as more content and services become available and users struggle to identify what might interest them. Although matrix factorization and deep learning based methods…

Information Retrieval · Computer Science 2021-01-14 Chen Ma , Liheng Ma , Yingxue Zhang , Ruiming Tang , Xue Liu , Mark Coates

Feedback optimization is an increasingly popular control paradigm to optimize dynamical systems, accounting for control objectives that concern the system operation at steady-state. Existing feedback optimization techniques heavily rely on…

Optimization and Control · Mathematics 2025-04-08 Amir Mehrnoosh , Gianluca Bianchin

Multiplicative noise models are often used instead of additive noise models in cases in which the noise variance depends on the state. Furthermore, when Poisson distributions with relatively small counts are approximated with normal…

Optimization and Control · Mathematics 2018-06-08 Ruanui Nicholson , Jari P. Kaipio

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

We present an efficient, principled, and interpretable technique for inferring module assignments and for identifying the optimal number of modules in a given network. We show how several existing methods for finding modules can be…

Data Analysis, Statistics and Probability · Physics 2008-06-23 Jake M. Hofman , Chris H. Wiggins

A well-defined distance on the parameter space is key to evaluating estimators, ensuring consistency, and building confidence sets. While there are typically standard distances to adopt in a continuous space, this is not the case for…

Statistics Theory · Mathematics 2026-02-02 Armeen Taeb , F. Richard Guo , Leonard Henckel

Metric-based meta-learning has attracted a lot of attention due to its effectiveness and efficiency in few-shot learning. Recent studies show that metric scaling plays a crucial role in the performance of metric-based meta-learning…

Machine Learning · Computer Science 2020-08-27 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-lai Chung

In this paper, we propose a variable metric method for unconstrained multiobjective optimization problems (MOPs). First, a sequence of points is generated using different positive definite matrices in the generic framework. It is proved…

Optimization and Control · Mathematics 2022-07-18 Jian Chen , Gaoxi Li , Xinmin Yang

We initiate the systematic study of decision-theoretic metrics in the design and analysis of algorithms with machine-learned predictions. We introduce approaches based on both deterministic measures such as distance-based evaluation, that…

Data Structures and Algorithms · Computer Science 2025-09-16 Spyros Angelopoulos , Christoph Dürr , Georgii Melidi

Non-convex optimization problems have multiple local optimal solutions. Non-convex optimization problems are commonly found in numerous applications. One of the methods recently proposed to efficiently explore multiple local optimal…

Optimization and Control · Mathematics 2022-01-31 Mohamed Tarek , Yijiang Huang

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh