English
Related papers

Related papers: Leveraging Low-Rank Relations Between Surrogate Ta…

200 papers

The problem of learning a correspondence relationship between nodes of two networks has drawn much attention of the computer science community and recently that of statisticians. The unseeded version of this problem, in which we do not know…

Methodology · Statistics 2018-08-24 Yuan Zhang

Several tasks in machine learning are evaluated using non-differentiable metrics such as mean average precision or Spearman correlation. However, their non-differentiability prevents from using them as objective functions in a learning…

Machine Learning · Computer Science 2019-04-10 Martin Engilberge , Louis Chevallier , Patrick Pérez , Matthieu Cord

While there are many studies on weight regularization, the study on structure regularization is rare. Many existing systems on structured prediction focus on increasing the level of structural dependencies within the model. However, this…

Machine Learning · Computer Science 2015-02-02 Xu Sun

The data made available for analysis are becoming more and more complex along several directions: high dimensionality, number of examples and the amount of labels per example. This poses a variety of challenges for the existing machine…

Machine Learning · Computer Science 2020-08-11 Matej Petković , Sašo Džeroski , Dragi Kocev

High-fidelity electromagnetic (EM) simulations are indispensable for the design of microwave and wave devices, yet repeated full-wave evaluations over high-dimensional design spaces are often computationally prohibitive. While neural…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Mingze Sun , Liang Li , Xile Zhao , Zheng Tan , Yulu Hu , Xing Li , Bin Li

We study the problem of learning a partially observed matrix under the low rank assumption in the presence of fully observed side information that depends linearly on the true underlying matrix. This problem consists of an important…

Machine Learning · Statistics 2026-02-05 Dimitris Bertsimas , Nicholas A. G. Johnson

We present a detailed study of surrogate losses and algorithms for multi-label learning, supported by $H$-consistency bounds. We first show that, for the simplest form of multi-label loss (the popular Hamming loss), the well-known…

Machine Learning · Computer Science 2024-07-19 Anqi Mao , Mehryar Mohri , Yutao Zhong

The increasing use of stochastic models for describing complex phenomena warrants surrogate models that capture the reference model characteristics at a fraction of the computational cost, foregoing potentially expensive Monte Carlo…

Machine Learning · Computer Science 2024-06-10 Neil Kichler , Sher Afghan , Uwe Naumann

When evaluating quantities of interest that depend on the solutions to differential equations, we inevitably face the trade-off between accuracy and efficiency. Especially for parametrized, time dependent problems in engineering…

Numerical Analysis · Mathematics 2022-12-21 Paolo Conti , Mengwu Guo , Andrea Manzoni , Jan S. Hesthaven

We demonstrate the adaption of three established methods to the field of surrogate machine learning model development. These methods are data augmentation, custom loss functions and transfer learning. Each of these methods have seen…

Machine Learning · Computer Science 2022-11-04 H. Rhys Jones , Tingting Mu , Andrei C. Popescu , Yusuf Sulehman

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

Over the past few years, trace regression models have received considerable attention in the context of matrix completion, quantum state tomography, and compressed sensing. Estimation of the underlying matrix from regularization-based…

Machine Learning · Statistics 2015-04-24 Martin Slawski , Ping Li , Matthias Hein

Surrogate models provide efficient alternatives to computationally demanding real world processes but often require large datasets for effective training. A promising solution to this limitation is the transfer of pre-trained surrogate…

Machine Learning · Computer Science 2025-05-14 Shuaiqun Pan , Diederick Vermetten , Manuel López-Ibáñez , Thomas Bäck , Hao Wang

In multiclass classification over $n$ outcomes, the outcomes must be embedded into the reals with dimension at least $n-1$ in order to design a consistent surrogate loss that leads to the "correct" classification, regardless of the data…

Machine Learning · Computer Science 2026-01-21 Enrique Nueve , Bo Waggoner , Dhamma Kimpara , Jessie Finocchiaro

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov…

Data Analysis, Statistics and Probability · Physics 2013-12-25 AbdoulAhad Validi

Multiple network alignment is the problem of identifying similar and related regions in a given set of networks. While there are a large number of effective techniques for pairwise problems with two networks that scale in terms of edges,…

Social and Information Networks · Computer Science 2018-09-24 Huda Nassar , Georgios Kollias , Ananth Grama , David F. Gleich

In this paper we refine the process of computing calibration functions for a number of multiclass classification surrogate losses. Calibration functions are a powerful tool for easily converting bounds for the surrogate risk (which can be…

Machine Learning · Statistics 2016-09-22 Bernardo Ávila Pires , Csaba Szepesvári

For stochastic process models, parameter inference is often severely bottlenecked by computationally expensive likelihood functions. Simulation-based inference (SBI) bypasses this restriction by constructing amortized surrogate likelihoods,…

Machine Learning · Statistics 2026-05-26 Alexander Shen , Mikael Kuusela

This thesis presents recent advances in model order reduction methods with the primary aim to construct online-efficient reduced surrogate models for parameterized multiscale phenomena and accelerate large-scale PDE-constrained parameter…

Numerical Analysis · Mathematics 2022-11-18 Tim Keil

Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either spurious attributes or target labels, training a debiased…

Machine Learning · Computer Science 2023-10-10 Geon Yeong Park , Chanyong Jung , Sangmin Lee , Jong Chul Ye , Sang Wan Lee