English
Related papers

Related papers: An Embedding Framework for the Design and Analysis…

200 papers

Node embedding methods find latent lower-dimensional representations which are used as features in machine learning models. In the last few years, these methods have become extremely popular as a replacement for manual feature engineering.…

Social and Information Networks · Computer Science 2020-06-01 Christoph Martin , Meike Riebeling

We introduce and study various algorithms for solving nonconvex minimization with inequality constraints, based on the construction of convex surrogate envelopes that majorize the objective and the constraints. In the case where the…

Optimization and Control · Mathematics 2025-06-11 Nuozhou Wang , Junyu Zhang , Shuzhong Zhang

Autoencoders are commonly trained using element-wise loss. However, element-wise loss disregards high-level structures in the image which can lead to embeddings that disregard them as well. A recent improvement to autoencoders that helps…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Gustav Grund Pihlgren , Fredrik Sandin , Marcus Liwicki

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its performance critically depends on the choice of the uncertainty set. While large sets ensure reliability, they often lead to overly…

Machine Learning · Computer Science 2026-05-15 Shuyi Chen , Wenbin Zhou , Shixiang Zhu

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

Optimization and Control · Mathematics 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

When minimizing the empirical risk in binary classification, it is a common practice to replace the zero-one loss with a surrogate loss to make the learning objective feasible to optimize. Examples of well-known surrogate losses for binary…

Machine Learning · Statistics 2023-06-07 Nontawat Charoenphakdee , Jongyeong Lee , Masashi Sugiyama

Deep learning has received much attention lately due to the impressive empirical performance achieved by training algorithms. Consequently, a need for a better theoretical understanding of these problems has become more evident in recent…

Machine Learning · Computer Science 2022-03-03 Daniel Bienstock , Gonzalo Muñoz , Sebastian Pokutta

Modeling groundwater flow in three-dimensional fractured crystalline media requires accounting for strong spatial heterogeneity induced by fractures. Fine-scale discrete fracture-matrix (DFM) simulations can capture this complexity but are…

Machine Learning · Computer Science 2026-04-06 Martin Špetlík , Jan Březina

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

In a task where many similar inverse problems must be solved, evaluating costly simulations is impractical. Therefore, replacing the model $y$ with a surrogate model $y_s$ that can be evaluated quickly leads to a significant speedup. The…

Numerical Analysis · Mathematics 2024-05-15 Phillip Semler , Martin Weiser

Minimizing an adversarial surrogate risk is a common technique for learning robust classifiers. Prior work showed that convex surrogate losses are not statistically consistent in the adversarial context -- or in other words, a minimizing…

Machine Learning · Computer Science 2025-09-29 Natalie S. Frank

In the present work, two machine learning based constitutive models for finite deformations are proposed. Using input convex neural networks, the models are hyperelastic, anisotropic and fulfill the polyconvexity condition, which implies…

Materials Science · Physics 2021-11-29 Dominik K. Klein , Mauricio Fernández , Robert J. Martin , Patrizio Neff , Oliver Weeger

The incremental poses computed through odometry can be integrated over time to calculate the pose of a device with respect to an initial location. The resulting global pose may be used to formulate a second, consistency based, loss term in…

Machine Learning · Computer Science 2021-07-02 Hamed Damirchi , Rooholla Khorrambakht , Hamid D. Taghirad , Behzad Moshiri

Deep embeddings answer one simple question: How similar are two images? Learning these embeddings is the bedrock of verification, zero-shot learning, and visual search. The most prominent approaches optimize a deep convolutional network…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chao-Yuan Wu , R. Manmatha , Alexander J. Smola , Philipp Krähenbühl

Model error estimation remains one of the key challenges in uncertainty quantification and predictive science. For computational models of complex physical systems, model error, also known as structural error or model inadequacy, is often…

Computation · Statistics 2024-03-28 Khachik Sargsyan , Xun Huan , Habib N. Najm

This paper addresses the task of learning convex regularizers to guide the reconstruction of images from limited data. By imposing that the reconstruction be amplitude-equivariant, we narrow down the class of admissible functionals to those…

Machine Learning · Statistics 2026-01-19 Michael Unser , Stanislas Ducotterd

Vector retrieval systems exhibit significant performance variance across queries due to heterogeneous embedding quality. We propose a lightweight framework for predicting retrieval performance at the query level by combining quantization…

Information Retrieval · Computer Science 2025-07-09 Y. Du

In this paper, we show that simple {Stochastic} subGradient Decent methods with multiple Restarting, named {\bf RSGD}, can achieve a \textit{linear convergence rate} for a class of non-smooth and non-strongly convex optimization problems…

Machine Learning · Computer Science 2016-04-01 Tianbao Yang , Qihang Lin

Complex engineering models are typically computationally demanding and defined by a high-dimensional parameter space challenging the comprehensive exploration of parameter effects and design optimization. To overcome this curse of…

Applications · Statistics 2024-03-01 Corey Arndt , Cody Crusenberry , Bozhi Heng , Rochelle Butler , Stephanie TerMaath

We study the polyhedral structure of the static probabilistic lot-sizing problem and propose valid inequalities that integrate information from the chance constraint and the binary setup variables. We prove that the proposed inequalities…

Optimization and Control · Mathematics 2020-06-02 Xiao Liu , Simge Kucukyavuz