English
Related papers

Related papers: Generalized Eigenvalue Problems with Generative Pr…

200 papers

In this study, we investigate the performance of two novel first-order optimization algorithms, namely the rescaled-gradient flow (RGF) and the signed-gradient flow (SGF). These algorithms are derived from the forward Euler discretization…

Machine Learning · Computer Science 2025-03-19 Siqi Zhang , Mouhacine Benosman , Orlando Romero

Typical performance of approximation algorithms is studied for randomized minimum vertex cover problems. A wide class of random graph ensembles characterized by an arbitrary degree distribution is discussed with some theoretical frameworks.…

Disordered Systems and Neural Networks · Physics 2016-11-10 Satoshi Takabe , Koji Hukushima

Efficient global optimization is the problem of minimizing an unknown function f, using as few evaluations f(x) as possible. It can be considered as a continuum-armed bandit problem, with noiseless data and simple regret. Expected…

Machine Learning · Statistics 2013-02-19 Adam D. Bull

Artificial intelligence (AI) for fluid mechanics has become attractive topic. High-fidelity data is one of most critical issues for the successful applications of AI in fluid mechanics, however, it is expensively obtained or even…

Machine Learning · Computer Science 2025-09-03 Ruilin Chen

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by generative adversarial networks, or GANs). In this work,…

Machine Learning · Computer Science 2018-10-09 Chinmay Hegde

Standard model-free reinforcement learning algorithms optimize a policy that generates the action to be taken in the current time step in order to maximize expected future return. While flexible, it faces difficulties arising from the…

Machine Learning · Computer Science 2022-02-07 Haichao Zhang , Wei Xu , Haonan Yu

Autoregressive language models are the currently dominant paradigm for text generation, but they have some fundamental limitations that cannot be remedied by scale-for example inherently sequential and unidirectional generation. While…

Computation and Language · Computer Science 2024-08-01 Yuchen Li , Alexandre Kirchmeyer , Aashay Mehta , Yilong Qin , Boris Dadachev , Kishore Papineni , Sanjiv Kumar , Andrej Risteski

We study private synthetic data generation for query release, where the goal is to construct a sanitized version of a sensitive dataset, subject to differential privacy, that approximately preserves the answers to a large collection of…

Machine Learning · Computer Science 2021-12-10 Terrance Liu , Giuseppe Vietri , Zhiwei Steven Wu

This paper proposes a novel method, Explicit Flow Matching (ExFM), for training and analyzing flow-based generative models. ExFM leverages a theoretically grounded loss function, ExFM loss (a tractable form of Flow Matching (FM) loss), to…

Machine Learning · Computer Science 2024-07-03 Gleb Ryzhakov , Svetlana Pavlova , Egor Sevriugov , Ivan Oseledets

Variable selection has become a pivotal choice in data analyses that impacts subsequent inference and prediction. In linear models, variable selection using Second-Generation P-Values (SGPV) has been shown to be as good as any other…

Methodology · Statistics 2021-09-22 Yi Zuo , Thomas G. Stewart , Jeffrey D. Blume

In this work, we propose a novel Parameter-Efficient Fine-Tuning (PEFT) approach based on Gaussian Graphical Models (GGMs), marking the first application of GGMs to PEFT tasks, to the best of our knowledge. The proposed method utilizes the…

Machine Learning · Computer Science 2024-12-12 Jingjing Zheng , Yankai Cao

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Inferring physical fields from sparse observations while strictly satisfying partial differential equations (PDEs) is a fundamental challenge in computational physics. Recently, deep generative models offer powerful data-driven priors for…

Machine Learning · Computer Science 2026-01-29 Zichao Yu , Ming Li , Wenyi Zhang , Difan Zou , Weiguo Gao

Solving large-scale Generalized Eigenvalue Problems (GEPs) is a fundamental yet computationally prohibitive task in science and engineering. As a promising direction, contour integral (CI) methods, such as the CIRR algorithm, offer an…

Machine Learning · Computer Science 2025-11-05 Yeqiu Chen , Ziyan Liu , Hong Wang

In this work, we investigate the use of data-driven equation discovery for dynamical systems to model and forecast continuous-time dynamics of unconstrained optimization problems. To avoid expensive evaluations of the objective function and…

Optimization and Control · Mathematics 2026-02-19 Grant Norman , Conor Rowan , Kurt Maute , Alireza Doostan

A new algorithm, denoted by RSRR, is presented for solving large-scale nonlinear eigenvalue problems (NEPs) with a focus on improving the robustness and reliability of the solution, which is a challenging task in computational science and…

Numerical Analysis · Mathematics 2016-07-27 Jinyou Xiao , Shuangshuang Meng , Chuanzeng Zhang , Changjun Zheng

Our goal is to efficiently compute low-dimensional latent coordinates for nodes in an input graph -- known as graph embedding -- for subsequent data processing such as clustering. Focusing on finite graphs that are interpreted as uniform…

Signal Processing · Electrical Eng. & Systems 2022-03-08 Fei Chen , Gene Cheung , Xue Zhang

We introduce a novel generative model for the representation of joint probability distributions of a possibly large number of discrete random variables. The approach uses measure transport by randomized assignment flows on the statistical…

Machine Learning · Statistics 2025-01-15 Bastian Boll , Daniel Gonzalez-Alvarado , Stefania Petra , Christoph Schnörr

Statistical evaluation aims to estimate the generalization performance of a model using held-out i.i.d.\ test data sampled from the ground-truth distribution. In supervised learning settings such as classification, performance metrics such…

Machine Learning · Computer Science 2026-04-08 Shashaank Aiyer , Yishay Mansour , Shay Moran , Han Shao

We introduce Prior-Informed Flow Matching (PIFM), a conditional flow model for graph reconstruction. Reconstructing graphs from partial observations remains a key challenge; classical embedding methods often lack global consistency, while…

Machine Learning · Computer Science 2026-01-30 Harvey Chen , Nicolas Zilberstein , Santiago Segarra