English
Related papers

Related papers: Element-wise uniqueness, prior knowledge, and data…

200 papers

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

We present a numerical framework for recovering unknown non-autonomous dynamical systems with time-dependent inputs. To circumvent the difficulty presented by the non-autonomous nature of the system, our method transforms the solution state…

Signal Processing · Electrical Eng. & Systems 2020-06-04 Tong Qin , Zhen Chen , John Jakeman , Dongbin Xiu

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

Many real world problems can be expressed as optimisation problems. Solving this kind of problems means to find, among all possible solutions, the one that maximises an evaluation function. One approach to solve this kind of problem is to…

Artificial Intelligence · Computer Science 2012-04-24 Patrick Taillandier , Cécile Duchêne , Alexis Drogoul

We revisit the problem of robust principal component analysis with features acting as prior side information. To this aim, a novel, elegant, non-convex optimization approach is proposed to decompose a given observation matrix into a…

Machine Learning · Statistics 2017-09-15 Niannan Xue , Jiankang Deng , Yannis Panagakis , Stefanos Zafeiriou

In many real world problems, optimization decisions have to be made with limited information. The decision maker may have no a priori or posteriori data about the often nonconvex objective function except from on a limited number of points…

Optimization and Control · Mathematics 2011-11-10 Tansu Alpcan

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

Convex optimization problems arising in applications often have favorable objective functions and complicated constraints, thereby precluding first-order methods from being immediately applicable. We describe an approach that exchanges the…

Optimization and Control · Mathematics 2016-02-05 Aleksandr Y. Aravkin , James V. Burke , Dmitriy Drusvyatskiy , Michael P. Friedlander , Scott Roy

Industrial and scientific applications handle large volumes of data that render manual validation by humans infeasible. Therefore, we require automated data validation approaches that are able to consider the prior knowledge of domain…

Machine Learning · Computer Science 2023-03-10 Florian Bachinger , Gabriel Kronberger

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Regularization is used in many different areas of optimization when solutions are sought which not only minimize a given function, but also possess a certain degree of regularity. Popular applications are image denoising, sparse regression…

Optimization and Control · Mathematics 2021-11-15 Bennet Gebken , Katharina Bieker , Sebastian Peitz

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

A key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties. Existing work that provably achieves this goal relies on strong assumptions on relationships between the latent…

Machine Learning · Computer Science 2021-11-01 Kartik Ahuja , Jason Hartford , Yoshua Bengio

Ocular biometric systems working in unconstrained environments usually face the problem of small within-class compactness caused by the multiple factors that jointly degrade the quality of the obtained data. In this work, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Luiz A. Zanlorensi , Hugo Proença , David Menotti

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

A finite element methodology for large classes of variational boundary value problems is defined which involves discretizing two linear operators: (1) the differential operator defining the spatial boundary value problem; and (2) a Riesz…

Numerical Analysis · Mathematics 2017-12-08 Brendan Keith , Socratis Petrides , Federico Fuentes , Leszek Demkowicz

Many real-world decision processes are modeled by optimization problems whose defining parameters are unknown and must be inferred from observable data. The Predict-Then-Optimize framework uses machine learning models to predict unknown…

Machine Learning · Computer Science 2023-11-23 James Kotary , Vincenzo Di Vito , Jacob Christopher , Pascal Van Hentenryck , Ferdinando Fioretto

We present an end-to-end framework for generating solutions to combinatorial optimization problems with unknown components using transformer-based sequence-to-sequence neural networks. Our framework learns directly from past solutions and…

Optimization and Control · Mathematics 2026-02-06 Macarena Navarro , Willem-Jan van Hoeve , Karan Singh

Emergences of computers and information technological revolution made tremendous changes in the real world and provides a different dimension for the intelligent data analysis. Well formed fact, the information at right time and at right…

Artificial Intelligence · Computer Science 2011-08-10 D. P. Acharjya , L. Ezhilarasi