English
Related papers

Related papers: Trace Ratio Optimization with an Application to Mu…

200 papers

Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Jérémy Scanvic , Mike Davies , Patrice Abry , Julián Tachella

Personalized Federated Learning (PFL) has witnessed remarkable advancements, enabling the development of innovative machine learning applications that preserve the privacy of training data. However, existing theoretical research in this…

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

Many machine learning problems involve regressing variables on a non-Euclidean manifold -- e.g. a discrete probability distribution, or the 6D pose of an object. One way to tackle these problems through gradient-based learning is to use a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Romain Brégier

Robust and accurate visual tracking is one of the most challenging computer vision problems. Due to the inherent lack of training data, a robust approach for constructing a target appearance model is crucial. Recently, discriminatively…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Martin Danelljan , Gustav Häger , Fahad Shahbaz Khan , Michael Felsberg

This paper proposes a novel analysis for the Scaffold algorithm, a popular method for dealing with data heterogeneity in federated learning. While its convergence in deterministic settings--where local control variates mitigate client…

Machine Learning · Statistics 2025-03-11 Paul Mangold , Alain Durmus , Aymeric Dieuleveut , Eric Moulines

We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$,…

Optimization and Control · Mathematics 2026-05-26 Dinh Van Tiep , Nguyen Thanh Son

In recent years, interest in gradient-based optimization over Riemannian manifolds has surged. However, a significant challenge lies in the reliance on hyperparameters, especially the learning rate, which requires meticulous tuning by…

Machine Learning · Computer Science 2024-06-05 Daniel Dodd , Louis Sharrock , Christopher Nemeth

Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse…

Machine Learning · Computer Science 2022-10-14 Philipp Holl , Vladlen Koltun , Nils Thuerey

We address the problem of computing the smallest symplectic eigenvalues and the corresponding eigenvectors of symmetric positive-definite matrices in the sense of Williamson's theorem. It is formulated as minimizing a trace cost function…

Optimization and Control · Mathematics 2022-01-06 Nguyen Thanh Son , P. -A. Absil , Bin Gao , Tatjana Stykel

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

Machine Learning · Computer Science 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

Machine learning is at the heart of managing the real-world problems associated with massive data. With the success of neural networks on such large-scale problems, more research in machine learning is being conducted now than ever before.…

Machine Learning · Computer Science 2026-02-23 Ryan O'Dowd

For visual tracking, an ideal filter learned by the correlation filter (CF) method should take both discrimination and reliability information. However, existing attempts usually focus on the former one while pay less attention to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Chong Sun , Dong Wang , Huchuan Lu , Ming-Hsuan Yang

Transductive few-shot learning algorithms have showed substantially superior performance over their inductive counterparts by leveraging the unlabeled queries. However, the vast majority of such methods are evaluated on perfectly…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Michalis Lazarou , Yannis Avrithis , Tania Stathaki

We consider the problem of simultaneously clustering and learning a linear representation of data lying close to a union of low-dimensional manifolds, a fundamental task in machine learning and computer vision. When the manifolds are…

Machine Learning · Computer Science 2023-08-25 Tianjiao Ding , Shengbang Tong , Kwan Ho Ryan Chan , Xili Dai , Yi Ma , Benjamin D. Haeffele

During the recent years, correlation filters have shown dominant and spectacular results for visual object tracking. The types of the features that are employed in these family of trackers significantly affect the performance of visual…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Erhan Gundogdu , A. Aydin Alatan

This paper proposes an intrinsic pseudospectral convexification framework for optimal control problems with manifold constraints. While successive pseudospectral convexification combines spectral collocation with successive convexification,…

Optimization and Control · Mathematics 2025-12-11 Tatsuya Narumi , Shin-ichiro Sakai

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

In this paper, we focus on the unsupervised multi-view feature selection which tries to handle high dimensional data in the field of multi-view learning. Although some graph-based methods have achieved satisfactory performance, they ignore…

Machine Learning · Computer Science 2021-04-13 Qi Wang , Xu Jiang , Mulin Chen , Xuelong Li