English
Related papers

Related papers: Explainable bilevel optimization: an application t…

200 papers

Automated hyperparameter search in machine learning, especially for deep learning models, is typically formulated as a bilevel optimization problem, with hyperparameter values determined by the upper level and the model learning achieved by…

Machine Learning · Computer Science 2024-12-06 Meltem Apaydin Ustun , Liang Xu , Bo Zeng , Xiaoning Qian

Although image restoration has advanced significantly, most existing methods target only a single type of degradation. In real-world scenarios, images often contain multiple degradations simultaneously, such as rain, noise, and haze,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Hu Gao , Xiaoning Lei , Xichen Xu , Depeng Dang , Lizhuang Ma

We propose an unfolded accelerated projected-gradient descent procedure to estimate model and algorithmic parameters for image super-resolution and molecule localization problems in image microscopy. The variational lower-level constraint…

Numerical Analysis · Mathematics 2024-03-27 Silvia Bonettini , Luca Calatroni , Danilo Pezzi , Marco Prato

Motion blur is a fundamental problem in computer vision as it impacts image quality and hinders inference. Traditional deblurring algorithms leverage the physics of the image formation model and use hand-crafted priors: they usually produce…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Huaijin Chen , Jinwei Gu , Orazio Gallo , Ming-Yu Liu , Ashok Veeraraghavan , Jan Kautz

Bilevel optimization has witnessed a resurgence of interest, driven by its critical role in trustworthy and efficient AI applications. While many recent works have established convergence to stationary points or local minima, obtaining the…

Optimization and Control · Mathematics 2024-12-25 Quan Xiao , Tianyi Chen

In image classification tasks, deep learning models are vulnerable to image distortion. For successful deployment, it is important to identify distortion levels under which the model is usable i.e. its accuracy stays above a stipulated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Dang Nguyen , Sunil Gupta

Current state-of-the-art solution techniques for solving bilevel optimization problems either assume strong problem regularity criteria or are computationally intractable. In this paper we address power system problems of bilevel structure,…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Domagoj Vlah , Karlo Šepetanc , Hrvoje Pandžić

A wide range of applications arising in machine learning and signal processing can be cast as convex optimization problems. These problems are often ill-posed, i.e., the optimal solution lacks a desired property such as uniqueness or…

Optimization and Control · Mathematics 2019-07-18 Mostafa Amini , Farzad Yousefian

While machine learning approaches to image restoration offer great promise, current methods risk training models fixated on performing well only for image corruption of a particular level of difficulty---such as a certain level of noise or…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Ruohan Gao , Kristen Grauman

A large number of application problems involve two levels of optimization, where one optimization task is nested inside the other. These problems are known as bilevel optimization problems and have been studied by both classical…

Optimization and Control · Mathematics 2017-05-09 Ankur Sinha , Zhichao Lu , Kalyanmoy Deb , Pekka Malo

Deep Learning (DL) methods can reconstruct highly accelerated magnetic resonance imaging (MRI) scans, but they rely on application-specific large training datasets and often generalize poorly to out-of-distribution data. Self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2026-04-24 Hongze Yu , Jeffrey A. Fessler , Yun Jiang

Deep learning methods have been successfully applied to various computer vision tasks. However, existing neural network architectures do not per se incorporate domain knowledge about the addressed problem, thus, understanding what the model…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

Restoring severely blurred images remains a significant challenge in computer vision, impacting applications in autonomous driving, medical imaging, and photography. This paper introduces a novel training strategy based on curriculum…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Sushant Gautam , Jingdao Chen

Bilevel programming has recently received attention in the literature due to its wide range of applications, including reinforcement learning and hyper-parameter optimization. However, it is widely assumed that the underlying bilevel…

Machine Learning · Computer Science 2024-10-11 Parvin Nazari , Ahmad Mousavi , Davoud Ataee Tarzanagh , George Michailidis

We propose a very fast and effective one-step restoring method for blurry face images. In the last decades, many blind deblurring algorithms have been proposed to restore latent sharp images. However, these algorithms run slowly because of…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Lingxiao Wang , Yali Li , Shengjin Wang

Low-light image enhancement aims to improve the visibility of degraded images to better align with human visual perception. While diffusion-based methods have shown promising performance due to their strong generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jinhong He , Minglong Xue , Zhipu Liu , Mingliang Zhou , Aoxiang Ning , Palaiahnakote Shivakumara

Image optimization problems encompass many applications such as spectral fusion, deblurring, deconvolution, dehazing, matting, reflection removal and image interpolation, among others. With current image sizes in the order of megabytes, it…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Majed El Helou , Frederike Dümbgen , Radhakrishna Achanta , Sabine Süsstrunk

We propose techniques for approximating bilevel optimization problems with non-smooth lower level problems that can have a non-unique solution. To this end, we substitute the expression of a minimizer of the lower level minimization problem…

Optimization and Control · Mathematics 2016-04-27 Peter Ochs , René Ranftl , Thomas Brox , Thomas Pock

Bilevel optimization is a powerful tool for many machine learning problems, such as hyperparameter optimization and meta-learning. Estimating hypergradients (also known as implicit gradients) is crucial for developing gradient-based methods…

Optimization and Control · Mathematics 2025-05-06 Youran Dong , Junfeng Yang , Wei Yao , Jin Zhang

This paper proposes a novel method for segmentation of images by hierarchical multilevel thresholding. The method is global, agglomerative in nature and disregards pixel locations. It involves the optimization of the ratio of the unbiased…

Computer Vision and Pattern Recognition · Computer Science 2007-12-27 Sreechakra Goparaju , Jayadev Acharya , Ajoy K. Ray , Jaideva C. Goswami