English
Related papers

Related papers: Enhancing Sharpness-Aware Minimization by Learning…

200 papers

Images acquired in low-light environments present significant obstacles for computer vision systems and human perception, especially for applications requiring accurate object recognition and scene analysis. Such images typically manifest…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Bibhabasu Debnath , Sahana Ray , Sanjay Ghosh

When adapting Simultaneous Mapping and Localization (SLAM) to real-world applications, such as autonomous vehicles, drones, and augmented reality devices, its memory footprint and computing cost are the two main factors limiting the…

Robotics · Computer Science 2022-11-04 Yeonsoo Park , Soohyun Bae

In this paper, we present a novel low-light image enhancement method called dark region-aware low-light image enhancement (DALE), where dark regions are accurately recognized by the proposed visual attention module and their brightness are…

Image and Video Processing · Electrical Eng. & Systems 2020-08-31 Dokyeong Kwon , Guisik Kim , Junseok Kwon

We propose a novel Learned Alternating Minimization Algorithm (LAMA) for dual-domain sparse-view CT image reconstruction. LAMA is naturally induced by a variational model for CT reconstruction with learnable nonsmooth nonconvex…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Chi Ding , Qingchao Zhang , Ge Wang , Xiaojing Ye , Yunmei Chen

We present SAM, a biologically-plausible selective attention-driven modulation approach to enhance classification models in a continual learning setting. Inspired by neurophysiological evidence that the primary visual cortex does not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Giovanni Bellitto , Federica Proietto Salanitri , Matteo Pennisi , Matteo Boschini , Angelo Porrello , Simone Calderara , Simone Palazzo , Concetto Spampinato

Improving the generalization ability of modern deep neural networks (DNNs) is a fundamental challenge in machine learning. Two branches of methods have been proposed to seek flat minima and improve generalization: one led by sharpness-aware…

Machine Learning · Computer Science 2024-04-02 Tao Li , Qinghua Tao , Weihao Yan , Zehao Lei , Yingwen Wu , Kun Fang , Mingzhen He , Xiaolin Huang

As the context window expands, self-attention increasingly dominates the transformer's inference time. Therefore, accelerating attention computation while minimizing performance degradation is essential for the efficient deployment of Large…

Computation and Language · Computer Science 2025-03-14 Eli Sason , Darya Frolova , Boris Nazarov , Felix Goldberd

Recent advances in vision foundation models, such as the Segment Anything Model (SAM) and its successor SAM2, have achieved state-of-the-art performance on general image segmentation benchmarks. However, these models struggle in adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Dharsan Ravindran , Kevin Wang , Zhuoyuan Cao , Saleh Abdelrahman , Jeffery Wu

Understanding the implicit bias of optimization algorithms is key to explaining and improving the generalization of deep models. The hyperbolic implicit bias induced by pointwise overparameterization promotes sparsity, but also yields a…

Machine Learning · Computer Science 2026-03-03 Tom Jacobs , Advait Gadhikar , Celia Rubio-Madrigal , Rebekka Burkholz

Low-light images suffer from severe noise and low illumination. Current deep learning models that are trained with real-world images have excellent noise reduction, but a ratio parameter must be chosen manually to complete the enhancement…

Image and Video Processing · Electrical Eng. & Systems 2020-04-23 Qingxu Fu , Xiaoguang Di , Yu Zhang

Decentralized training enables learning with distributed datasets generated at different locations without relying on a central server. In realistic scenarios, the data distribution across these sparsely connected learning agents can be…

Machine Learning · Computer Science 2025-02-27 Sakshi Choudhary , Sai Aparna Aketi , Kaushik Roy

Low-light image enhancement (LLIE) aims to improve the illuminance of images due to insufficient light exposure. Recently, various lightweight learning-based LLIE methods have been proposed to handle the challenges of unfavorable prevailing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yuantong Zhang , Baoxin Teng , Daiqin Yang , Zhenzhong Chen , Haichuan Ma , Gang Li , Wenpeng Ding

Learned Optimizers (LOs), a type of Meta-learning, have gained traction due to their ability to be parameterized and trained for efficient optimization. Traditional gradient-based methods incorporate explicit regularization techniques such…

Machine Learning · Computer Science 2025-10-13 Suraj Kumar Sahoo , Narayanan C Krishnan

Energy-efficient deep neural network (DNN) accelerators are prone to non-idealities that degrade DNN performance at inference time. To mitigate such degradation, existing methods typically add perturbations to the DNN weights during…

Machine Learning · Computer Science 2023-03-22 Gonçalo Mordido , Sébastien Henwood , Sarath Chandar , François Leduc-Primeau

Neural networks produced by standard training are known to suffer from poor accuracy on rare subgroups despite achieving high accuracy on average, due to the correlations between certain spurious features and labels. Previous approaches…

Machine Learning · Computer Science 2024-04-10 Gaotang Li , Jiarui Liu , Wei Hu

Perturbation with diverse unlabeled data has proven beneficial for semi-supervised medical image segmentation (SSMIS). While many works have successfully used various perturbation techniques, a deeper understanding of learning perturbations…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Zhenyan Yao , Miao Zhang , Lanhu Wu , Yongri Piao , Feng Tian , Weibing Sun , Huchuan Lu

A wide range of NLP tasks benefit from the fine-tuning of pretrained language models (PLMs). However, a number of redundant parameters which contribute less to the downstream task are observed in a directly fine-tuned model. We consider the…

Computation and Language · Computer Science 2022-10-26 Yupeng Zhang , Hongzhi Zhang , Sirui Wang , Wei Wu , Zhoujun Li

Autonomous robotic systems applied to new domains require an abundance of expensive, pixel-level dense labels to train robust semantic segmentation models under full supervision. This study proposes a model-agnostic Depth Edge Alignment…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Patrick Schmidt , Vasileios Belagiannis , Lazaros Nalpantidis

We study the SAM (Sharpness-Aware Minimization) optimizer which has recently attracted a lot of interest due to its increased performance over more classical variants of stochastic gradient descent. Our main contribution is the derivation…

Machine Learning · Computer Science 2023-06-06 Enea Monzio Compagnoni , Luca Biggio , Antonio Orvieto , Frank Norbert Proske , Hans Kersting , Aurelien Lucchi

Current feature matching methods focus on point-level matching, pursuing better representation learning of individual features, but lacking further understanding of the scene. This results in significant performance degradation when…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xiaoyong Lu , Yaping Yan , Tong Wei , Songlin Du