English
Related papers

Related papers: Deep Saliency Models : The Quest For The Loss Func…

200 papers

Gradient-based saliency methods are widely used to interpret deep neural networks, yet they often produce noisy and unstable explanations that poorly align with semantically meaningful input features. We argue that a fundamental cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Ali Karkehabadi , Jamshid Hassanpour , Houman Homayoun , Avesta Sasan

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muhammad Adeel Hafeez , Michael G. Madden , Ganesh Sistu , Ihsan Ullah

Recent works have studied implicit biases in deep learning, especially the behavior of last-layer features and classifier weights. However, they usually need to simplify the intermediate dynamics under gradient flow or gradient descent due…

Machine Learning · Computer Science 2023-12-14 Xiong Zhou , Xianming Liu , Hanzhang Wang , Deming Zhai , Junjun Jiang , Xiangyang Ji

The last decades have seen great progress in saliency prediction, with the success of deep neural networks that are able to encode high-level semantics. Yet, while humans have the innate capability in leveraging their knowledge to decide…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yifeng Zhang , Ming Jiang , Qi Zhao

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

Data-driven saliency detection has attracted strong interest as a result of applying convolutional neural networks to the detection of eye fixations. Although a number of imagebased salient object and fixation detection models have been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Meijun Sun , Ziqi Zhou , QinGhua Hu , Zheng Wang , Jianmin Jiang

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

Neural networks appear to have mysterious generalization properties when using parameter counting as a proxy for complexity. Indeed, neural networks often have many more parameters than there are data points, yet still provide good…

Machine Learning · Computer Science 2020-05-26 Wesley J. Maddox , Gregory Benton , Andrew Gordon Wilson

Making consistently profitable financial decisions in a continuously evolving and volatile stock market has always been a difficult task. Professionals from different disciplines have developed foundational theories to anticipate price…

Machine Learning · Computer Science 2025-11-11 Ruoyu Guo , Haochen Qiu , Xuelun Hou

This work explores how human judgement about salient regions of an image can be introduced into deep convolutional neural network (DCNN) training. Traditionally, training of DCNNs is purely data-driven. This often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aidan Boyd , Patrick Tinsley , Kevin W. Bowyer , Adam Czajka

Change detection, i.e. identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Foivos I. Diakogiannis , François Waldner , Peter Caccetta

Loss functions drive the optimization of machine learning algorithms. The choice of a loss function can have a significant impact on the training of a model, and how the model learns the data. Binary classification is one of the major…

Machine Learning · Computer Science 2022-11-02 Rayan Wali

The question of how and why the phenomenon of mode connectivity occurs in training deep neural networks has gained remarkable attention in the research community. From a theoretical perspective, two possible explanations have been proposed:…

Machine Learning · Computer Science 2021-10-22 Quynh Nguyen , Pierre Brechet , Marco Mondelli

Medical images commonly exhibit multiple abnormalities. Predicting them requires multi-class classifiers whose training and desired reliable performance can be affected by a combination of factors, such as, dataset size, data source,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-16 Sivaramakrishnan Rajaraman , Ghada Zamzmi , Sameer Antani

While cross entropy (CE) is the most commonly used loss to train deep neural networks for classification tasks, many alternative losses have been developed to obtain better empirical performance. Among them, which one is the best to use is…

Machine Learning · Computer Science 2022-10-11 Jinxin Zhou , Chong You , Xiao Li , Kangning Liu , Sheng Liu , Qing Qu , Zhihui Zhu

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Saliency detection has drawn a lot of attention of researchers in various fields over the past several years. Saliency is the perceptual quality that makes an object, person to draw the attention of humans at the very sight. Salient object…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Shubham Pachori

Over the past decade, deep learning models have exhibited considerable advancements, reaching or even exceeding human-level performance in a range of visual perception tasks. This remarkable progress has sparked interest in applying deep…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yulin Wang , Yizeng Han , Chaofei Wang , Shiji Song , Qi Tian , Gao Huang

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen