English
Related papers

Related papers: Learning From Brains How to Regularize Machines

200 papers

Neural networks have attracted a lot of attention due to its success in applications such as natural language processing and computer vision. For large scale data, due to the tremendous number of parameters in neural networks, overfitting…

Machine Learning · Statistics 2022-07-05 Xiaoxi Shen , Jinghang Lin

This paper presents a predictive model for estimating regularization parameters of diffeomorphic image registration. We introduce a novel framework that automatically determines the parameters controlling the smoothness of diffeomorphic…

Image and Video Processing · Electrical Eng. & Systems 2022-02-08 Jian Wang , Miaomiao Zhang

Deep convolutional neural networks (DCNNs) have revolutionized computer vision and are often advocated as good models of the human visual system. However, there are currently many shortcomings of DCNNs, which preclude them as a model of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Harshitha Machiraju , Oh-Hyeon Choung , Pascal Frossard , Michael. H Herzog

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

This paper focuses on regularizing the training of the convolutional neural network (CNN). We propose a new regularization approach named ``PatchShuffle`` that can be adopted in any classification-oriented CNN models. It is easy to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Guoliang Kang , Xuanyi Dong , Liang Zheng , Yi Yang

Spatial and intensity normalization are nowadays a prerequisite for neuroimaging analysis. Influenced by voxel-wise and other univariate comparisons, where these corrections are key, they are commonly applied to any type of analysis and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Francisco J. Martinez-Murcia , Juan M. Górriz , Javier Ramírez , Andrés Ortiz

While convolutional neural networks (CNNs) have come to match and exceed human performance in many settings, the tasks these models optimize for are largely constrained to the level of individual objects, such as classification and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Max Gupta , Sunayana Rane , R. Thomas McCoy , Thomas L. Griffiths

The rapid evolution of digital image manipulation techniques poses significant challenges for content verification, with models such as stable diffusion and mid-journey producing highly realistic, yet synthetic, images that can deceive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Alejandro Marco Montejano , Angela Sanchez Perez , Javier Barrachina , David Ortiz-Perez , Manuel Benavent-Lledo , Jose Garcia-Rodriguez

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right…

Computer Vision and Pattern Recognition · Computer Science 2014-11-19 Xiaolong Wang , David F. Fouhey , Abhinav Gupta

What makes an image appear realistic? In this work, we are answering this question from a data-driven perspective by learning the perception of visual realism directly from large amounts of data. In particular, we train a Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2015-10-05 Jun-Yan Zhu , Philipp Krähenbühl , Eli Shechtman , Alexei A. Efros

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Quantization of Convolutional Neural Networks (CNNs) is a common approach to ease the computational burden involved in the deployment of CNNs, especially on low-resource edge devices. However, fixed-point arithmetic is not natural to the…

Machine Learning · Computer Science 2024-06-14 Ido Ben-Yair , Gil Ben Shalom , Moshe Eliasof , Eran Treister

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Convolutional neural networks (CNNs) often perform well, but their stability is poorly understood. To address this problem, we consider the simple prototypical problem of signal denoising, where classical approaches such as nonlinear…

Machine Learning · Computer Science 2020-06-09 Tobias Alt , Joachim Weickert , Pascal Peter

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Humans represent scenes and objects in rich feature spaces, carrying information that allows us to generalise about category memberships and abstract functions with few examples. What determines whether a neural network model generalises…

Regularization can mitigate the generalization gap between training and inference by introducing inductive bias. Existing works have already proposed various inductive biases from diverse perspectives. However, none of them explores…

Machine Learning · Computer Science 2022-11-02 Qiang Fu , Lun Du , Haitao Mao , Xu Chen , Wei Fang , Shi Han , Dongmei Zhang

Modern machine learning models for computer vision exceed humans in accuracy on specific visual recognition tasks, notably on datasets like ImageNet. However, high accuracy can be achieved in many ways. The particular decision function…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Shikhar Tuli , Ishita Dasgupta , Erin Grant , Thomas L. Griffiths

Convolutional Neural Networks (CNNs) are build specifically for computer vision tasks for which it is known that the input data is a hierarchical structure based on locally correlated elements. The question that naturally arises is what…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Cristian Ivan

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu