English
Related papers

Related papers: Informative Dropout for Robust Representation Lear…

200 papers

Vision transformers have demonstrated the potential to outperform CNNs in a variety of vision tasks. But the computational and memory requirements of these models prohibit their use in many applications, especially those that depend on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yue Liu , Christos Matsoukas , Fredrik Strand , Hossein Azizpour , Kevin Smith

Incorporating stochasticity into the training process of deep convolutional networks is a widely used technique to reduce overfitting and improve regularization. Existing techniques often require modifying the architecture of the network by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Evgeny Hershkovitch Neiterman , Gil Ben-Artzi

In the contemporary of deep learning, where models often grapple with the challenge of simultaneously achieving robustness against adversarial attacks and strong generalization capabilities, this study introduces an innovative Local Feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yunpeng Gong , Chuangliang Zhang , Yongjie Hou , Lifei Chen , Min Jiang

Dropout is used as a practical tool to obtain uncertainty estimates in large vision models and reinforcement learning (RL) tasks. But to obtain well-calibrated uncertainty estimates, a grid-search over the dropout probabilities is necessary…

Machine Learning · Statistics 2017-05-23 Yarin Gal , Jiri Hron , Alex Kendall

Recurrent recommender systems have been successful in capturing the temporal dynamics in users' activity trajectories. However, recurrent neural networks (RNNs) are known to have difficulty learning long-term dependencies. As a consequence,…

Information Retrieval · Computer Science 2022-01-27 Bo Chang , Can Xu , Matthieu Lê , Jingchen Feng , Ya Le , Sriraj Badam , Ed Chi , Minmin Chen

Shallow Convolution Neural Network (CNN) is a time-tested tool for the information extraction from cancer pathology reports. Shallow CNN performs competitively on this task to other deep learning models including BERT, which holds the…

Computation and Language · Computer Science 2020-08-05 Abhishek K Dubey , Alina Peluso , Jacob Hinkle , Devanshu Agarawal , Zilong Tan

A key challenge in robot teaching is grasp-type recognition with a single RGB image and a target object name. Here, we propose a simple yet effective pipeline to enhance learning-based recognition by leveraging a prior distribution of grasp…

Robotics · Computer Science 2020-09-22 Naoki Wake , Kazuhiro Sasabuchi , Katsushi Ikeuchi

Feature extraction with convolutional neural networks (CNNs) is a popular method to represent images for machine learning tasks. These representations seek to capture global image content, and ideally should be independent of geometric…

Machine Learning · Computer Science 2022-03-03 Jake Lee , Junfeng Yang , Zhangyang Wang

In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xuan Cheng , Tianshu Xie , Xiaomin Wang , Qifeng Weng , Minghui Liu , Jiali Deng , Ming Liu

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke

Recent work suggests that representations learned by adversarially robust networks are more human perceptually-aligned than non-robust networks via image manipulations. Despite appearing closer to human visual perception, it is unclear if…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Anne Harrington , Arturo Deza

Marginalising out uncertain quantities within the internal representations or parameters of neural networks is of central importance for a wide range of learning techniques, such as empirical, variational or full Bayesian methods. We set…

Machine Learning · Statistics 2015-07-21 Justin Bayer , Maximilian Karl , Daniela Korhammer , Patrick van der Smagt

Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Amr Farahat , Felix Effenberger , Martin Vinck

The accuracy of deep convolutional neural networks (CNNs) generally improves when fueled with high resolution images. However, this often comes at a high computational cost and high memory footprint. Inspired by the fact that not all…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Yulin Wang , Kangchen Lv , Rui Huang , Shiji Song , Le Yang , Gao Huang

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Boyao Wang , Volodymyr Kindratenko

Deep convolutional neural networks (DCNNs) have revolutionized computer vision and are often advocated as good models of the human visual system. However, there are currently many shortcomings of DCNNs, which preclude them as a model of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Harshitha Machiraju , Oh-Hyeon Choung , Michael H. Herzog , Pascal Frossard

Though having achieved some progresses, the hand-crafted texture features, e.g., LBP [23], LBP-TOP [11] are still unable to capture the most discriminative cues between genuine and fake faces. In this paper, instead of designing feature by…

Computer Vision and Pattern Recognition · Computer Science 2014-08-27 Jianwei Yang , Zhen Lei , Stan Z. Li

Image ordinal classification refers to predicting a discrete target value which carries ordering correlation among image categories. The limited size of labeled ordinal data renders modern deep learning approaches easy to overfit. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Chao Zhang , Ce Zhu , Jimin Xiao , Xun Xu , Yipeng Liu

Current research in Computer Vision has shown that Convolutional Neural Networks (CNN) give state-of-the-art performance in many classification tasks and Computer Vision problems. The embedding of CNN, which is the internal representation…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Axel Angel

Graph neural networks(GNNs) have been demonstrated to depend on whether the node effective information is sufficiently passing. Discrete curvature (Ricci curvature) is used to study graph connectivity and information propagation efficiency…

Machine Learning · Computer Science 2024-12-31 Xingcheng Fu , Jian Wang , Yisen Gao , Qingyun Sun , Haonan Yuan , Jianxin Li , Xianxian Li