English
Related papers

Related papers: Neural Loss Function Evolution for Large-Scale Ima…

200 papers

Image classification is a fundamental task in computer vision with diverse applications, ranging from autonomous systems to medical imaging. The CIFAR-10 dataset is a widely used benchmark to evaluate the performance of classification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Graph neural networks (GNNs) have become increasingly popular for classification tasks on graph-structured data. Yet, the interplay between graph topology and feature evolution in GNNs is not well understood. In this paper, we focus on…

Machine Learning · Computer Science 2023-10-27 Vignesh Kothapalli , Tom Tirer , Joan Bruna

In recent years, with the rapid development of computer information technology, the development of artificial intelligence has been accelerating. The traditional geometry recognition technology is relatively backward and the recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ruiyang Wang , Haonan Wang , Junfeng Sun , Mingjia Zhao , Meng Liu

It has been demonstrated that deep neural networks outperform traditional machine learning. However, deep networks lack generalisability, that is, they will not perform as good as in a new (testing) set drawn from a different distribution…

Machine Learning · Computer Science 2022-06-28 Bruno Casella , Alessio Barbaro Chisari , Sebastiano Battiato , Mario Valerio Giuffrida

Neural architecture search has attracted wide attentions in both academia and industry. To accelerate it, researchers proposed weight-sharing methods which first train a super-network to reuse computation among different operators, from…

Machine Learning · Computer Science 2020-12-16 Xin Chen , Lingxi Xie , Jun Wu , Longhui Wei , Yuhui Xu , Qi Tian

Multi-view learning accomplishes the task objectives of classification by leverag-ing the relationships between different views of the same object. Most existing methods usually focus on consistency and complementarity between multiple…

Machine Learning · Computer Science 2022-01-14 Jian-wei Liu , Yuan-fang Wang , Run-kun Lu , Xionglin Luo

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Motoshi Abe , Junichi Miyao , Takio Kurita

Conventionally, image denoising and high-level vision tasks are handled separately in computer vision. In this paper, we cope with the two jointly and explore the mutual influence between them. First we propose a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Ding Liu , Bihan Wen , Xianming Liu , Zhangyang Wang , Thomas S. Huang

There is no such thing as a perfect dataset. In some datasets, deep neural networks discover underlying heuristics that allow them to take shortcuts in the learning process, resulting in poor generalization capability. Instead of using…

Computation and Language · Computer Science 2022-11-28 Frano Rajič , Ivan Stresec , Axel Marmet , Tim Poštuvan

Discriminative features are critical for machine learning applications. Most existing deep learning approaches, however, rely on convolutional neural networks (CNNs) for learning features, whose discriminant power is not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Fusheng Hao , Jun Cheng , Lei Wang , Xinchao Wang , Jianzhong Cao , Xiping Hu , Dapeng Tao

Existing graph convolutional networks focus on the neighborhood aggregation scheme. When applied to semi-supervised learning, they often suffer from the overfitting problem as the networks are trained with the cross-entropy loss on a small…

Machine Learning · Computer Science 2020-02-18 Qilin Li , Wanquan Liu , Ling Li

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

Neural Networks are function approximators that have achieved state-of-the-art accuracy in numerous machine learning tasks. In spite of their great success in terms of accuracy, their large training time makes it difficult to use them for…

Machine Learning · Computer Science 2017-04-18 Abhishek Sinha , Mausoom Sarkar , Aahitagni Mukherjee , Balaji Krishnamurthy

Evolutionary computation can be used to optimize several different aspects of neural network architectures. For instance, the TaylorGLO method discovers novel, customized loss functions, resulting in improved performance, faster training,…

Machine Learning · Computer Science 2025-06-12 Santiago Gonzalez , Xin Qiu , Risto Miikkulainen

Over the past decade deep learning has revolutionized the field of computer vision, with convolutional neural network models proving to be very effective for image classification benchmarks. However, a fundamental theoretical questions…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Vinoth Nandakumar , Arush Tagade , Tongliang Liu

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

Neural field methods have seen great progress in various long-standing tasks in computer vision and computer graphics, including novel view synthesis and geometry reconstruction. As existing neural field methods try to predict some…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xindi Yang , Zeke Xie , Xiong Zhou , Boyu Liu , Buhua Liu , Yi Liu , Haoran Wang , Yunfeng Cai , Mingming Sun

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

Activation functions (AFs) play a pivotal role in the performance of neural networks. The Rectified Linear Unit (ReLU) is currently the most commonly used AF. Several replacements to ReLU have been suggested but improvements have proven…

Neural and Evolutionary Computing · Computer Science 2022-06-27 Raz Lapid , Moshe Sipper