English
Related papers

Related papers: Multi-Frame Cross-Entropy Training for Convolution…

200 papers

Recent advances in machine learning have become increasingly popular in the applications of phase transitions and critical phenomena. By machine learning approaches, we try to identify the physical characteristics in the two-dimensional…

Disordered Systems and Neural Networks · Physics 2021-01-25 Shu Cheng , Fei He , Huai Zhang , Ka-Di Zhu , Yaolin Shi

Deep structured output learning shows great promise in tasks like semantic image segmentation. We proffer a new, efficient deep structured model learning scheme, in which we show how deep Convolutional Neural Networks (CNNs) can be used to…

Computer Vision and Pattern Recognition · Computer Science 2015-09-09 Guosheng Lin , Chunhua Shen , Ian Reid , Anton van den Hengel

Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking because they require very long training time and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanxi Li , Yi Li , Fatih Porikli

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

Non-autoregressive machine translation models significantly speed up decoding by allowing for parallel prediction of the entire target sequence. However, modeling word order is more challenging due to the lack of autoregressive factors in…

Computation and Language · Computer Science 2020-04-06 Marjan Ghazvininejad , Vladimir Karpukhin , Luke Zettlemoyer , Omer Levy

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

Since the BOSS competition, in 2010, most steganalysis approaches use a learning methodology involving two steps: feature extraction, such as the Rich Models (RM), for the image representation, and use of the Ensemble Classifier (EC) for…

Multimedia · Computer Science 2018-01-15 Lionel Pibre , Pasquet Jérôme , Dino Ienco , Marc Chaumont

The "CNN-RNN" design pattern is increasingly widely applied in a variety of image annotation tasks including multi-label classification and captioning. Existing models use the weakly semantic CNN hidden layer or its transform as the image…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Images or videos always contain multiple objects or actions. Multi-label recognition has been witnessed to achieve pretty performance attribute to the rapid development of deep learning technologies. Recently, graph convolution network…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Ya Wang , Dongliang He , Fu Li , Xiang Long , Zhichao Zhou , Jinwen Ma , Shilei Wen

We propose "collision cross-entropy" as a robust alternative to Shannon's cross-entropy (CE) loss when class labels are represented by soft categorical distributions y. In general, soft labels can naturally represent ambiguous targets in…

Machine Learning · Computer Science 2023-11-30 Zhongwen Zhang , Yuri Boykov

In recent decade, many state-of-the-art algorithms on image classification as well as audio classification have achieved noticeable successes with the development of deep convolutional neural network (CNN). However, most of the works only…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bold Naranchimeg , Chao Zhang , Takuya Akashi

The task of multi-label image classification is to recognize all the object labels presented in an image. Though advancing for years, small objects, similar objects and objects with high conditional probability are still the main…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Xing Cheng , Hezheng Lin , Xiangyu Wu , Fan Yang , Dong Shen , Zhongyuan Wang , Nian Shi , Honglin Liu

Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks. Most Graph Convolutional Networks are designed with the…

Computation and Language · Computer Science 2022-04-12 Kunze Wang , Soyeon Caren Han , Siqu Long , Josiah Poon

Cross-lingual named entity recognition (CrossNER) faces challenges stemming from uneven performance due to the scarcity of multilingual corpora, especially for non-English data. While prior efforts mainly focus on data-driven transfer…

Computation and Language · Computer Science 2024-02-22 Ying Mo , Jian Yang , Jiahao Liu , Qifan Wang , Ruoyu Chen , Jingang Wang , Zhoujun Li

Even though machine learning (ML) techniques are being widely used in communications, the question of how to train communication systems has received surprisingly little attention. In this paper, we show that the commonly used binary…

Information Theory · Computer Science 2023-03-08 Reinhard Wiesmayr , Gian Marti , Chris Dick , Haochuan Song , Christoph Studer

In the context of adversarial robustness, a single model does not usually have enough power to defend against all possible adversarial attacks, and as a result, has sub-optimal robustness. Consequently, an emerging line of work has focused…

Machine Learning · Computer Science 2022-06-08 Dinghuai Zhang , Hongyang Zhang , Aaron Courville , Yoshua Bengio , Pradeep Ravikumar , Arun Sai Suggala

In practical applications of regression analysis, it is not uncommon to encounter a multitude of values for each attribute. In such a situation, the univariate distribution, which is typically Gaussian, is suboptimal because the mean may be…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Krzysztof Byrski , Jacek Tabor , Przemysław Spurek , Marcin Mazur

Convolutional neural networks (CNNs) have demonstrated strong performance in visual recognition tasks, but their inherent reliance on regular grid structures limits their capacity to model complex topological relationships and non-local…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Feiyue Zhao , Zhichao Zhang

Convolutional neural networks (CNN) are one of the best-performing neural network architectures for environmental sound classification (ESC). Recently, temporal attention mechanisms have been used in CNN to capture the useful information…

Sound · Computer Science 2020-05-22 Helin Wang , Yuexian Zou , Dading Chong , Wenwu Wang

Low-cost cross-modal representation learning is crucial for deriving semantic representations across diverse modalities such as text, audio, images, and video. Traditional approaches typically depend on large specialized models trained from…

Machine Learning · Computer Science 2024-09-10 Bilal Faye , Hanane Azzag , Mustapha Lebbah , Djamel Bouchaffra