中文
相关论文

相关论文: Position, Padding and Predictions: A Deeper Look a…

200 篇论文

Word order, an essential property of natural languages, is injected in Transformer-based neural language models using position encoding. However, recent experiments have shown that explicit position encoding is not always useful, since some…

计算与语言 · 计算机科学 2022-11-09 Karim Lasri , Alessandro Lenci , Thierry Poibeau

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

Recent development in deep learning techniques has attracted attention in decoding and classification in EEG signals. Despite several efforts utilizing different features of EEG signals, a significant research challenge is to use…

机器学习 · 计算机科学 2020-06-09 Avinash Kumar Singh , Chin-Teng Lin

CNNs have excelled at performing place recognition over time, particularly when the neural network is optimized for localization in the current environmental conditions. In this paper we investigate the concept of feature map filtering,…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Stephen Hausler , Adam Jacobson , Michael Milford

The anatomical location of imaging features is of crucial importance for accurate diagnosis in many medical tasks. Convolutional neural networks (CNN) have had huge successes in computer vision, but they lack the natural ability to…

Sequential word order is important when processing text. Currently, neural networks (NNs) address this by modeling word position using position embeddings. The problem is that position embeddings capture the position of individual words,…

计算与语言 · 计算机科学 2020-06-30 Benyou Wang , Donghao Zhao , Christina Lioma , Qiuchi Li , Peng Zhang , Jakob Grue Simonsen

Image representations, from SIFT and Bag of Visual Words to Convolutional Neural Networks (CNNs), are a crucial component of almost any image understanding system. Nevertheless, our understanding of them remains limited. In this paper we…

计算机视觉与模式识别 · 计算机科学 2014-12-02 Aravindh Mahendran , Andrea Vedaldi

Convolutional neural networks (CNNs) are one of the most widely used neural network architectures, showcasing state-of-the-art performance in computer vision tasks. Although larger CNNs generally exhibit higher accuracy, their size can be…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Sukhbinder Singh , Saeed S. Jahromi , Roman Orus

Advanced video classification systems decode video frames to derive the necessary texture and motion representations for ingestion and analysis by spatio-temporal deep convolutional neural networks (CNNs). However, when considering visual…

计算机视觉与模式识别 · 计算机科学 2019-01-03 Mohammad Jubran , Alhabib Abbas , Aaron Chadha , Yiannis Andreopoulos

It is common practice to apply padding prior to convolution operations to preserve the resolution of feature-maps in Convolutional Neural Networks (CNN). While many alternatives exist, this is often achieved by adding a border of zeros…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Paul Gavrikov , Janis Keuper

SinGAN shows impressive capability in learning internal patch distribution despite its limited effective receptive field. We are interested in knowing how such a translation-invariant convolutional generator could capture the global…

计算机视觉与模式识别 · 计算机科学 2020-12-10 Rui Xu , Xintao Wang , Kai Chen , Bolei Zhou , Chen Change Loy

Deep convolutional neural networks (CNN) have revolutionized various fields of vision research and have seen unprecedented adoption for multiple tasks such as classification, detection, captioning, etc. However, they offer little…

计算机视觉与模式识别 · 计算机科学 2018-12-13 Konda Reddy Mopuri , Utsav Garg , R. Venkatesh Babu

The convolutional neural network (CNN) is one of the most commonly used architectures for computer vision tasks. The key building block of a CNN is the convolutional kernel that aggregates information from the pixel neighborhood and shares…

图像与视频处理 · 电气工程与系统科学 2022-02-08 Tianyu Ma , Alan Q. Wang , Adrian V. Dalca , Mert R. Sabuncu

Computer vision tasks often have side information available that is helpful to solve the task. For example, for crowd counting, the camera perspective (e.g., camera angle and height) gives a clue about the appearance and scale of people in…

计算机视觉与模式识别 · 计算机科学 2016-11-22 Di Kang , Debarun Dhar , Antoni B. Chan

The state-of-the-art performance for several real-world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing,…

机器学习 · 计算机科学 2021-08-31 Giosuè Cataldo Marinò , Alessandro Petrini , Dario Malchiodi , Marco Frasca

Recently, self-attention (SA) structures became popular in computer vision fields. They have locally independent filters and can use large kernels, which contradicts the previously popular convolutional neural networks (CNNs). CNNs success…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Nana Arizumi

Transformers have gained increasing popularity in a wide range of applications, including Natural Language Processing (NLP), Computer Vision and Speech Recognition, because of their powerful representational capacity. However, harnessing…

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

计算机视觉与模式识别 · 计算机科学 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Convolutional Neural Networks (CNNs) have proven to be highly effective in solving a broad spectrum of computer vision tasks, such as classification, identification, and segmentation. These methods can be deployed in both centralized and…

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

机器学习 · 计算机科学 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis