English
Related papers

Related papers: Improving Shift Invariance in Convolutional Neural…

200 papers

Adapting pre-trained models with broad capabilities has become standard practice for learning a wide range of downstream tasks. The typical approach of fine-tuning different models for each task is performant, but incurs a substantial…

In this work, we address the problem of improvement of robustness of feature representations learned using convolutional neural networks (CNNs) to image deformation. We argue that higher moment statistics of feature distributions could be…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Zhun Sun , Mete Ozay , Takayuki Okatani

Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

We introduce the novel concept of anti-transfer learning for speech processing with convolutional neural networks. While transfer learning assumes that the learning process for a target task will benefit from re-using representations…

Machine Learning · Computer Science 2021-01-14 Eric Guizzo , Tillman Weyde , Giacomo Tarroni

The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby,…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Andreas Kofler , Christian Wald , Tobias Schaeffter , Markus Haltmeier , Christoph Kolbitsch

Deep neural networks have been widely used in text classification. However, it is hard to interpret the neural models due to the complicate mechanisms. In this work, we study the interpretability of a variant of the typical text…

Computation and Language · Computer Science 2019-10-25 Hao Cheng , Xiaoqing Yang , Zang Li , Yanghua Xiao , Yucheng Lin

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

The reasonable definition of semantic interpretability presents the core challenge in explainable AI. This paper proposes a method to modify a traditional convolutional neural network (CNN) into an interpretable compositional CNN, in order…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Wen Shen , Zhihua Wei , Shikun Huang , Binbin Zhang , Jiaqi Fan , Ping Zhao , Quanshi Zhang

Invariance to spatial transformations such as translations and rotations is a desirable property and a basic design principle for classification neural networks. However, the commonly used convolutional neural networks (CNNs) are actually…

Machine Learning · Computer Science 2023-06-30 Yihan Wang , Lijia Yu , Xiao-Shan Gao

Convolutional neural networks (CNNs) excel in computer vision but are susceptible to adversarial attacks, crafted perturbations designed to mislead predictions. Despite advances in adversarial training, a gap persists between model accuracy…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hayat Ullah , Syed Muhammad Talha Zaidi , Arslan Munir

Achieving rotation invariance in deep neural networks without relying on data has always been a hot research topic. Intrinsic rotation invariance can enhance the model's feature representation capability, enabling better performance in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Hanlin Mo , Guoying Zhao

Convolutional neural networks (CNNs) have demonstrated remarkable success in vision-related tasks. However, their susceptibility to failing when inputs deviate from the training distribution is well-documented. Recent studies suggest that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Pradyumna Elavarthi , James Lee , Anca Ralescu

Downsampling-based methods for time series forecasting have attracted increasing attention due to their superiority in capturing sequence trends. However, this approaches mainly capture dependencies within subsequences but neglect…

Computational Engineering, Finance, and Science · Computer Science 2026-01-21 Zhangyao Song , Nanqing Jiang , Miaohong He , Xiaoyu Zhao , Tao Guo

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Deep neural networks that achieve remarkable performance in image classification have previously been shown to be easily fooled by tiny transformations such as a one pixel translation of the input image. In order to address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Ofir Shifman , Yair Weiss

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Incremental semantic segmentation(ISS) is an emerging task where old model is updated by incrementally adding new classes. At present, methods based on convolutional neural networks are dominant in ISS. However, studies have shown that such…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Zekai Xu , Mingyi Zhang , Jiayue Hou , Xing Gong , Chuan Wen , Chengjie Wang , Junge Zhang

In recent years, representation learning approaches have disrupted many multimedia computing tasks. Among those approaches, deep convolutional neural networks (CNNs) have notably reached human level expertise on some constrained image…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Lucas Pascal , Xavier Bost , Benoît Huet

Deep neural networks are applied in more and more areas of everyday life. However, they still lack essential abilities, such as robustly dealing with spatially transformed input signals. Approaches to mitigate this severe robustness issue…

Machine Learning · Computer Science 2024-05-28 Johann Schmidt , Sebastian Stober

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learned is limited. In a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Charlotte Bunne , Lukas Rahmann , Thomas Wolf