English
Related papers

Related papers: MIAFEx: An Attention-based Feature Extraction Meth…

200 papers

As an effective data preprocessing step, feature selection has shown its effectiveness to prepare high-dimensional data for many machine learning tasks. The proliferation of high di-mension and huge volume big data, however, has brought…

Machine Learning · Computer Science 2019-03-01 Ning Gui , Danni Ge , Ziyin Hu

High-dimensional data in many areas such as computer vision and machine learning tasks brings in computational and analytical difficulty. Feature selection which selects a subset from observed features is a widely used approach for…

Machine Learning · Computer Science 2018-04-10 Kai Han , Yunhe Wang , Chao Zhang , Chao Li , Chao Xu

In this paper, we propose the FedFeat+ framework, which distinctively separates feature extraction from classification. We develop a two-tiered model training process: following local training, clients transmit their weights and some…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Mrityunjoy Gain , Kitae Kim , Avi Deb Raha , Apurba Adhikary , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Deep learning methods have been widely used for Human Activity Recognition (HAR) using recorded signals from Iner-tial Measurement Units (IMUs) sensors that are installed on various parts of the human body. For this type of HAR, sev-eral…

Machine Learning · Computer Science 2025-02-10 Saeed Arabzadeh , Farshad Almasganj , Mohammad Mahdi Ahmadi

Although transformers have become the neural architectures of choice for natural language processing, they require orders of magnitude more training data, GPU memory, and computations in order to compete with convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Pranav Jeevan , Amit Sethi

Vision Transformer (ViT) self-attention mechanism is characterized by feature collapse in deeper layers, resulting in the vanishing of low-level visual features. However, such features can be helpful to accurately represent and identify…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Anxhelo Diko , Danilo Avola , Marco Cascio , Luigi Cinque

The medical image is characterized by the inter-class indistinction, high variability, and noise, where the recognition of pixels is challenging. Unlike previous self-attention based methods that capture context information from one level,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Fei Ding , Gang Yang , Jinlu Liu , Jun Wu , Dayong Ding , Jie Xv , Gangwei Cheng , Xirong Li

Convolutional Neural Networks (CNNs) specialize in feature extraction rather than function mapping. In doing so they form complex internal hierarchical feature representations, the complexity of which gradually increases with a…

Neural and Evolutionary Computing · Computer Science 2021-05-11 Nidhi Gowdra , Roopak Sinha , Stephen MacDonell

In this paper we propose a novel deep learning-based algorithm for biomedical image segmentation which uses a sequential attention mechanism able to shift the focus of attention across the image in a selective way, allowing subareas which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Shohei Hayashi , Bisser Raytchev , Toru Tamaki , Kazufumi Kaneda

Semantic segmentation of remote sensing images plays an important role in a wide range of applications including land resource management, biosphere monitoring and urban planning. Although the accuracy of semantic segmentation in remote…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Rui Li , Shunyi Zheng , Chenxi Duan , Ce Zhang , Jianlin Su , P. M. Atkinson

The increase of available large clinical and experimental datasets has contributed to a substantial amount of important contributions in the area of biomedical image analysis. Image segmentation, which is crucial for any quantitative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Nikhil Kumar Tomar , Debesh Jha , Michael A. Riegler , Håvard D. Johansen , Dag Johansen , Jens Rittscher , Pål Halvorsen , Sharib Ali

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Masanari Kimura , Masayuki Tanaka

Extracting robust feature representation is critical for object re-identification to accurately identify objects across non-overlapping cameras. Although having a strong representation ability, the Vision Transformer (ViT) tends to overfit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Lei Tan , Pingyang Dai , Jie Chen , Liujuan Cao , Yongjian Wu , Rongrong Ji

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

The computational demands of computer vision tasks based on state-of-the-art Convolutional Neural Network (CNN) image classification far exceed the energy budgets of mobile devices. This paper proposes FixyNN, which consists of a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Paul N. Whatmough , Chuteng Zhou , Patrick Hansen , Shreyas Kolala Venkataramanaiah , Jae-sun Seo , Matthew Mattina

Deep learning has become a powerful tool for medical image analysis; however, conventional Convolutional Neural Networks (CNNs) often fail to capture the fine-grained and complex features critical for accurate diagnosis. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zahid Ullah , Minki Hong , Tahir Mahmood , Jihie Kim

We address the problem of referring image segmentation that aims to generate a mask for the object specified by a natural language expression. Many recent works utilize Transformer to extract features for the target object by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Chang Liu , Henghui Ding , Yulun Zhang , Xudong Jiang

Convolution Neural Networks (CNNs) are widely used in medical image analysis, but their performance degrade when the magnification of testing images differ from the training images. The inability of CNNs to generalize across magnification…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Pranav Jeevan , Nikhil Cherian Kurian , Amit Sethi

Vision Transformers (ViTs) have shown competitive accuracy in image classification tasks compared with CNNs. Yet, they generally require much more data for model pre-training. Most of recent works thus are dedicated to designing more…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Daquan Zhou , Yujun Shi , Bingyi Kang , Weihao Yu , Zihang Jiang , Yuan Li , Xiaojie Jin , Qibin Hou , Jiashi Feng