English
Related papers

Related papers: TabAttention: Learning Attention Conditionally on …

200 papers

Attention mechanisms are widely used to dramatically improve deep learning model performance in various fields. However, their general ability to improve the performance of physiological signal deep learning model is immature. In this…

Signal Processing · Electrical Eng. & Systems 2022-07-15 Seong-A Park , Hyung-Chul Lee , Chul-Woo Jung , Hyun-Lim Yang

Prostate cancer biopsy benefits from accurate fusion of transrectal ultrasound (TRUS) and magnetic resonance (MR) images. In the past few years, convolutional neural networks (CNNs) have been proved powerful in extracting image features…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Xinrui Song , Hengtao Guo , Xuanang Xu , Hanqing Chao , Sheng Xu , Baris Turkbey , Bradford J. Wood , Ge Wang , Pingkun Yan

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Unlike images or videos data which can be easily labeled by human being, sensor data annotation is a time-consuming process. However, traditional methods of human activity recognition require a large amount of such strictly labeled data for…

Machine Learning · Computer Science 2019-07-02 Kun Wang , Jun He , Lei Zhang

Attention mechanism has been regarded as an advanced technique to capture long-range feature interactions and to boost the representation capability for convolutional neural networks. However, we found two ignored problems in current…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhu Baozhou , Peter Hofstee , Jinho Lee , Zaid Al-Ars

The paper addresses the problem of recognition of actions in video with low inter-class variability such as Table Tennis strokes. Two stream, "twin" convolutional neural networks are used with 3D convolutions both on RGB data and optical…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Pierre-Etienne Martin , Jenny Benois-Pineau , Renaud Péteri , Julien Morlier

In recent years, significant progress has been made in the medical image analysis domain using convolutional neural networks (CNNs). In particular, deep neural networks based on a U-shaped architecture (UNet) with skip connections have been…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Vamsi Krishna Vasa , Wenhui Zhu , Xiwen Chen , Peijie Qiu , Xuanzhao Dong , Yalin Wang

In the task of emotion recognition from videos, a key improvement has been to focus on emotions over time rather than a single frame. There are many architectures to address this task such as GRUs, LSTMs, Self-Attention, Transformers, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Alexander Mehta , William Yang

In recent years, convolutional neural networks (CNNs) have been successfully implemented to various image recognition applications, such as medical image analysis, object detection, and image segmentation. Many studies and applications have…

Image and Video Processing · Electrical Eng. & Systems 2021-05-06 Chi-Shiang Wang , Fang-Yi Su , Tsung-Lu Michael Lee , Yi-Shan Tsai , Jung-Hsien Chiang

Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Rakshith Sathish , Swanand Khare , Debdoot Sheet

In this work, we propose "Residual Attention Network", a convolutional neural network using attention mechanism which can incorporate with state-of-art feed forward network architecture in an end-to-end training fashion. Our Residual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fei Wang , Mengqing Jiang , Chen Qian , Shuo Yang , Cheng Li , Honggang Zhang , Xiaogang Wang , Xiaoou Tang

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Accurately credit default prediction faces challenges due to imbalanced data and low correlation between features and labels. Existing default prediction studies on the basis of gradient boosting decision trees (GBDT), deep learning…

Computational Engineering, Finance, and Science · Computer Science 2023-12-06 Yandan Tan , Hongbin Zhu , JieWu , Hongfeng Chai

Convolution is the main building block of convolutional neural networks (CNN). We observe that an optimized CNN often has highly correlated filters as the number of channels increases with depth, reducing the expressive power of feature…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Xudong Wang , Stella X. Yu

The research explores the utilization of a deep learning model employing an attention mechanism in medical text mining. It targets the challenge of analyzing unstructured text information within medical data. This research seeks to enhance…

Computation and Language · Computer Science 2024-06-04 Lingxi Xiao , Muqing Li , Yinqiu Feng , Meiqi Wang , Ziyi Zhu , Zexi Chen

Leveraging the in-context learning (ICL) capability of Large Language Models (LLMs) for tabular classification has gained significant attention for its training-free adaptability across diverse datasets. Recent advancements, like TabPFN,…

Machine Learning · Computer Science 2025-06-09 Yuchen Zeng , Tuan Dinh , Wonjun Kang , Andreas C Mueller

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

Tabular data is a common format for storing information in rows and columns to represent data entries and their features. Although deep neural networks have become the main approach for modeling a wide range of domains including computer…

Machine Learning · Computer Science 2025-12-19 Fathi Said Emhemed Shaninah , AbdulRahman M. A. Baraka , Mohd Halim Mohd Noor

Alongside neuroimaging such as MRI scans and PET, Alzheimer's disease (AD) datasets contain valuable tabular data including AD biomarkers and clinical assessments. Existing computer vision approaches struggle to utilize this additional…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Weichen Huang