English
Related papers

Related papers: A Lightweight Transformer for Pain Recognition fro…

200 papers

Recent advances in acquisition equipment is providing experiments with growing amounts of precise yet affordable sensors. At the same time an improved computational power, coming from new hardware resources (GPU, FPGA, ACAP), has been made…

Computational Physics · Physics 2021-09-01 A. Rigoni Garola , R. Cavazzana , M. Gobbin , R. S. Delogu , G. Manduchi , C. Taliercio , A. Luchetta

Lightweight inference is critical for biomolecular structure prediction and downstream tasks, enabling efficient real-world deployment and inference-time scaling for large-scale applications. While AF3 and its variants (e.g., Protenix,…

Quantitative Methods · Quantitative Biology 2025-10-17 Bo Qiang , Chengyue Gong , Xinshi Chen , Yuxuan Zhang , Wenzhi Xiao

This article presents design techniques proposed for efficient hardware implementation of feedforward artificial neural networks (ANNs) under parallel and time-multiplexed architectures. To reduce their design complexity, after the weights…

Hardware Architecture · Computer Science 2021-08-05 Mohammadreza Esmali Nojehdeh , Sajjad Parvin , Mustafa Altun

Objective skill assessment in high-stakes procedural environments requires models that not only decode underlying cognitive and motor processes but also generalize across tasks, individuals, and experimental contexts. While prior work has…

Signal Processing · Electrical Eng. & Systems 2025-07-01 A. Subedi , S. De , L. Cavuoto , S. Schwaitzberg , M. Hackett , J. Norfleet

Detecting emotions directly from a speech signal plays an important role in effective human-computer interactions. Existing speech emotion recognition models require massive computational and storage resources, making them hard to implement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Arya Aftab , Alireza Morsali , Shahrokh Ghaemmaghami , Benoit Champagne

With the rapid development of deep learning and computer vision technologies, medical image segmentation plays a crucial role in the early diagnosis of breast cancer. However, due to the characteristics of breast ultrasound images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jiajun Ding , Beiyao Zhu , Wenjie Wang , Shurong Zhang , Dian Zhua , Zhao Liua

The Transformer architecture aggregates input information through the self-attention mechanism, but there is no clear understanding of how this information is mixed across the entire model. Additionally, recent works have demonstrated that…

Computation and Language · Computer Science 2022-10-25 Javier Ferrando , Gerard I. Gállego , Marta R. Costa-jussà

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

Fusion is a technique for merging multiple independently-trained neural networks in order to combine their capabilities. Past attempts have been restricted to the case of fully-connected, convolutional, and residual networks. This paper…

Machine Learning · Computer Science 2024-04-23 Moritz Imfeld , Jacopo Graldi , Marco Giordano , Thomas Hofmann , Sotiris Anagnostidis , Sidak Pal Singh

Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the…

Machine Learning · Computer Science 2018-02-21 Zhanli Chen , Rashid Ansari , Diana J. Wilkie

Neuroimaging data allows researchers to model the relationship between multivariate patterns of brain activity and outcomes related to mental states and behaviors. However, the existence of outlying participants can potentially undermine…

Methodology · Statistics 2026-03-17 Dongliang Zhang , Masoud Asgharian , Martin A. Lindquist

Pain is a complex phenomenon which is manifested and expressed by patients in various forms. The immediate and objective recognition of it is a great of importance in order to attain a reliable and unbiased healthcare system. In this work,…

Artificial Intelligence · Computer Science 2024-07-30 Stefanos Gkikas , Chariklia Chatzaki , Manolis Tsiknakis

Despite the popularity of transformers in practice, their architectures are empirically designed and neither mathematically justified nor interpretable. Moreover, as indicated by many empirical studies, some components of transformer…

Machine Learning · Computer Science 2025-06-05 Peng Wang , Yifu Lu , Yaodong Yu , Druv Pai , Qing Qu , Yi Ma

Vision Transformers (ViTs) have emerged as powerful backbones in computer vision, outperforming many traditional CNNs. However, their computational overhead, largely attributed to the self-attention mechanism, makes deployment on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Minchul Kim , Shangqian Gao , Yen-Chang Hsu , Yilin Shen , Hongxia Jin

This work introduces a novel approach to fMRI-based visual image reconstruction using a subject-agnostic common representation space. We show that the brain signals of the subjects can be aligned in this common space during training to form…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Christos Zangos , Danish Ebadulla , Thomas Christopher Sprague , Ambuj Singh

Latent spaces offer an efficient and effective means of summarizing data while implicitly preserving meta-information through relational encoding. We leverage these meta-embeddings to develop a modality-agnostic, unified encoder. Our method…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Abdullah Ahmed , Jeremy Gummeson

Mixup is a commonly adopted data augmentation technique for image classification. Recent advances in mixup methods primarily focus on mixing based on saliency. However, many saliency detectors require intense computation and are especially…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Hyeong Kyu Choi , Joonmyung Choi , Hyunwoo J. Kim

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Recent advances in automated skin cancer diagnosis have yielded performance on par with board-certified dermatologists. However, these approaches formulated skin cancer diagnosis as a simple classification task, dismissing the potential…

Image and Video Processing · Electrical Eng. & Systems 2021-12-06 Jingye Chen , Jieneng Chen , Zongwei Zhou , Bin Li , Alan Yuille , Yongyi Lu

Magnetic Resonance Imaging (MRI) is one of the most flexible and powerful medical imaging modalities. This flexibility does however come at a cost; MRI images acquired at different sites and with different parameters exhibit significant…