English
Related papers

Related papers: Central Dogma Transformer: Towards Mechanism-Orien…

200 papers

With the proliferation of social media platforms and e-commerce sites, several cross-domain collaborative filtering strategies have been recently introduced to transfer the knowledge of user preferences across domains. The main challenge of…

Information Retrieval · Computer Science 2019-08-20 Dimitrios Rafailidis

Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace the self-attention mechanism in vision transformers with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zimian Wei , Hengyue Pan , Lujun Li , Menglong Lu , Xin Niu , Peijie Dong , Dongsheng Li

This work proposes an extensive analysis of the Transformer architecture in the Neural Machine Translation (NMT) setting. Focusing on the encoder-decoder attention mechanism, we prove that attention weights systematically make alignment…

Computation and Language · Computer Science 2021-09-14 Javier Ferrando , Marta R. Costa-jussà

Attention module does not always help deep models learn causal features that are robust in any confounding context, e.g., a foreground object feature is invariant to different backgrounds. This is because the confounders trick the attention…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Tan Wang , Chang Zhou , Qianru Sun , Hanwang Zhang

Recent extensions of Cellular Automata (CA) have incorporated key ideas from modern deep learning, dramatically extending their capabilities and catalyzing a new family of Neural Cellular Automata (NCA) techniques. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Mattie Tesfaldet , Derek Nowrouzezahrai , Christopher Pal

Recent advances in applying deep learning in genomics include DNA-language and single-cell foundation models. However, these models take only one data type as input. We introduce dynamic token adaptation and demonstrate how it combines…

Understanding non-genetic determinants of cell fate is critical for developing and improving cancer therapies, as genetically identical cells can exhibit divergent outcomes under the same treatment conditions. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Florian Bürger , Martim Dias Gomes , Adrián E. Granada , Noémie Moreau , Katarzyna Bozek

Unsupervised domain adaptation (UDA) aims to learn transferable knowledge from a labeled source domain and adapts a trained model to an unlabeled target domain. To bridge the gap between source and target domains, one prevailing strategy is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Xu Ma , Junkun Yuan , Yen-wei Chen , Ruofeng Tong , Lanfen Lin

Convolutional neural networks (CNNs) evaluate short-range correlations in input images which progress along the layers, whereas vision transformer (ViT) architectures evaluate long-range correlations, using repeated transformer encoders…

Machine Learning · Computer Science 2025-04-10 Ella Koresh , Ronit D. Gross , Yuval Meir , Yarden Tzach , Tal Halevi , Ido Kanter

Transformers are powerful neural architectures that allow integrating different modalities using attention mechanisms. In this paper, we leverage the neural transformer architectures for multi-channel speech recognition systems, where the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Feng-Ju Chang , Martin Radfar , Athanasios Mouchtaris , Brian King , Siegfried Kunzmann

Recent studies have applied deep learning methods such as convolutional recurrent neural networks (CRNs) and Transformers to brain disease classification based on dynamic functional connectivity networks (dFCNs), such as Alzheimer's disease…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Zhixiang Zhang , Biao Jie , Zhengdong Wang , Jie Zhou , Yang Yang

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Channel coding for 6G networks is expected to support a wide range of requirements arising from heterogeneous communication scenarios. These demands challenge traditional code-specific decoders, which lack the flexibility and scalability…

Information Theory · Computer Science 2025-07-03 Seong-Joon Park , Hee-Youl Kwak , Sang-Hyo Kim , Yongjune Kim , Jong-Seon No

Most models of visual attention aim at predicting either top-down or bottom-up control, as studied using different visual search and free-viewing tasks. In this paper we propose the Human Attention Transformer (HAT), a single model that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhibo Yang , Sounak Mondal , Seoyoung Ahn , Ruoyu Xue , Gregory Zelinsky , Minh Hoai , Dimitris Samaras

Human language is often multimodal, which comprehends a mixture of natural language, facial gestures, and acoustic behaviors. However, two major challenges in modeling such multimodal human language time-series data exist: 1) inherent data…

Computation and Language · Computer Science 2019-06-04 Yao-Hung Hubert Tsai , Shaojie Bai , Paul Pu Liang , J. Zico Kolter , Louis-Philippe Morency , Ruslan Salakhutdinov

Deep learning is changing many areas in molecular physics, and it has shown great potential to deliver new solutions to challenging molecular modeling problems. Along with this trend arises the increasing demand of expressive and versatile…

Machine Learning · Computer Science 2023-12-27 Jun Zhang , Yao-Kun Lei , Yaqiang Zhou , Yi Isaac Yang , Yi Qin Gao

Most existing multivariate time series forecasting methods adopt an all-to-all paradigm that feeds all variable histories into a unified model to predict their future values without distinguishing their individual roles. However, this…

Machine Learning · Computer Science 2026-02-16 Xingyu Zhang , Hanyun Du , Zeen Song , Siyu Zhao , Changwen Zheng , Wenwen Qiang

Various deep learning models have been developed to segment anatomical structures from medical images, but they typically have poor performance when tested on another target domain with different data distribution. Recently, unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2022-01-21 Linkai Peng , Li Lin , Pujin Cheng , Ziqi Huang , Xiaoying Tang

Relational reasoning is a central component of generally intelligent systems, enabling robust and data-efficient inductive generalization. Recent empirical evidence shows that many existing neural architectures, including Transformers,…

Machine Learning · Computer Science 2025-06-23 Awni Altabaa , John Lafferty

Attention Deficit Hyperactivity Disorder (ADHD) is a prevalent neurodevelopmental disorder with limited objective diagnostic tools, highlighting the urgent need for objective, biology-based diagnostic frameworks in precision psychiatry. We…

Machine Learning · Computer Science 2026-02-25 Nabil Belacel , Mohamed Rachid Boulassel