English
Related papers

Related papers: AttnGen: Attention-Guided Saliency Learning for In…

200 papers

Single-cell RNA sequencing (scRNAseq) is rapidly advancing our understanding of cellular composition within complex tissues and organisms. A major limitation in most scRNAseq analysis pipelines is the reliance on manual annotations to…

Genomics · Quantitative Biology 2022-06-10 A. Ali Heydari , Oscar A. Davalos , Katrina K. Hoyer , Suzanne S. Sindi

Given a sequence of tokens generated by a language model, we may want to identify the preceding tokens that influence the model to generate this sequence. Performing such token attribution is expensive; a common approach is to ablate…

Machine Learning · Computer Science 2025-04-21 Benjamin Cohen-Wang , Yung-Sung Chuang , Aleksander Madry

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Deep neural networks have achieved remarkable performance in various text-based tasks but often lack interpretability, making them less suitable for applications where transparency is critical. To address this, we propose ProtoLens, a novel…

Computation and Language · Computer Science 2024-10-25 Bowen Wei , Ziwei Zhu

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

Although substantial efforts have been made using graph neural networks (GNNs) for AI-driven drug discovery (AIDD), effective molecular representation learning remains an open challenge, especially in the case of insufficient labeled…

Machine Learning · Computer Science 2023-11-07 Zhen Wang , Zheng Feng , Yanjun Li , Bowen Li , Yongrui Wang , Chulin Sha , Min He , Xiaolin Li

Gene expression profiles have been widely used to characterize patterns of cellular responses to diseases. As data becomes available, scalable learning toolkits become essential to processing large datasets using deep learning models to…

Machine Learning · Computer Science 2019-02-01 Ya Ju Fan , Jonathan E. Allen , Sam Ade Jacobs , Brian C. Van Essen

Attention mechanism in sequence-to-sequence models is designed to model the alignments between acoustic features and output tokens in speech recognition. However, attention weights produced by models trained end to end do not always…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Gene-Ping Yang , Hao Tang

Unlike images or videos data which can be easily labeled by human being, sensor data annotation is a time-consuming process. However, traditional methods of human activity recognition require a large amount of such strictly labeled data for…

Machine Learning · Computer Science 2019-07-02 Kun Wang , Jun He , Lei Zhang

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Current models on Explainable Artificial Intelligence (XAI) have shown an evident and quantified lack of reliability for measuring feature-relevance when statistically entangled features are proposed for training deep classifiers. There has…

Signal Processing · Electrical Eng. & Systems 2023-02-27 Juan Manuel Mayor-Torres , Sara Medina-DeVilliers , Tessa Clarkson , Matthew D. Lerner , Giuseppe Riccardi

Developments in machine learning interpretability techniques over the past decade have provided new tools to observe the image regions that are most informative for classification and localization in artificial neural networks (ANNs). Are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Thomas A. Langlois , H. Charles Zhao , Erin Grant , Ishita Dasgupta , Thomas L. Griffiths , Nori Jacoby

Classification using supervised learning requires annotating a large amount of classes-balanced data for model training and testing. This has practically limited the scope of applications with supervised learning, in particular deep…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Hao Zhen , Yucheng Shi , Jidong J. Yang , Javad Mohammadpour Vehni

Supervised deep learning requires a large amount of training samples with annotations (e.g. label class for classification task, pixel- or voxel-wised label map for segmentation tasks), which are expensive and time-consuming to obtain.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yuanhan Mo , Shuo Wang , Chengliang Dai , Rui Zhou , Zhongzhao Teng , Wenjia Bai , Yike Guo

Sequence classification is the task of predicting a class label given a sequence of observations. In many applications such as healthcare monitoring or intrusion detection, early classification is crucial to prompt intervention. In this…

Machine Learning · Computer Science 2020-10-07 Maayan Shvo , Andrew C. Li , Rodrigo Toro Icarte , Sheila A. McIlraith

While pre-trained Transformer models achieve high accuracy on in-domain sentiment classification, they frequently experience severe performance degradation when transferring to out-of-domain data. We hypothesize that this generalization gap…

Machine Learning · Computer Science 2026-05-06 Shubham Harkare , Arvind Yogesh Suresh Babu , Yash Kulkarni

Weakly supervised semantic segmentation is receiving great attention due to its low human annotation cost. In this paper, we aim to tackle bounding box supervised semantic segmentation, i.e., training accurate semantic segmentation models…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Bingfeng Zhang , Jimin Xiao , Jianbo Jiao , Yunchao Wei , Yao Zhao

This paper is a contribution towards interpretability of the deep learning models in different applications of time-series. We propose a temporal attention layer that is capable of selecting the relevant information to perform various…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Phongtharin Vinayavekhin , Subhajit Chaudhury , Asim Munawar , Don Joven Agravante , Giovanni De Magistris , Daiki Kimura , Ryuki Tachibana

Recurrent neural networks with differentiable attention mechanisms have had success in generative and classification tasks. We show that the classification performance of such models can be enhanced by guiding a randomly initialized model…

Machine Learning · Computer Science 2017-12-18 Jack Lindsey

While significant advances in deep learning has resulted in state-of-the-art performance across a large number of complex visual perception tasks, the widespread deployment of deep neural networks for TinyML applications involving…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Alexander Wong , Mahmoud Famouri , Mohammad Javad Shafiee