English
Related papers

Related papers: An Attention Ensemble Approach for Efficient Text …

200 papers

Understanding linguistics and morphology of resource-scarce code-mixed texts remains a key challenge in text processing. Although word embedding comes in handy to support downstream tasks for low-resource languages, there are plenty of…

Computation and Language · Computer Science 2021-06-01 Ayan Sengupta , Sourabh Kumar Bhattacharjee , Tanmoy Chakraborty , Md Shad Akhtar

Racism is an alarming phenomenon in our country as well as all over the world. Every day we have come across some racist comments in our daily life and virtual life. Though we can eradicate this racism from virtual life (such as Social…

Computation and Language · Computer Science 2024-01-31 S. S. Saruar , Nusrat , Sadia

Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure that uses the…

In this work we propose a novel attention-based neural network model for the task of fine-grained entity type classification that unlike previously proposed models recursively composes representations of entity mention contexts. Our model…

Computation and Language · Computer Science 2016-04-20 Sonse Shimaoka , Pontus Stenetorp , Kentaro Inui , Sebastian Riedel

In the recent past, complex deep neural networks have received huge interest in various document understanding tasks such as document image classification and document retrieval. As many document types have a distinct visual style, learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Ziheng Ming , Mickael Coustaty , Marçal Rusiñol

Graph Convolutional Networks (GCN) have achieved state-of-art results on single text classification tasks like sentiment analysis, emotion detection, etc. However, the performance is achieved by testing and reporting on resource-rich…

Computation and Language · Computer Science 2022-05-04 Mounika Marreddy , Subba Reddy Oota , Lakshmi Sireesha Vakada , Venkata Charan Chinni , Radhika Mamidi

Attention-based models have recently shown great performance on a range of tasks, such as speech recognition, machine translation, and image captioning due to their ability to summarize relevant information that expands through the entire…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-02 F A Rezaur Rahman Chowdhury , Quan Wang , Ignacio Lopez Moreno , Li Wan

How do you build a sign language recognizer that works on a phone? That question drove this work. We built EfficientSign, a lightweight model which takes EfficientNet-B0 and focuses on two attention modules (Squeeze-and-Excitation for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Rishabh Gupta , Shravya R. Nalla

Modeling long sequences is crucial for various large-scale models; however, extending existing architectures to handle longer sequences presents significant technical and resource challenges. In this paper, we propose an efficient and…

Computation and Language · Computer Science 2024-10-08 Ning Wang , Zekun Li , Tongxin Bai , Guoqi Li

Since Bahdanau et al. [1] first introduced attention for neural machine translation, most sequence-to-sequence models made use of attention mechanisms [2, 3, 4]. While they produce soft-alignment matrices that could be interpreted as…

Computation and Language · Computer Science 2019-09-12 Marcely Zanon Boito , Aline Villavicencio , Laurent Besacier

Large Vision-Language Models (VLMs) have achieved remarkable success in multi-modal reasoning, but their inference time efficiency remains a significant challenge due to the memory overhead during decoding, especially when the query and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Fatih Ilhan , Gaowen Liu , Ramana Rao Kompella , Selim Furkan Tekin , Tiansheng Huang , Zachary Yahn , Yichang Xu , Ling Liu

With the rapid development of Natural Language Processing (NLP) technologies, text steganography methods have been significantly innovated recently, which poses a great threat to cybersecurity. In this paper, we propose a novel attentional…

Multimedia · Computer Science 2022-02-21 YongJian Bao , Hao Yang , Zhongliang Yang , Sheng Liu , Yongfeng Huang

State-of-the-art methods for text classification include several distinct steps of pre-processing, feature extraction and post-processing. In this work, we focus on end-to-end neural architectures and show that the best performance in text…

Computation and Language · Computer Science 2019-03-29 Athanasios Giannakopoulos , Maxime Coriou , Andreea Hossmann , Michael Baeriswyl , Claudiu Musat

This paper describes our system used in the BLP-2025 Task 1: Hate Speech Detection. We participated in Subtask 1A and Subtask 1B, addressing hate speech classification in Bangla text. Our approach employs a unified architecture that…

Computation and Language · Computer Science 2026-01-13 Md. Shihab Uddin Riad

Evaluating LLMs and text-to-image models is a computationally intensive task often overlooked. Efficient evaluation is crucial for understanding the diverse capabilities of these models and enabling comparisons across a growing number of…

In this work, we propose a new approach for language identification using multi-head self-attention combined with raw waveform based 1D convolutional neural networks for Indian languages. Our approach uses an encoder, multi-head…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Krishna D N , Ankita Patil

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

This work proposes an LSTM-based sentiment classification model with multi-head attention mechanism and TF-IDF optimization. Through the integration of TF-IDF feature extraction and multi-head attention, the model significantly improves…

Computation and Language · Computer Science 2025-03-12 Jingyuan Yi , Peiyang Yu , Tianyi Huang , Xiaochuan Xu

Despite the progress made in sentence-level NMT, current systems still fall short at achieving fluent, good quality translation for a full document. Recent works in context-aware NMT consider only a few previous sentences as context and may…

Computation and Language · Computer Science 2019-05-27 Sameen Maruf , André F. T. Martins , Gholamreza Haffari

Hateful content on social media increasingly appears as multimodal memes that combine images and text to convey harmful narratives. In low-resource languages such as Bengali, automated detection remains challenging due to limited annotated…

Computation and Language · Computer Science 2026-02-24 Raihan Tanvir , Md. Golam Rabiul Alam