English
Related papers

Related papers: Convolutional Quantum-Like Language Model with Mut…

200 papers

Recent trends of incorporating attention mechanisms in vision have led researchers to reconsider the supremacy of convolutional layers as a primary building block. Beyond helping CNNs to handle long-range dependencies, Ramachandran et al.…

Machine Learning · Computer Science 2020-01-13 Jean-Baptiste Cordonnier , Andreas Loukas , Martin Jaggi

Convolutional neural networks (CNNs) based approaches for semantic alignment and object landmark detection have improved their performance significantly. Current efforts for the two tasks focus on addressing the lack of massive training…

Computer Vision and Pattern Recognition · Computer Science 2019-10-03 Sangryul Jeon , Dongbo Min , Seungryong Kim , Kwanghoon Sohn

The success of the self-attention mechanism in classical machine learning models has inspired the development of quantum analogs aimed at reducing computational overhead. Self-attention integrates learnable query and key matrices to…

Perceptual video quality assessment (VQA) is an integral component of many streaming and video sharing platforms. Here we consider the problem of learning perceptually relevant video quality representations in a self-supervised manner.…

Image and Video Processing · Electrical Eng. & Systems 2022-06-30 Pavan C. Madhusudana , Neil Birkbeck , Yilin Wang , Balu Adsumilli , Alan C. Bovik

Recently, the generality of natural language text has been leveraged to develop transferable recommender systems. The basic idea is to employ pre-trained language models~(PLM) to encode item text into item representations. Despite the…

Information Retrieval · Computer Science 2023-02-14 Yupeng Hou , Zhankui He , Julian McAuley , Wayne Xin Zhao

Engaging in smooth conversations with others is a crucial social skill. However, differences in knowledge between conversation participants can sometimes hinder effective communication. To tackle this issue, this study proposes a real-time…

Human-Computer Interaction · Computer Science 2025-06-23 Yuichiro Fujimoto

How to better utilize sequential information has been extensively studied in the setting of recommender systems. To this end, architectural inductive biases such as Markov-Chains, Recurrent models, Convolutional networks and many others…

Information Retrieval · Computer Science 2019-02-27 Chaoyue He , Yong Liu , Qingyu Guo , Chunyan Miao

We introduce a deep convolutional neural networks (CNN) architecture to classify facial attributes and recognize face images simultaneously via a shared learning paradigm to improve the accuracy for facial attribute prediction and face…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Mohammad Rasool Izadi

Attention mechanism has played critical roles in various state-of-the-art NLP models such as Transformer and BERT. It can be formulated as a ternary function that maps the input queries, keys and values into an output by using a summation…

Computation and Language · Computer Science 2020-10-09 Chuhan Wu , Fangzhao Wu , Tao Qi , Yongfeng Huang

Automatic prediction of age and gender from face images has drawn a lot of attention recently, due it is wide applications in various facial analysis problems. However, due to the large intra-class variation of face images (such as…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Amirali Abdolrashidi , Mehdi Minaei , Elham Azimi , Shervin Minaee

In recent years, great success has been achieved in many tasks of natural language processing (NLP), e.g., named entity recognition (NER), especially in the high-resource language, i.e., English, thanks in part to the considerable amount of…

Computation and Language · Computer Science 2023-01-10 Shengfei Lyu , Linghao Sun , Huixiong Yi , Yong Liu , Huanhuan Chen , Chunyan Miao

In NLP, convolutional neural networks (CNNs) have benefited less than recurrent neural networks (RNNs) from attention mechanisms. We hypothesize that this is because the attention in CNNs has been mainly implemented as attentive pooling…

Computation and Language · Computer Science 2018-11-14 Wenpeng Yin , Hinrich Schütze

Convolutional Neural Networks (CNN) are used mainly to treat problems with many images characteristic of Deep Learning. In this work, we propose a hybrid image classification model to take advantage of quantum and classical computing. The…

Quantum Physics · Physics 2021-04-10 Parfait Atchade-Adelomou , Guillermo Alonso-Linaje

A substantial body of research has focused on developing systems that assist medical professionals during labor-intensive early screening processes, many based on convolutional deep-learning architectures. Recently, multiple studies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Tristan Piater , Niklas Penzel , Gideon Stein , Joachim Denzler

Discriminating between closely-related language varieties is considered a challenging and important task. This paper describes our submission to the DSL 2016 shared-task, which included two sub-tasks: one on discriminating similar languages…

Computation and Language · Computer Science 2016-09-27 Yonatan Belinkov , James Glass

Recent research demonstrates the effectiveness of using fine-tuned language models~(LM) for dense retrieval. However, dense retrievers are hard to train, typically requiring heavily engineered fine-tuning pipelines to realize their full…

Information Retrieval · Computer Science 2021-08-13 Luyu Gao , Jamie Callan

In this paper, we propose a novel Question-Guided Hybrid Convolution (QGHC) network for Visual Question Answering (VQA). Most state-of-the-art VQA methods fuse the high-level textual and visual features from the neural network and abandon…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Peng Gao , Pan Lu , Hongsheng Li , Shuang Li , Yikang Li , Steven Hoi , Xiaogang Wang

In this paper, we introduce a Deep Convolutional Analysis Dictionary Model (DeepCAM) by learning convolutional dictionaries instead of unstructured dictionaries as in the case of deep analysis dictionary model introduced in the companion…

Machine Learning · Statistics 2020-02-04 Jun-Jie Huang , Pier Luigi Dragotti

Recently the crowd counting has received more and more attention. Especially the technology of high-density environment has become an important research content, and the relevant methods for the existence of extremely dense crowd are not…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Mengxiao Tian , Hao Guo , Chengjiang Long

Deep learning techniques have revolutionized the fields of image restoration and image quality assessment in recent years. While image restoration methods typically utilize synthetically distorted training data for training, deep quality…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Hakan Emre Gedik , Abhinau K. Venkataramanan , Alan C. Bovik