中文
相关论文

相关论文: Sequence-to-Sequence Contrastive Learning for Text…

200 篇论文

Texts from scene images typically consist of several characters and exhibit a characteristic sequence structure. Existing methods capture the structure with the sequence-to-sequence models by an encoder to have the visual representations…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Xiangcheng Du , Tianlong Ma , Yingbin Zheng , Hao Ye , Xingjiao Wu , Liang He

The advent of recurrent neural networks for handwriting recognition marked an important milestone reaching impressive recognition accuracies despite the great variability that we observe across different writing styles. Sequential…

计算机视觉与模式识别 · 计算机科学 2020-05-28 Lei Kang , Pau Riba , Marçal Rusiñol , Alicia Fornés , Mauricio Villegas

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Capturing emotions within a conversation plays an essential role in modern dialogue systems. However, the weak correlation between emotions and semantics brings many challenges to emotion recognition in conversation (ERC). Even semantically…

人工智能 · 计算机科学 2022-10-20 Xiaohui Song , Longtao Huang , Hui Xue , Songlin Hu

Sequential Recommendation (SR) has received increasing attention due to its ability to capture user dynamic preferences. Recently, Contrastive Learning (CL) provides an effective approach for sequential recommendation by learning invariance…

Recently, neural networks have shown impressive progress across diverse fields, with speech processing being no exception. However, recent breakthroughs in this area require extensive offline training using large datasets and tremendous…

音频与语音处理 · 电气工程与系统科学 2024-06-05 Umberto Cappellazzo , Enrico Fini , Muqiao Yang , Daniele Falavigna , Alessio Brutti , Bhiksha Raj

Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. However, when…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Gaoang Wang , Yibing Zhan , Xinchao Wang , Mingli Song , Klara Nahrstedt

In this paper, we present a new cross-architecture contrastive learning (CACL) framework for self-supervised video representation learning. CACL consists of a 3D CNN and a video transformer which are used in parallel to generate diverse…

计算机视觉与模式识别 · 计算机科学 2022-05-27 Sheng Guo , Zihua Xiong , Yujie Zhong , Limin Wang , Xiaobo Guo , Bing Han , Weilin Huang

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

计算与语言 · 计算机科学 2021-09-20 Haoxiang Shi , Cen Wang

Until recently, the number of public real-world text images was insufficient for training scene text recognizers. Therefore, most modern training methods rely on synthetic data and operate in a fully supervised manner. Nevertheless, the…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Aviad Aberdam , Roy Ganz , Shai Mazor , Ron Litman

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Contrastive Analysis is a sub-field of Representation Learning that aims at separating common factors of variation between two datasets, a background (i.e., healthy subjects) and a target (i.e., diseased subjects), from the salient factors…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Robin Louiset , Edouard Duchesnay , Antoine Grigis , Pietro Gori

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

This work presents a method for visual text recognition without using any paired supervisory data. We formulate the text recognition task as one of aligning the conditional distribution of strings predicted from given text images, with…

计算机视觉与模式识别 · 计算机科学 2018-12-11 Ankush Gupta , Andrea Vedaldi , Andrew Zisserman

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

机器学习 · 计算机科学 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Electroencephalography-to-Text generation (EEG-to-Text), which aims to directly generate natural text from EEG signals has drawn increasing attention in recent years due to the enormous potential for Brain-computer interfaces (BCIs).…

人机交互 · 计算机科学 2023-01-24 Xiachong Feng , Xiaocheng Feng , Bing Qin

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

音频与语音处理 · 电气工程与系统科学 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Prior works on action representation learning mainly focus on designing various architectures to extract the global representations for short video clips. In contrast, many practical applications such as video alignment have strong demand…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Minghao Chen , Fangyun Wei , Chong Li , Deng Cai

Semantic representation is of great benefit to the video text tracking(VTT) task that requires simultaneously classifying, detecting, and tracking texts in the video. Most existing approaches tackle this task by appearance similarity in…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Zhuang Li , Weijia Wu , Mike Zheng Shou , Jiahong Li , Size Li , Zhongyuan Wang , Hong Zhou

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

机器学习 · 计算机科学 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler