English
Related papers

Related papers: CLEVE: Contrastive Pre-training for Event Extracti…

200 papers

Event extraction (EE) is one of the core information extraction tasks, whose purpose is to automatically identify and extract information about incidents and their actors from texts. This may be beneficial to several domains such as…

Machine Learning · Computer Science 2020-10-29 Ali Balali , Masoud Asadpour , Ricardo Campos , Adam Jatowt

Binary code representation learning has shown significant performance in binary analysis tasks. But existing solutions often have poor transferability, particularly in few-shot and zero-shot scenarios where few or no training samples are…

Software Engineering · Computer Science 2024-02-28 Hao Wang , Zeyu Gao , Chao Zhang , Zihan Sha , Mingyang Sun , Yuchen Zhou , Wenyu Zhu , Wenju Sun , Han Qiu , Xi Xiao

Identifying events and mapping them to pre-defined event types has long been an important natural language processing problem. Most previous work has been heavily relying on labor-intensive and domain-specific annotations while ignoring the…

Computation and Language · Computer Science 2021-06-03 Hongming Zhang , Haoyu Wang , Dan Roth

The contextual information is critical for various computer vision tasks, previous works commonly design plug-and-play modules and structural losses to effectively extract and aggregate the global context. These methods utilize fine-label…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jing Wang , Jiangyun Li , Wei Li , Lingfei Xuan , Tianxiang Zhang , Wenxuan Wang

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising performances when transferred to downstream tasks. Nevertheless,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Xuran Pan , Tianzhu Ye , Dongchen Han , Shiji Song , Gao Huang

In this paper, a novel contrastive language-image pre-training (CLIP) model based semantic communication framework is designed. Compared to standard neural network (e.g.,convolutional neural network) based semantic encoders and decoders…

Machine Learning · Computer Science 2025-07-15 Shaoran Yang , Dongyu Wei , Hanzhi Yu , Zhaohui Yang , Yuchen Liu , Mingzhe Chen

Context-aware emotion recognition (CAER) has recently boosted the practical applications of affective computing techniques in unconstrained environments. Mainstream CAER methods invariably extract ensemble representations from diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dingkang Yang , Kun Yang , Mingcheng Li , Shunli Wang , Shuaibing Wang , Lihua Zhang

Dense retrieval (DR) has shown promising results in information retrieval. In essence, DR requires high-quality text representations to support effective search in the representation space. Recent studies have shown that pre-trained…

Information Retrieval · Computer Science 2022-08-23 Xinyu Ma , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Structural extraction of events within discourse is critical since it avails a deeper understanding of communication patterns and behavior trends. Event argument extraction (EAE), at the core of event-centric understanding, is the task of…

Computation and Language · Computer Science 2025-03-21 Xinliang Frederick Zhang , Carter Blum , Temma Choji , Shalin Shah , Alakananda Vempala

Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods…

Computation and Language · Computer Science 2023-12-12 Tao Shi , Xiao Liang , Yaoyuan Liang , Xinyi Tong , Shao-Lun Huang

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

In this study, we present EventRL, a reinforcement learning approach developed to enhance event extraction for large language models (LLMs). EventRL utilizes outcome supervision with specific reward functions to tackle prevalent challenges…

Computation and Language · Computer Science 2024-02-20 Jun Gao , Huan Zhao , Wei Wang , Changlong Yu , Ruifeng Xu

Most video-and-language representation learning approaches employ contrastive learning, e.g., CLIP, to project the video and text features into a common latent space according to the semantic similarities of text-video pairs. However, such…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Peng Jin , Jinfa Huang , Fenglin Liu , Xian Wu , Shen Ge , Guoli Song , David A. Clifton , Jie Chen

We present GTE, a general-purpose text embedding model trained with multi-stage contrastive learning. In line with recent advancements in unifying various NLP tasks into a single format, we train a unified text embedding model by employing…

Computation and Language · Computer Science 2023-08-08 Zehan Li , Xin Zhang , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang

Detecting events from social media data streams is gradually attracting researchers. The innate challenge for detecting events is to extract discriminative information from social media data thereby assigning the data into different events.…

Social and Information Networks · Computer Science 2023-12-18 Yuanyuan Guo , Zehua Zang , Hang Gao , Xiao Xu , Rui Wang , Lixiang Liu , Jiangmeng Li

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

Constituency Parse Extraction from Pre-trained Language Models (CPE-PLM) is a recent paradigm that attempts to induce constituency parse trees relying only on the internal knowledge of pre-trained language models. While attractive in the…

Computation and Language · Computer Science 2022-11-02 Taeuk Kim