English
Related papers

Related papers: Contrastive Multi-document Question Generation

200 papers

Existing text recognition methods usually need large-scale training data. Most of them rely on synthetic training data due to the lack of annotated real images. However, there is a domain gap between the synthetic data and real data, which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mingkun Yang , Minghui Liao , Pu Lu , Jing Wang , Shenggao Zhu , Hualin Luo , Qi Tian , Xiang Bai

In this paper, we tackle the task of distractor generation (DG) for multiple-choice questions. Our study introduces two key designs. First, we propose \textit{retrieval augmented pretraining}, which involves refining the language model…

Computation and Language · Computer Science 2024-06-21 Han-Cheng Yu , Yu-An Shih , Kin-Man Law , Kai-Yu Hsieh , Yu-Chen Cheng , Hsin-Chih Ho , Zih-An Lin , Wen-Chuan Hsu , Yao-Chung Fan

Contemporary large-scale visual language models (VLMs) exhibit strong representation capacities, making them ubiquitous for enhancing image and text understanding tasks. They are often trained in a contrastive manner on a large and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Ugur Sahin , Hang Li , Qadeer Khan , Daniel Cremers , Volker Tresp

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Computed Tomography Report Generation (CTRG) aims to automate the clinical radiology reporting process, thereby reducing the workload of report writing and facilitating patient care. While deep learning approaches have achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qiong Peng , Yawen Huang , Xian Wu , Yefeng Zheng , Liansheng Wang

We propose a generative machine comprehension model that learns jointly to ask and answer questions based on documents. The proposed model uses a sequence-to-sequence framework that encodes the document and generates a question (answer)…

Computation and Language · Computer Science 2017-06-06 Tong Wang , Xingdi Yuan , Adam Trischler

Human explanations are often contrastive, meaning that they do not answer the indeterminate "Why?" question, but instead "Why P, rather than Q?". Automatically generating contrastive explanations is challenging because the contrastive event…

Software Engineering · Computer Science 2024-02-21 Lars Herbold , Mersedeh Sadeghi , Andreas Vogelsang

Motivated by the success of coarse-grained or fine-grained contrast in text-video retrieval, there emerge multi-grained contrastive learning methods which focus on the integration of contrasts with different granularity. However, due to the…

Information Retrieval · Computer Science 2025-04-08 Xiaolun Jing , Genke Yang , Jian Chu

Math Word Problem (MWP) solving needs to discover the quantitative relationships over natural language narratives. Recent work shows that existing models memorize procedures from context and rely on shallow heuristics to solve MWPs. In this…

Computation and Language · Computer Science 2022-03-11 Zhongli Li , Wenxuan Zhang , Chao Yan , Qingyu Zhou , Chao Li , Hongzhi Liu , Yunbo Cao

For the field of education, being able to generate semantically correct and educationally relevant multiple choice questions (MCQs) could have a large impact. While question generation itself is an active research topic, generating…

Computation and Language · Computer Science 2020-10-20 Jeroen Offerijns , Suzan Verberne , Tessa Verhoef

Contrastive learning is an approach to representation learning that utilizes naturally occurring similar and dissimilar pairs of data points to find useful embeddings of data. In the context of document classification under topic modeling…

Machine Learning · Computer Science 2020-03-05 Christopher Tosh , Akshay Krishnamurthy , Daniel Hsu

Multi-hop Question Generation (QG) aims to generate answer-related questions by aggregating and reasoning over multiple scattered evidence from different paragraphs. It is a more challenging yet under-explored task compared to conventional…

Computation and Language · Computer Science 2021-02-10 Dan Su , Yan Xu , Wenliang Dai , Ziwei Ji , Tiezheng Yu , Pascale Fung

We present $\textbf{$\texttt{SkillQG}$}$: a question generation framework with controllable comprehension types for assessing and improving machine reading comprehension models. Existing question generation systems widely differentiate…

Computation and Language · Computer Science 2023-05-09 Xiaoqiang Wang , Bang Liu , Siliang Tang , Lingfei Wu

Recent years have witnessed increasing interest in code representation learning, which aims to represent the semantics of source code into distributed vectors. Currently, various works have been proposed to represent the complex semantics…

Programming Languages · Computer Science 2022-05-05 Xin Wang , Yasheng Wang , Yao Wan , Jiawei Wang , Pingyi Zhou , Li Li , Hao Wu , Jin Liu

Deep candidate generation (DCG) that narrows down the collection of relevant items from billions to hundreds via representation learning has become prevalent in industrial recommender systems. Standard approaches approximate maximum…

Information Retrieval · Computer Science 2021-06-07 Chang Zhou , Jianxin Ma , Jianwei Zhang , Jingren Zhou , Hongxia Yang

The top-k recommendation is a fundamental task in recommendation systems which is generally learned by comparing positive and negative pairs. The Contrastive Loss (CL) is the key in contrastive learning that has received more attention…

Information Retrieval · Computer Science 2021-09-02 Hao Tang , Guoshuai Zhao , Yuxia Wu , Xueming Qian

Self-supervised learning (SSL) for multivariate time series mainly includes two paradigms: contrastive methods that excel at instance discrimination and generative approaches that model data distributions. While effective individually,…

Machine Learning · Computer Science 2025-08-14 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

There are many potential benefits to news readers accessing diverse sources. Modern news aggregators do the hard work of organizing the news, offering readers a plethora of source options, but choosing which source to read remains…

Computation and Language · Computer Science 2022-11-10 Philippe Laban , Chien-Sheng Wu , Lidiya Murakhovs'ka , Xiang 'Anthony' Chen , Caiming Xiong

The effectiveness of contrastive learning in sequential recommendation hinges on the construction of contrastive views, which ideally should be both semantically consistent and diverse. However, most existing CL-based methods rely on…

Information Retrieval · Computer Science 2026-05-13 Wei Wang

Teaching neural models to generate narrative coherent texts is a critical problem. Recent pre-trained language models have achieved promising results, but there is still a gap between human written texts and machine-generated outputs. In…

Computation and Language · Computer Science 2022-10-27 Zhe Hu , Hou Pong Chan , Lifu Huang