English
Related papers

Related papers: Coarse-to-Fine Memory Matching for Joint Retrieval…

200 papers

Contrastive Language and Image Pairing (CLIP), a transformative method in multimedia retrieval, typically trains two neural networks concurrently to generate joint embeddings for text and image pairs. However, when applied directly, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Coreference resolution is the task of finding expressions that refer to the same entity in a text. Coreference models are generally trained on monolingual annotated data but annotating coreference is expensive and challenging. Hardmeier et…

Computation and Language · Computer Science 2023-05-30 Gongbo Tang , Christian Hardmeier

In the recent years, the dual-encoder vision-language models (\eg CLIP) have achieved remarkable text-to-image retrieval performance. However, we discover that these models usually results in very different retrievals for a pair of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jiacheng Cheng , Hijung Valentina Shin , Nuno Vasconcelos , Bryan Russell , Fabian Caba Heilbron

A popular approach to creating a zero-shot cross-language retrieval model is to substitute a monolingual pretrained language model in the retrieval model with a multilingual pretrained language model such as Multilingual BERT. This…

Information Retrieval · Computer Science 2022-12-21 Eugene Yang , Suraj Nair , Dawn Lawrie , James Mayfield , Douglas W. Oard

This paper studies the task of best counter-argument retrieval given an input argument. Following the definition that the best counter-argument addresses the same aspects as the input argument while having the opposite stance, we aim to…

Computation and Language · Computer Science 2023-04-20 Hongguang Shi , Shuirong Cao , Cam-Tu Nguyen

End-to-end neural models have made significant progress in question answering, however recent studies show that these models implicitly assume that the answer and evidence appear close together in a single document. In this work, we propose…

Computation and Language · Computer Science 2019-05-14 Victor Zhong , Caiming Xiong , Nitish Shirish Keskar , Richard Socher

Biomedical entity linking is the task of identifying mentions of biomedical concepts in text documents and mapping them to canonical entities in a target thesaurus. Recent advancements in entity linking using BERT-based models follow a…

Computation and Language · Computer Science 2021-03-10 Rajarshi Bhowmik , Karl Stratos , Gerard de Melo

Coreference resolution, the task of identifying expressions in text that refer to the same entity, is a critical component in various natural language processing applications. This paper presents a novel end-to-end neural coreference…

Computation and Language · Computer Science 2024-12-30 Ondřej Pražák , Miloslav Konopík , Pavel Král

The latest developments in Natural Language Processing (NLP) have demonstrated remarkable progress in a code-text retrieval problem. As the Transformer-based models used in this task continue to increase in size, the computational costs and…

Machine Learning · Computer Science 2024-05-08 Karim Galliamov , Leila Khaertdinova , Karina Denisova

We present an approach for jointly matching and segmenting object instances of the same category within a collection of images. In contrast to existing algorithms that tackle the tasks of semantic matching and object co-segmentation in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Yun-Chun Chen , Yen-Yu Lin , Ming-Hsuan Yang , Jia-Bin Huang

Pretrained contextualized language models such as BERT have achieved impressive results on various natural language processing benchmarks. Benefiting from multiple pretraining tasks and large scale training corpora, pretrained models can…

Information Retrieval · Computer Science 2020-05-28 Zhiyu Chen , Mohamed Trabelsi , Jeff Heflin , Yinan Xu , Brian D. Davison

BERT is inefficient for sentence-pair tasks such as clustering or semantic search as it needs to evaluate combinatorially many sentence pairs which is very time-consuming. Sentence BERT (SBERT) attempted to solve this challenge by learning…

Computation and Language · Computer Science 2021-02-08 Yan Zhang , Ruidan He , Zuozhu Liu , Kwan Hui Lim , Lidong Bing

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

Computation and Language · Computer Science 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Deep learning algorithms have recently gained significant attention due to their impressive performance. However, their high complexity and un-interpretable mode of operation hinders their confident deployment in real-world safety-critical…

Machine Learning · Computer Science 2024-06-28 Konstantinos P. Panousis , Dino Ienco , Diego Marcos

Detecting plagiarism involves finding similar items in two different sources. In this article, we propose a novel method for detecting plagiarism that is based on attention mechanism-based long short-term memory (LSTM) and bidirectional…

Computation and Language · Computer Science 2023-05-05 Seyed Vahid Moravvej , Seyed Jalaleddin Mousavirad , Diego Oliva , Fardin Mohammadi

Autoregressive language models like GPT aim to predict next tokens, while autoencoding models such as BERT are trained on tasks such as predicting masked tokens. We train a decoder-only architecture for predicting the second to last token…

Computation and Language · Computer Science 2025-02-17 Johannes Schneider

Referring Expression Comprehension and Segmentation are critical tasks for assessing the integration of language understanding and image comprehension, serving as benchmarks for Multimodal Large Language Models (MLLMs) capabilities. To…

Computation and Language · Computer Science 2026-01-21 Qihua Dong , Luis Figueroa , Handong Zhao , Kushal Kafle , Jason Kuen , Zhihong Ding , Scott Cohen , Yun Fu

When combined with In-Context Learning, a technique that enables models to adapt to new tasks by incorporating task-specific examples or demonstrations directly within the input prompt, autoregressive language models have achieved good…

Computation and Language · Computer Science 2024-10-18 Enzo Shiraishi , Raphael Y. de Camargo , Henrique L. P. Silva , Ronaldo C. Prati

Video-text retrieval has seen significant advancements, yet the ability of models to discern subtle differences in captions still requires verification. In this paper, we introduce a new approach for fine-grained evaluation. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Aozhu Chen , Hazel Doughty , Xirong Li , Cees G. M. Snoek

This paper presents a deep neural architecture, for Natural Language Sentence Matching (NLSM) by adding a deep recursive encoder to BERT so called BERT with Deep Recursive Encoder (BERT-DRE). Our analysis of model behavior shows that BERT…

Computation and Language · Computer Science 2021-11-05 Ehsan Tavan , Ali Rahmati , Maryam Najafi , Saeed Bibak , Zahed Rahmati