English
Related papers

Related papers: Intrinsic Task-based Evaluation for Referring Expr…

200 papers

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

Referring Expression Comprehension (REC) is an emerging research spot in computer vision, which refers to detecting the target region in an image given an text description. Most existing REC methods follow a multi-stage pipeline, which are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Yiyi Zhou , Rongrong Ji , Gen Luo , Xiaoshuai Sun , Jinsong Su , Xinghao Ding , Chia-wen Lin , Qi Tian

Most of the existing work in one-stage referring expression comprehension (REC) mainly focuses on multi-modal fusion and reasoning, while the influence of other factors in this task lacks in-depth exploration. To fill this gap, we conduct…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Gen Luo , Yiyi Zhou , Jiamu Sun , Xiaoshuai Sun , Rongrong Ji

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak

Generating facial reactions in a human-human dyadic interaction is complex and highly dependent on the context since more than one facial reactions can be appropriate for the speaker's behaviour. This has challenged existing machine…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Tong Xu , Micol Spitale , Hao Tang , Lu Liu , Hatice Gunes , Siyang Song

Retrieval-augmented generation (RAG) has emerged as a popular solution to mitigate the hallucination issues of large language models. However, existing studies on RAG seldom address the issue of predictive uncertainty, i.e., how likely it…

Computation and Language · Computer Science 2024-12-05 Lu Chen , Ruqing Zhang , Jiafeng Guo , Yixing Fan , Xueqi Cheng

In this paper, we propose a novel model RevGAN that automatically generates controllable and personalized user reviews based on the arbitrarily given sentimental and stylistic information. RevGAN utilizes the combination of three novel…

Computation and Language · Computer Science 2020-01-09 Pan Li , Alexander Tuzhilin

Developing the capacity to effectively search for requisite datasets is an urgent requirement to assist data users in identifying relevant datasets considering the very limited available metadata. For this challenge, the utilization of…

Information Retrieval · Computer Science 2024-10-08 Teruaki Hayashi , Hiroki Sakaji , Jiayi Dai , Randy Goebel

The ability of language models in RAG systems to selectively refuse to answer based on flawed context is critical for safety, yet remains a significant failure point. Our large-scale study reveals that even frontier models struggle in this…

Computation and Language · Computer Science 2025-10-14 Aashiq Muhamed , Leonardo F. R. Ribeiro , Markus Dreyer , Virginia Smith , Mona T. Diab

We propose THELMA (Task Based Holistic Evaluation of Large Language Model Applications), a reference free framework for RAG (Retrieval Augmented generation) based question answering (QA) applications. THELMA consist of six interdependent…

This paper investigates the design of a unified search engine to serve multiple retrieval-augmented generation (RAG) agents, each with a distinct task, backbone large language model (LLM), and RAG strategy. We introduce an iterative…

Computation and Language · Computer Science 2025-06-27 Alireza Salemi , Hamed Zamani

Reinforcement learning has become the central approach for language models (LMs) to learn from environmental reward or feedback. In practice, the environmental feedback is usually sparse and delayed. Learning from such signals is…

Machine Learning · Computer Science 2026-02-17 Taiwei Shi , Sihao Chen , Bowen Jiang , Linxin Song , Longqi Yang , Jieyu Zhao

Although current state-of-the-art language models have achieved impressive results in numerous natural language processing tasks, still they could not solve the problem of producing repetitive, dull and sometimes inconsistent text in…

Computation and Language · Computer Science 2021-08-10 An Nguyen

Recent advances in large language models have enabled the development of viable generative retrieval systems. Instead of a traditional document ranking, generative retrieval systems often directly return a grounded generated text as a…

Reference expression comprehension (REC) aims to find the location that the phrase refer to in a given image. Proposal generation and proposal representation are two effective techniques in many two-stage REC methods. However, most of the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Chao Yang , Guoqing Wang , Dongsheng Li , Huawei Shen , Su Feng , Bin Jiang

REPA and its variants effectively mitigate training challenges in diffusion models by incorporating external visual representations from pretrained models, through alignment between the noisy hidden projections of denoising networks and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ge Wu , Shen Zhang , Ruijing Shi , Shanghua Gao , Zhenyuan Chen , Lei Wang , Zhaowei Chen , Hongcheng Gao , Yao Tang , Jian Yang , Ming-Ming Cheng , Xiang Li

We assume that recommender systems are more successful, when they are based on a thorough understanding of how people process information. In the current paper we test this assumption in the context of social tagging systems. Cognitive…

Information Retrieval · Computer Science 2014-05-09 Dominik Kowald , Paul Seitlinger , Christoph Trattner , Tobias Ley

Connecting conversation with external domain knowledge is vital for conversational recommender systems (CRS) to correctly understand user preferences. However, existing solutions either require domain-specific engineering, which limits…

Information Retrieval · Computer Science 2025-09-29 Dayu Yang , Hui Fang

Retrieval-augmented generation (RAG) is a powerful method for enhancing natural language generation by integrating external knowledge into a model's output. While prior work has demonstrated the importance of improving knowledge retrieval…

Computation and Language · Computer Science 2025-09-03 Xiangci Li , Jessica Ouyang

Embodied Everyday Task is a popular task in the embodied AI community, requiring agents to make a sequence of actions based on natural language instructions and visual observations. Traditional learning-based approaches face two challenges.…

Robotics · Computer Science 2024-09-18 Weiye Xu , Min Wang , Wengang Zhou , Houqiang Li