English
Related papers

Related papers: LLMs as Bridges: Reformulating Grounded Multimodal…

200 papers

Weakly supervised Referring Expression Grounding (REG) aims to ground a particular target in an image described by a language expression while lacking the correspondence between target and expression. Two main problems exist in weakly…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xuejing Liu , Liang Li , Shuhui Wang , Zheng-Jun Zha , Zechao Li , Qi Tian , Qingming Huang

Grounded Situation Recognition (GSR) is the task that not only classifies a salient action (verb), but also predicts entities (nouns) associated with semantic roles and their locations in the given image. Inspired by the remarkable success…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Junhyeong Cho , Youngseok Yoon , Hyeonjun Lee , Suha Kwak

In-Context Learning (ICL) technique based on Large Language Models (LLMs) has gained prominence in Named Entity Recognition (NER) tasks for its lower computing resource consumption, less manual labeling overhead, and stronger…

Computation and Language · Computer Science 2025-05-30 Yuzhen Xiao , Jiahe Song , Yongxin Xu , Ruizhe Zhang , Yiqi Xiao , Xin Lu , Runchuan Zhu , Bowen Jiang , Junfeng Zhao

Grounded Situation Recognition (GSR) aims to generate structured semantic summaries of images for "human-like" event understanding. Specifically, GSR task not only detects the salient activity verb (e.g. buying), but also predicts all…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhi-Qi Cheng , Qi Dai , Siyao Li , Teruko Mitamura , Alexander G. Hauptmann

While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these assumptions remain scarce. The Universal NER project, now…

Named Entity Recognition (NER) is a critical task in natural language processing, yet it remains particularly challenging for discontinuous entities. The primary difficulty lies in text segmentation, as traditional methods often missegment…

Computation and Language · Computer Science 2026-01-01 Wen-Fang Su , Hsiao-Wei Chou , Wen-Yang Lin

Entity retrieval, which aims at disambiguating mentions to canonical entities from massive KBs, is essential for many tasks in natural language processing. Recent progress in entity retrieval shows that the dual-encoder structure is a…

Computation and Language · Computer Science 2021-09-14 Xinyin Ma , Yong Jiang , Nguyen Bach , Tao Wang , Zhongqiang Huang , Fei Huang , Weiming Lu

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations in correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2018-09-07 Diego Esteves

Recurrent Neural Network models are the state-of-the-art for Named Entity Recognition (NER). We present two innovations to improve the performance of these models. The first innovation is the introduction of residual connections between the…

Computation and Language · Computer Science 2017-07-12 Quan Tran , Andrew MacKinlay , Antonio Jimeno Yepes

Named entity recognition (NER) task aims at identifying entities from a piece of text that belong to predefined semantic types such as person, location, organization, etc. The state-of-the-art solutions for flat entities NER commonly suffer…

Computation and Language · Computer Science 2022-08-08 Jianlin Su , Ahmed Murtadha , Shengfeng Pan , Jing Hou , Jun Sun , Wanwei Huang , Bo Wen , Yunfeng Liu

Named Entity Recognition (NER) is a well and widely studied task in natural language processing. Recently, the nested NER has attracted more attention since its practicality and difficulty. Existing works for nested NER ignore the…

Computation and Language · Computer Science 2023-05-15 Yawen Yang , Xuming Hu , Fukun Ma , Shu'ang Li , Aiwei Liu , Lijie Wen , Philip S. Yu

India's rich cultural and linguistic diversity poses various challenges in the domain of Natural Language Processing (NLP), particularly in Named Entity Recognition (NER). NER is a NLP task that aims to identify and classify tokens into…

Computation and Language · Computer Science 2025-02-07 Mohammed Amaan Dhamaskar , Rasika Ransing

Previous studies have shown that linguistic features of a word such as possession, genitive or other grammatical cases can be employed in word representations of a named entity recognition (NER) tagger to improve the performance for…

Computation and Language · Computer Science 2019-11-12 Onur Güngör , Suzan Üsküdarlı , Tunga Güngör

The rapid advancement of Multimodal Large Language Models (MLLMs) has extended CLIP-based frameworks to produce powerful, universal embeddings for retrieval tasks. However, existing methods primarily focus on natural images, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Weijian Jian , Yajun Zhang , Dawei Liang , Chunyu Xie , Yixiao He , Dawei Leng , Yuhui Yin

Entity matching (EM) is a critical task in data integration, aiming to identify records across different datasets that refer to the same real-world entities. Traditional methods often rely on manually engineered features and rule-based…

Computation and Language · Computer Science 2024-06-03 Qianyu Huang , Tongfang Zhao

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

We introduce Grounded Situation Recognition (GSR), a task that requires producing structured semantic summaries of images describing: the primary activity, entities engaged in the activity with their roles (e.g. agent, tool), and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Sarah Pratt , Mark Yatskar , Luca Weihs , Ali Farhadi , Aniruddha Kembhavi

Processing complex and ambiguous named entities is a challenging research problem, but it has not received sufficient attention from the natural language processing community. In this short paper, we present our participation in the English…

Computation and Language · Computer Science 2022-03-08 Ngoc Minh Lai

Traditional named entity recognition (NER) aims to identify text mentions into pre-defined entity types. Continual Named Entity Recognition (CNER) is introduced since entity categories are continuously increasing in various real-world…

Computation and Language · Computer Science 2025-10-14 Yawen Yang , Fukun Ma , Shiao Meng , Aiwei Liu , Lijie Wen

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui