English
Related papers

Related papers: LLMs as Bridges: Reformulating Grounded Multimodal…

200 papers

Autonomous agents operating on the graphical user interfaces (GUIs) of various applications hold immense practical value. Unlike the large language model (LLM)-based methods which rely on structured texts and customized backends, the…

Artificial Intelligence · Computer Science 2024-11-05 Xuetian Chen , Hangcheng Li , Jiaqing Liang , Sihang Jiang , Deqing Yang

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations with correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2017-10-31 Diego Esteves , Rafael Peres , Jens Lehmann , Giulio Napolitano

We present MultiCoNER, a large multilingual dataset for Named Entity Recognition that covers 3 domains (Wiki sentences, questions, and search queries) across 11 languages, as well as multilingual and code-mixing subsets. This dataset is…

Computation and Language · Computer Science 2022-09-01 Shervin Malmasi , Anjie Fang , Besnik Fetahu , Sudipta Kar , Oleg Rokhlenko

Named entities are ubiquitous in text that naturally accompanies images, especially in domains such as news or Wikipedia articles. In previous work, named entities have been identified as a likely reason for low performance of image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Giacomo Nebbia , Adriana Kovashka

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin

The task of named entity recognition (NER) is normally divided into nested NER and flat NER depending on whether named entities are nested or not. Models are usually separately developed for the two tasks, since sequence labeling models,…

Computation and Language · Computer Science 2022-11-23 Xiaoya Li , Jingrong Feng , Yuxian Meng , Qinghong Han , Fei Wu , Jiwei Li

Deep learning (DL) based channel estimation (CE) and multiple input and multiple output detection (MIMODet), as two separate research topics, have provided convinced evidence to demonstrate the effectiveness and robustness of artificial…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Xiangzhao Qin , Sha Hu , Jiankun Zhang , Jing Qian , Hao Wang

Visual grounding is a ubiquitous building block in many vision-language tasks and yet remains challenging due to large variations in visual and linguistic features of grounding entities, strong context effect and the resulting semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Yongfei Liu , Bo Wan , Xiaodan Zhu , Xuming He

Large language models (LLMs) have demonstrated remarkable versatility across a wide range of natural language processing tasks and domains. One such task is Named Entity Recognition (NER), which involves identifying and classifying proper…

Digital Libraries · Computer Science 2026-04-29 Shibingfeng Zhang , Giovanni Colavizza

In recent years, the fine-tuned generative models have been proven more powerful than the previous tagging-based or span-based models on named entity recognition (NER) task. It has also been found that the information related to entities,…

Computation and Language · Computer Science 2024-06-12 Guochao Jiang , Ziqin Luo , Yuchen Shi , Dixuan Wang , Jiaqing Liang , Deqing Yang

Lately, instruction-based techniques have made significant strides in improving performance in few-shot learning scenarios. They achieve this by bridging the gap between pre-trained language models and fine-tuning for specific downstream…

Information Retrieval · Computer Science 2024-01-25 Hiranmai Sri Adibhatla , Pavan Baswani , Manish Shrivastava

Large Language Models (LLMs) have revolutionized various sectors, including healthcare where they are employed in diverse applications. Their utility is particularly significant in the context of rare diseases, where data scarcity,…

Computation and Language · Computer Science 2024-08-20 Qiuhao Lu , Rui Li , Andrew Wen , Jinlian Wang , Liwei Wang , Hongfang Liu

Named Entity Recognition (NER) is a key NLP task, which is all the more challenging on Web and user-generated content with their diverse and continuously changing language. This paper aims to quantify how this diversity impacts…

Computation and Language · Computer Science 2017-03-09 Isabelle Augenstein , Leon Derczynski , Kalina Bontcheva

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

Despite advances in multimodal learning, challenging benchmarks for mixed-modal image retrieval that combines visual and textual information are lacking. This paper introduces a novel benchmark to rigorously evaluate image retrieval that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Cristian-Ioan Blaga , Paul Suganthan , Sahil Dua , Krishna Srinivasan , Enrique Alfonseca , Peter Dornbach , Tom Duerig , Imed Zitouni , Zhe Dong

Knowledge-based Visual Question Answering about Named Entities is a challenging task that requires retrieving information from a multimodal Knowledge Base. Named entities have diverse visual representations and are therefore difficult to…

Computation and Language · Computer Science 2024-01-12 Paul Lerner , Olivier Ferret , Camille Guinaudeau

Leveraging the universal representations of pre-trained LLMs and MLLMs offers a promising path toward brain foundation models. However, visually-evoked EEG datasets remain scarce, leading existing methods to align neural signals mainly with…

Artificial Intelligence · Computer Science 2026-05-26 Jun-Yu Pan , Yansen Wang , Enze Zhang , Bao-Liang Lu , Wei-Long Zheng , Dongsheng Li

Visual Entity Linking (VEL) is a task to link regions of images with their corresponding entities in Knowledge Bases (KBs), which is beneficial for many computer vision tasks such as image retrieval, image caption, and visual question…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Wenxiang Sun , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng

Named Entity Recognition (NER) and Entity Linking (EL) play an essential role in voice assistant interaction, but are challenging due to the special difficulties associated with spoken user queries. In this paper, we propose a novel…

Satellite imagery differs fundamentally from natural images: its aerial viewpoint, very high resolution, diverse scale variations, and abundance of small objects demand both region-level spatial reasoning and holistic scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Emanuel Sánchez Aimar , Gulnaz Zhambulova , Fahad Shahbaz Khan , Yonghao Xu , Michael Felsberg