English
Related papers

Related papers: Fine-Grained Chemical Entity Typing with Multimoda…

200 papers

Named entity recognition (NER) of chemicals and drugs is a critical domain of information extraction in biochemical research. NER provides support for text mining in biochemical reactions, including entity relation extraction, attribute…

Computation and Language · Computer Science 2020-12-22 Jian Liu , Lei Gao , Sujie Guo , Rui Ding , Xin Huang , Long Ye , Qinghua Meng , Asef Nazari , Dhananjay Thiruvady

The recent advancement of pre-trained Transformer models has propelled the development of effective text mining models across various biomedical tasks. However, these models are primarily learned on the textual data and often lack the…

Computation and Language · Computer Science 2021-07-02 Sriram Pingali , Shweta Yadav , Pratik Dutta , Sriparna Saha

Motivation: State-of-the-art biomedical named entity recognition (BioNER) systems often require handcrafted features specific to each entity type, such as genes, chemicals and diseases. Although recent studies explored using neural network…

Information Retrieval · Computer Science 2018-10-09 Xuan Wang , Yu Zhang , Xiang Ren , Yuhao Zhang , Marinka Zitnik , Jingbo Shang , Curtis Langlotz , Jiawei Han

Multimodal Large Language Models (MLLMs) have seen growing adoption across various scientific disciplines. These advancements encourage the investigation of molecule-text modeling within synthetic chemistry, a field dedicated to designing…

Machine Learning · Computer Science 2024-06-21 He Cao , Yanjun Shao , Zhiyuan Liu , Zijing Liu , Xiangru Tang , Yuan Yao , Yu Li

Fine-grained entity typing is a challenging task with wide applications. However, most existing datasets for this task are in English. In this paper, we introduce a corpus for Chinese fine-grained entity typing that contains 4,800 mentions…

Computation and Language · Computer Science 2020-04-21 Chin Lee , Hongliang Dai , Yangqiu Song , Xin Li

Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains challenging as it is difficult to learn the association between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Wentian Zhao , Yao Hu , Heda Wang , Xinxiao Wu , Jiebo Luo

Fine-grained entity typing (FET), which assigns entities in text with context-sensitive, fine-grained semantic types, is a basic but important task for knowledge extraction from unstructured text. FET has been studied extensively in natural…

Computation and Language · Computer Science 2024-06-12 Tanay Komarlu , Minhao Jiang , Xuan Wang , Jiawei Han

External knowledge,e.g., entities and entity descriptions, can help humans understand texts. Many works have been explored to include external knowledge in the pre-trained models. These methods, generally, design pre-training tasks and…

Computation and Language · Computer Science 2022-08-19 Qinghua Zhao , Shuai Ma , Yuxuan Lei

With the widespread application of multimodal large language models in scientific intelligence, there is an urgent need for more challenging evaluation benchmarks to assess their ability to understand complex scientific data. Scientific…

Artificial Intelligence · Computer Science 2025-12-12 Yitong Zhou , Mingyue Cheng , Qingyang Mao , Yucong Luo , Qi Liu , Yupeng Li , Xiaohan Zhang , Deguang Liu , Xin Li , Enhong Chen

Our goal in this research is to study a more realistic environment in which we can conduct weakly-supervised multi-modal instance-level product retrieval for fine-grained product categories. We first contribute the Product1M datasets, and…

Multimedia · Computer Science 2022-06-20 Xiao Dong , Xunlin Zhan , Yunchao Wei , Xiaoyong Wei , Yaowei Wang , Minlong Lu , Xiaochun Cao , Xiaodan Liang

Fine-grained entity typing (FET) is the task of identifying specific entity types at a fine-grained level for entity mentions based on their contextual information. Conventional methods for FET require extensive human annotation, which is…

Computation and Language · Computer Science 2023-10-13 Siru Ouyang , Jiaxin Huang , Pranav Pillai , Yunyi Zhang , Yu Zhang , Jiawei Han

Fine-Grained Named Entity Typing (FG-NET) aims at classifying the entity mentions into a wide range of entity types (usually hundreds) depending upon the context. While distant supervision is the most common way to acquire supervised…

Computation and Language · Computer Science 2022-06-22 Muhammad Asif Ali , Yifang Sun , Bing Li , Wei Wang

This paper is a technical report on our system submitted to the chemical identification task of the BioCreative VII Track 2 challenge. The main feature of this challenge is that the data consists of full-text articles, while current…

Computation and Language · Computer Science 2021-11-23 Hyunjae Kim , Mujeen Sung , Wonjin Yoon , Sungjoon Park , Jaewoo Kang

Named Entity Recognition (NER) is an important task in natural language processing that aims to identify and extract key entities from unstructured text. We present a novel application of NER in plasma physics research articles and address…

Computation and Language · Computer Science 2026-02-13 Muhammad Haris , Hans Höft , Markus M. Becker , Markus Stocker

Accurate prediction of molecular properties in complex chemical systems is crucial for accelerating material discovery and chemical innovation. However, current computational methods often struggle to capture the intricate compositional…

Chemical Physics · Physics 2025-09-24 Jinming Fan , Chao Qian , Shaodong Zhou

The construction of experimental datasets is essential for expanding the scope of data-driven scientific discovery. Recent advances in natural language processing (NLP) have facilitated automatic extraction of structured data from…

Computation and Language · Computer Science 2025-05-12 Junhyeong Lee , Jong Min Yuk , Chan-Woo Lee

Named entity typing (NET) is a classification task of assigning an entity mention in the context with given semantic types. However, with the growing size and granularity of the entity types, rare researches in previous concern with newly…

Computation and Language · Computer Science 2020-11-04 Tao Zhang , Congying Xia , Chun-Ta Lu , Philip Yu

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair. Existing methods either (1) obtain named…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Meihuizi Jia , Lei Shen , Xin Shen , Lejian Liao , Meng Chen , Xiaodong He , Zhendong Chen , Jiaqi Li

Multimodal Entity Linking (MEL) is a crucial task that aims at linking ambiguous mentions within multimodal contexts to the referent entities in a multimodal knowledge base, such as Wikipedia. Existing methods focus heavily on using complex…

Artificial Intelligence · Computer Science 2024-08-22 Liu Qi , He Yongyi , Lian Defu , Zheng Zhi , Xu Tong , Liu Che , Chen Enhong

Existing text-driven infrared and visible image fusion approaches often rely on textual information at the sentence level, which can lead to semantic noise from redundant text and fail to fully exploit the deeper semantic value of textual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Wenyu Shao , Hongbo Liu , Yunchuan Ma , Ruili Wang