English
Related papers

Related papers: Zero- and Few-Shots Knowledge Graph Triplet Extrac…

200 papers

One of the ways Large Language Models (LLMs) are used to perform machine learning tasks is to provide them with a few examples before asking them to produce a prediction. This is a meta-learning process known as few-shot learning. In this…

Software Engineering · Computer Science 2024-03-14 Vali Tawosi , Salwa Alamir , Xiaomo Liu

The training of large language models (LLMs) is expensive. In this paper, we study data-efficient approaches for pre-training LLMs, i.e., techniques that aim to optimize the Pareto frontier of model quality and training resource/data…

Previous studies in Open Information Extraction (Open IE) are mainly based on extraction patterns. They manually define patterns or automatically learn them from a large corpus. However, these approaches are limited when grasping the…

Computation and Language · Computer Science 2016-05-26 Byungsoo Kim , Hwanjo Yu , Gary Geunbae Lee

We evaluate the ability of large language models (LLMs) to infer causal relations from natural language. Compared to traditional natural language processing and deep learning techniques, LLMs show competitive performance in a benchmark of…

Artificial Intelligence · Computer Science 2023-12-25 Alessandro Antonucci , Gregorio Piqué , Marco Zaffalon

Knowledge-based question answering (KBQA) is widely used in many scenarios that necessitate domain knowledge. Large language models (LLMs) bring opportunities to KBQA, while their costs are significantly higher and absence of…

Computation and Language · Computer Science 2024-05-28 Junnan Dong , Qinggang Zhang , Chuang Zhou , Hao Chen , Daochen Zha , Xiao Huang

The emerging zero-shot capabilities of Large Language Models (LLMs) have led to their applications in areas extending well beyond natural language processing tasks. In reinforcement learning, while LLMs have been extensively used in…

This study examines how Large Language Models (LLMs) perform when tackling quantitative management decision problems in a zero-shot setting. Drawing on 900 responses generated by five leading models across 20 diverse managerial scenarios,…

Computation and Language · Computer Science 2025-02-25 Jonathan Kuzmanko

Existing knowledge probing methods rely on pre-defined queries, limiting extraction to known concepts. We introduce DecompressionLM, a stateless framework for zero-shot concept graph extraction that discovers what language models encode…

Computation and Language · Computer Science 2026-02-06 Zhaochen Hong , Jiaxuan You

Large language model (LLM) has achieved outstanding performance on various downstream tasks with its powerful natural language understanding and zero-shot capability, but LLM still suffers from knowledge limitation. Especially in scenarios…

Computation and Language · Computer Science 2024-08-07 Tiezheng Guo , Qingwen Yang , Chen Wang , Yanyi Liu , Pan Li , Jiawei Tang , Dapeng Li , Yingyou Wen

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving…

Computation and Language · Computer Science 2025-09-18 Zhen Zhang , Xinyu Wang , Yong Jiang , Zile Qiao , Zhuo Chen , Guangyu Li , Feiteng Mu , Mengting Hu , Pengjun Xie , Fei Huang

This study is dedicated to assessing the capabilities of large language models (LLMs) such as GPT-3.5-Turbo, GPT-4, and GPT-4-Turbo in extracting structured information from scientific documents in materials science. To this end, we…

Computation and Language · Computer Science 2024-06-03 Luca Foppiano , Guillaume Lambard , Toshiyuki Amagasa , Masashi Ishii

Large Language Models (LLMs) have revolutionized many areas of artificial intelligence (AI), but their substantial resource requirements limit their deployment on mobile and edge devices. This survey paper provides a comprehensive overview…

Machine Learning · Computer Science 2025-09-03 Sanjay Surendranath Girija , Shashank Kapoor , Lakshit Arora , Dipen Pradhan , Aman Raj , Ankit Shetgaonkar

Large Language Models (LLMs) have demonstrated remarkable generalization capabilities across diverse tasks and languages. In this study, we focus on natural language understanding in three classical languages -- Sanskrit, Ancient Greek and…

The rapid growth of biomedical knowledge has outpaced our ability to efficiently extract insights and generate novel hypotheses. Large language models (LLMs) have emerged as a promising tool to revolutionize knowledge interaction and…

Computation and Language · Computer Science 2024-07-16 Biqing Qi , Kaiyan Zhang , Kai Tian , Haoxiang Li , Zhang-Ren Chen , Sihang Zeng , Ermo Hua , Hu Jinfang , Bowen Zhou

Recent advancement in large language models (LLMs) has offered a strong potential for natural language systems to process informal language. A representative form of informal language is slang, used commonly in daily conversations and…

Computation and Language · Computer Science 2024-04-16 Zhewei Sun , Qian Hu , Rahul Gupta , Richard Zemel , Yang Xu

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer…

Computation and Language · Computer Science 2024-02-23 Junjie Ye , Nuo Xu , Yikun Wang , Jie Zhou , Qi Zhang , Tao Gui , Xuanjing Huang

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow…

Computation and Language · Computer Science 2024-10-11 Lingbing Guo , Zhongpu Bo , Zhuo Chen , Yichi Zhang , Jiaoyan Chen , Yarong Lan , Mengshu Sun , Zhiqiang Zhang , Yangyifei Luo , Qian Li , Qiang Zhang , Wen Zhang , Huajun Chen

The advent of Large Language Models (LLM) has revolutionized the field of natural language processing, enabling significant progress in various applications. One key area of interest is the construction of Knowledge Bases (KB) using these…

Computation and Language · Computer Science 2023-08-28 Anmol Nayak , Hari Prasad Timmapathini

While large language models (LLMs) have demonstrated remarkable reasoning capabilities, they are not without their flaws and inaccuracies. Recent studies have introduced various methods to mitigate these limitations. Temporal reasoning…

Computation and Language · Computer Science 2024-10-10 Siheng Xiong , Ali Payani , Ramana Kompella , Faramarz Fekri

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks. However, these English-centric models encounter challenges in non-English clinical settings,…

Computation and Language · Computer Science 2024-01-31 Jiageng Wu , Xian Wu , Zhaopeng Qiu , Minghui Li , Yingying Zhang , Yefeng Zheng , Changzheng Yuan , Jie Yang