English
Related papers

Related papers: Raw Text is All you Need: Knowledge-intensive Mult…

200 papers

Fine-tuning large language models (LLMs) on multi-task instruction-following data has been proven to be a powerful learning paradigm for improving their zero-shot capabilities on new tasks. Recent works about high-quality…

Computation and Language · Computer Science 2024-06-17 Wei Han , Hui Chen , Soujanya Poria

Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yuzhe Lu , Sungmin Hong , Yash Shah , Panpan Xu

In this paper, we investigate the use of large language models (LLMs) like ChatGPT for document-grounded response generation in the context of information-seeking dialogues. For evaluation, we use the MultiDoc2Dial corpus of task-oriented…

Computation and Language · Computer Science 2023-09-22 Norbert Braunschweiler , Rama Doddipatla , Simon Keizer , Svetlana Stoyanchev

Virtual Reality (VR) has emerged as a powerful tool for workforce training, offering immersive, interactive, and risk-free environments that enhance skill acquisition, decision-making, and confidence. Despite its advantages, developing VR…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Subin Raj Peter

When using supervised fine-tuning (SFT) to adapt large language models (LLMs) to specific domains, a significant challenge arises: should we use the entire SFT dataset for fine-tuning? Common practice often involves fine-tuning directly on…

Computation and Language · Computer Science 2025-05-26 Xiang Liu , Zhaoxiang Liu , Peng Wang , Kohou Wang , Huan Hu , Kai Wang , Shiguo Lian

Large language models (LLMs) excel at solving problems with clear and complete statements, but often struggle with nuanced environments or interactive tasks which are common in most real-world scenarios. This highlights the critical need…

Multi-turn instruction following capability constitutes a core competency of large language models (LLMs) in real-world applications. Existing evaluation benchmarks predominantly focus on fine-grained constraint satisfaction and…

Computation and Language · Computer Science 2025-06-02 Jinnan Li , Jinzhe Li , Yue Wang , Yi Chang , Yuan Wu

Many-to-many summarization (M2MS) aims to process documents in any language and generate the corresponding summaries also in any language. Recently, large language models (LLMs) have shown strong multi-lingual abilities, giving them the…

Computation and Language · Computer Science 2025-05-20 Jiaan Wang , Fandong Meng , Zengkui Sun , Yunlong Liang , Yuxuan Cao , Jiarong Xu , Haoxiang Shi , Jie Zhou

Accurate multi-turn intent classification is essential for advancing conversational AI systems. However, challenges such as the scarcity of comprehensive datasets and the complexity of contextual dependencies across dialogue turns hinder…

Computation and Language · Computer Science 2024-11-20 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

We introduce a technique for multi-document grounded multi-turn synthetic dialog generation that incorporates three main ideas. First, we control the overall dialog flow using taxonomy-driven user queries that are generated with…

Computation and Language · Computer Science 2024-09-19 Young-Suk Lee , Chulaka Gunasekara , Danish Contractor , Ramón Fernandez Astudillo , Radu Florian

The advent of Large Language Models (LLMs) has ushered in a new era for design science in Information Systems, demanding a paradigm shift in tailoring LLMs design for business contexts. We propose and test a novel framework to customize…

Computers and Society · Computer Science 2024-05-15 Wen Wang , Zhenyue Zhao , Tianshu Sun

Objective To solve major clinical natural language processing (NLP) tasks using a unified text-to-text learning architecture based on a generative large language model (LLM) via prompt tuning. Methods We formulated 7 key clinical NLP tasks…

Computation and Language · Computer Science 2023-12-12 Cheng Peng , Xi Yang , Aokun Chen , Zehao Yu , Kaleb E Smith , Anthony B Costa , Mona G Flores , Jiang Bian , Yonghui Wu

While Online Learning is growing and becoming widespread, the associated curricula often suffer from a lack of coverage and outdated content. In this regard, a key question is how to dynamically define the topics that must be covered to…

Computers and Society · Computer Science 2024-12-11 Mohammad Moein , Mohammadreza Molavi Hajiagha , Abdolali Faraji , Mohammadreza Tavakoli , Gàbor Kismihòk

Instruction tuning enables language models to more effectively generalize and better follow user intent. However, obtaining instruction data is costly and challenging. Prior work employs methods such as expensive human annotation,…

Computation and Language · Computer Science 2024-10-04 Abdullatif Köksal , Timo Schick , Anna Korhonen , Hinrich Schütze

Despite the recent broad adoption of Large Language Models (LLMs) across various domains, their potential for enriching information systems in extracting and exploring Linked Data (LD) and Resource Description Framework (RDF) triplestores…

Information Retrieval · Computer Science 2024-09-25 Omar Mussa , Omer Rana , Benoît Goossens , Pablo Orozco-Terwengel , Charith Perera

Temporal Logic (TL) can be used to rigorously specify complex high-level specification for systems in many engineering applications. The translation between natural language (NL) and TL has been under-explored due to the lack of dataset and…

Computation and Language · Computer Science 2024-03-25 Yongchao Chen , Rujul Gandhi , Yang Zhang , Chuchu Fan

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

Reasoning Large Language Models (LLMs) have shown promising results when tasked with solving complex problems. In this paper, we propose and evaluate a multi-stage workflow that leverages the capabilities of fine-tuned reasoning LLMs to…

Computation and Language · Computer Science 2026-01-13 Alberto Purpura , Emily Chen , Swapnil Shinde

Instruction tuning of open-source large language models (LLMs) like LLaMA, using direct outputs from more powerful LLMs such as Instruct-GPT and GPT-4, has proven to be a cost-effective way to align model behaviors with human preferences.…

Computation and Language · Computer Science 2023-10-23 Haoran Li , Yiran Liu , Xingxing Zhang , Wei Lu , Furu Wei

We present a novel visual instruction tuning strategy to improve the zero-shot task generalization of multimodal large language models by building a firm text-only knowledge base. Existing work lacks sufficient experimentation on the…

Computation and Language · Computer Science 2025-07-01 Jianhong Tu , Zhuohao Ni , Nicholas Crispino , Zihao Yu , Michael Bendersky , Beliz Gunel , Ruoxi Jia , Xin Liu , Lingjuan Lyu , Dawn Song , Chenguang Wang