中文
相关论文

相关论文: Instruction Distillation Makes Large Language Mode…

200 篇论文

We introduce a state-of-the-art approach for URL categorization that leverages the power of Large Language Models (LLMs) to address the primary objectives of web content filtering: safeguarding organizations from legal and ethical risks,…

机器学习 · 计算机科学 2023-05-11 Tamás Vörös , Sean Paul Bergeron , Konstantin Berlin

We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the…

计算与语言 · 计算机科学 2023-11-23 Inderjeet Nair , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami

In real-world NLP applications, Large Language Models (LLMs) offer promising solutions due to their extensive training on vast datasets. However, the large size and high computation demands of LLMs limit their practicality in many…

人工智能 · 计算机科学 2025-04-01 Juanhui Li , Sreyashi Nag , Hui Liu , Xianfeng Tang , Sheikh Sarwar , Limeng Cui , Hansu Gu , Suhang Wang , Qi He , Jiliang Tang

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

信息检索 · 计算机科学 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevant is document A to…

信息检索 · 计算机科学 2024-04-19 Le Yan , Zhen Qin , Honglei Zhuang , Rolf Jagerman , Xuanhui Wang , Michael Bendersky , Harrie Oosterhuis

Sentence Simplification aims to rephrase complex sentences into simpler sentences while retaining original meaning. Large Language models (LLMs) have demonstrated the ability to perform a variety of natural language processing tasks.…

计算与语言 · 计算机科学 2023-02-24 Yutao Feng , Jipeng Qiang , Yun Li , Yunhao Yuan , Yi Zhu

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output content) and reward…

We propose to utilize an instruction-tuned large language model (LLM) for guiding the text generation process in automatic speech recognition (ASR). Modern large language models (LLMs) are adept at performing various text generation tasks…

音频与语音处理 · 电气工程与系统科学 2025-01-08 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

Software documentation is essential for program comprehension, developer onboarding, code review, and long-term maintenance. Yet producing quality documentation manually is time-consuming and frequently yields incomplete or inconsistent…

软件工程 · 计算机科学 2026-04-20 Afia Farjana , Zaiyu Cheng , Antonio Mastropaolo

Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently…

计算与语言 · 计算机科学 2023-11-29 Utsav Garg , Erhan Bas

Instruction-tuned large language models (IT-LLMs) exhibit strong zero-shot reasoning, yet their ability to execute simple, self-contained instructions remains underexplored, despite this being foundational to complex instruction-following.…

计算与语言 · 计算机科学 2025-10-21 Henry Lim , Kwan Hui Lim

Large-scale vision-language models (VLMs) have shown a strong zero-shot generalization capability on unseen-domain data. However, adapting pre-trained VLMs to a sequence of downstream tasks often leads to the forgetting of previously…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Yu-Chu Yu , Chi-Pin Huang , Jr-Jen Chen , Kai-Po Chang , Yung-Hsuan Lai , Fu-En Yang , Yu-Chiang Frank Wang

Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, transformation, and improvement. In this work, we investigate…

人工智能 · 计算机科学 2024-02-29 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Instruction fine-tuning of large language models (LLMs) often involves selecting a subset of instruction training data from a large candidate pool, using a small query set from the target task. Despite growing interest, the literature on…

机器学习 · 计算机科学 2026-02-17 Nihal V. Nayak , Paula Rodriguez-Diaz , Neha Hulkund , Sara Beery , David Alvarez-Melis

The recommendation of medication is a vital aspect of intelligent healthcare systems, as it involves prescribing the most suitable drugs based on a patient's specific health needs. Unfortunately, many sophisticated models currently in use…

信息检索 · 计算机科学 2025-01-28 Qidong Liu , Xian Wu , Xiangyu Zhao , Yuanshao Zhu , Zijian Zhang , Feng Tian , Yefeng Zheng

Stance classification, the task of predicting the viewpoint of an author on a subject of interest, has long been a focal point of research in domains ranging from social science to machine learning. Current stance detection methods rely…

计算与语言 · 计算机科学 2024-03-07 Iain J. Cruickshank , Lynnette Hui Xian Ng

The application of large language models (LLMs) in recommendation systems has recently gained traction. Traditional recommendation systems often lack explainability and suffer from issues such as popularity bias. Previous research has also…

信息检索 · 计算机科学 2025-12-04 Yaqi Wang , Haojia Sun , Shuting Zhang

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in…

人工智能 · 计算机科学 2023-05-22 Liting Chen , Lu Wang , Hang Dong , Yali Du , Jie Yan , Fangkai Yang , Shuang Li , Pu Zhao , Si Qin , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

计算机与社会 · 计算机科学 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello