中文
相关论文

相关论文: Inference-Time Policy Adapters (IPA): Tailoring Ex…

200 篇论文

Adapting LLMs to specific stylistic characteristics, like brand voice or authorial tones, is crucial for enterprise communication but challenging to achieve from corpora which lacks instruction-response formatting without compromising…

计算与语言 · 计算机科学 2025-07-25 Pritika Ramu , Apoorv Saxena , Meghanath M Y , Varsha Sankar , Debraj Basu

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and research teams with limited GPU resources from engaging with…

机器学习 · 计算机科学 2025-08-26 Daniel Frees , Aditri Bhagirath , Moritz Bolling

Pre-trained Language Models (PLMs) have achieved remarkable performance for various language understanding tasks in IR systems, which require the fine-tuning process based on labeled training data. For low-resource scenarios, prompt-based…

计算与语言 · 计算机科学 2022-04-04 Ziyun Xu , Chengyu Wang , Minghui Qiu , Fuli Luo , Runxin Xu , Songfang Huang , Jun Huang

We propose an iterative programmatic planning (IPP) framework for solving grid-based tasks by synthesizing interpretable agent policies expressed in code using large language models (LLMs). Instead of relying on traditional search or…

人工智能 · 计算机科学 2025-05-19 Ashwath Vaithinathan Aravindan , Zhisheng Tang , Mayank Kejriwal

GPT-5, a state of the art large language model from OpenAI, demonstrates strong performance in widely used programming languages such as Python, C++, and Java; however, its ability to operate in low resource or less commonly used languages…

编程语言 · 计算机科学 2026-02-13 Minda Li , Bhaskar Krishnamachari

Fine-tuning large language models (LLMs) on downstream tasks requires substantial computational resources. Selective PEFT, a class of parameter-efficient fine-tuning (PEFT) methodologies, aims to mitigate these computational challenges by…

计算与语言 · 计算机科学 2025-06-24 Aradhye Agarwal , Suhas K Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Large language models (LLMs) such as GPT-3 and GPT-4 are powerful but their weights are often publicly unavailable and their immense sizes make the models difficult to be tuned with common hardware. As a result, effectively tuning these…

计算与语言 · 计算机科学 2023-05-16 Canwen Xu , Yichong Xu , Shuohang Wang , Yang Liu , Chenguang Zhu , Julian McAuley

This paper presents a novel method for utilizing fine-tuned Large Language Models (LLMs) to minimize data requirements in load profile analysis, demonstrated through the restoration of missing data in power system load profiles. A two-stage…

机器学习 · 计算机科学 2024-06-05 Yi Hu , Hyeonjin Kim , Kai Ye , Ning Lu

Large Language Models (LLMs) have improved substantially alignment, yet their behavior remains highly sensitive to prompt phrasing. This brittleness has motivated automated prompt engineering, but most existing methods (i) require a…

计算与语言 · 计算机科学 2026-03-05 Bartosz Dziuba , Kacper Kuchta , Paweł Batorski , Przemysław Spurek , Paul Swoboda

Large Language Models (LLMs) have shown extraordinary success across various text generation tasks; however, their potential for simple yet essential text classification remains underexplored, as LLM pre-training tends to emphasize…

计算与语言 · 计算机科学 2025-10-02 Zhexiong Liu , Diane Litman

Advancing large language models (LLMs) for the next point-of-interest (POI) recommendation task faces two fundamental challenges: (i) although existing methods produce semantic IDs that incorporate semantic information, their topology-blind…

信息检索 · 计算机科学 2026-03-13 Peibo Li , Shuang Ao , Hao Xue , Yang Song , Maarten de Rijke , Johan Barthélemy , Tomasz Bednarz , Flora D. Salim

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

计算与语言 · 计算机科学 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

Lightweight language models remain attractive for on-device and privacy-sensitive applications, but their responses are highly sensitive to prompt quality. For open-ended generation, non-expert users often lack the knowledge or time to…

计算与语言 · 计算机科学 2025-12-01 Yizhou Xu , Janet Davis

Personalizing jargon detection and explanation is essential for making technical documents accessible to readers with diverse disciplinary backgrounds. However, tailoring models to individual users typically requires substantial annotation…

计算与语言 · 计算机科学 2025-10-14 Bohao Wu , Qingyun Wang , Yue Guo

We investigate the extent to which contemporary Large Language Models (LLMs) can engage in exploration, a core capability in reinforcement learning and decision making. We focus on native performance of existing LLMs, without training…

机器学习 · 计算机科学 2024-10-30 Akshay Krishnamurthy , Keegan Harris , Dylan J. Foster , Cyril Zhang , Aleksandrs Slivkins

Large language models (LLMs) are often trained on extensive, temporally indiscriminate text corpora, reflecting the lack of datasets with temporal metadata. This approach is not aligned with the evolving nature of language. Conventional…

计算与语言 · 计算机科学 2024-04-30 Felix Drinkall , Eghbal Rahimikia , Janet B. Pierrehumbert , Stefan Zohren

Instruction tuning (IT) is crucial to tailoring large language models (LLMs) towards human-centric interactions. Recent advancements have shown that the careful selection of a small, high-quality subset of IT data can significantly enhance…

计算与语言 · 计算机科学 2025-01-16 Liangxin Liu , Xuebo Liu , Derek F. Wong , Dongfang Li , Ziyi Wang , Baotian Hu , Min Zhang

This study introduces GPTA, a Large Language Model assistance training framework, that enhances the training of downstream task models via prefix prompt. By minimizing data exposure to LLM, the framework addresses the security and legal…

计算与语言 · 计算机科学 2024-04-02 Xiao Liu , Jiawei Zhang

The increasingly large size of modern pretrained language models not only makes them inherit more human-like biases from the training corpora, but also makes it computationally expensive to mitigate such biases. In this paper, we…

计算与语言 · 计算机科学 2023-06-08 Zhongbin Xie , Thomas Lukasiewicz

Generative pre-trained transformer (GPT) models have revolutionized the field of natural language processing (NLP) with remarkable performance in various tasks and also extend their power to multimodal domains. Despite their success, large…

计算与语言 · 计算机科学 2023-08-29 Kaiyuan Gao , Sunan He , Zhenyu He , Jiacheng Lin , QiZhi Pei , Jie Shao , Wei Zhang