English
Related papers

Related papers: Inference-Time Policy Adapters (IPA): Tailoring Ex…

200 papers

Adapting LLMs to specific stylistic characteristics, like brand voice or authorial tones, is crucial for enterprise communication but challenging to achieve from corpora which lacks instruction-response formatting without compromising…

Computation and Language · Computer Science 2025-07-25 Pritika Ramu , Apoorv Saxena , Meghanath M Y , Varsha Sankar , Debraj Basu

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and research teams with limited GPU resources from engaging with…

Machine Learning · Computer Science 2025-08-26 Daniel Frees , Aditri Bhagirath , Moritz Bolling

Pre-trained Language Models (PLMs) have achieved remarkable performance for various language understanding tasks in IR systems, which require the fine-tuning process based on labeled training data. For low-resource scenarios, prompt-based…

Computation and Language · Computer Science 2022-04-04 Ziyun Xu , Chengyu Wang , Minghui Qiu , Fuli Luo , Runxin Xu , Songfang Huang , Jun Huang

We propose an iterative programmatic planning (IPP) framework for solving grid-based tasks by synthesizing interpretable agent policies expressed in code using large language models (LLMs). Instead of relying on traditional search or…

Artificial Intelligence · Computer Science 2025-05-19 Ashwath Vaithinathan Aravindan , Zhisheng Tang , Mayank Kejriwal

GPT-5, a state of the art large language model from OpenAI, demonstrates strong performance in widely used programming languages such as Python, C++, and Java; however, its ability to operate in low resource or less commonly used languages…

Programming Languages · Computer Science 2026-02-13 Minda Li , Bhaskar Krishnamachari

Fine-tuning large language models (LLMs) on downstream tasks requires substantial computational resources. Selective PEFT, a class of parameter-efficient fine-tuning (PEFT) methodologies, aims to mitigate these computational challenges by…

Computation and Language · Computer Science 2025-06-24 Aradhye Agarwal , Suhas K Ramesh , Ayan Sengupta , Tanmoy Chakraborty

Large language models (LLMs) such as GPT-3 and GPT-4 are powerful but their weights are often publicly unavailable and their immense sizes make the models difficult to be tuned with common hardware. As a result, effectively tuning these…

Computation and Language · Computer Science 2023-05-16 Canwen Xu , Yichong Xu , Shuohang Wang , Yang Liu , Chenguang Zhu , Julian McAuley

This paper presents a novel method for utilizing fine-tuned Large Language Models (LLMs) to minimize data requirements in load profile analysis, demonstrated through the restoration of missing data in power system load profiles. A two-stage…

Machine Learning · Computer Science 2024-06-05 Yi Hu , Hyeonjin Kim , Kai Ye , Ning Lu

Large Language Models (LLMs) have improved substantially alignment, yet their behavior remains highly sensitive to prompt phrasing. This brittleness has motivated automated prompt engineering, but most existing methods (i) require a…

Computation and Language · Computer Science 2026-03-05 Bartosz Dziuba , Kacper Kuchta , Paweł Batorski , Przemysław Spurek , Paul Swoboda

Large Language Models (LLMs) have shown extraordinary success across various text generation tasks; however, their potential for simple yet essential text classification remains underexplored, as LLM pre-training tends to emphasize…

Computation and Language · Computer Science 2025-10-02 Zhexiong Liu , Diane Litman

Advancing large language models (LLMs) for the next point-of-interest (POI) recommendation task faces two fundamental challenges: (i) although existing methods produce semantic IDs that incorporate semantic information, their topology-blind…

Information Retrieval · Computer Science 2026-03-13 Peibo Li , Shuang Ao , Hao Xue , Yang Song , Maarten de Rijke , Johan Barthélemy , Tomasz Bednarz , Flora D. Salim

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

Computation and Language · Computer Science 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

Lightweight language models remain attractive for on-device and privacy-sensitive applications, but their responses are highly sensitive to prompt quality. For open-ended generation, non-expert users often lack the knowledge or time to…

Computation and Language · Computer Science 2025-12-01 Yizhou Xu , Janet Davis

Personalizing jargon detection and explanation is essential for making technical documents accessible to readers with diverse disciplinary backgrounds. However, tailoring models to individual users typically requires substantial annotation…

Computation and Language · Computer Science 2025-10-14 Bohao Wu , Qingyun Wang , Yue Guo

We investigate the extent to which contemporary Large Language Models (LLMs) can engage in exploration, a core capability in reinforcement learning and decision making. We focus on native performance of existing LLMs, without training…

Machine Learning · Computer Science 2024-10-30 Akshay Krishnamurthy , Keegan Harris , Dylan J. Foster , Cyril Zhang , Aleksandrs Slivkins

Large language models (LLMs) are often trained on extensive, temporally indiscriminate text corpora, reflecting the lack of datasets with temporal metadata. This approach is not aligned with the evolving nature of language. Conventional…

Computation and Language · Computer Science 2024-04-30 Felix Drinkall , Eghbal Rahimikia , Janet B. Pierrehumbert , Stefan Zohren

Instruction tuning (IT) is crucial to tailoring large language models (LLMs) towards human-centric interactions. Recent advancements have shown that the careful selection of a small, high-quality subset of IT data can significantly enhance…

Computation and Language · Computer Science 2025-01-16 Liangxin Liu , Xuebo Liu , Derek F. Wong , Dongfang Li , Ziyi Wang , Baotian Hu , Min Zhang

This study introduces GPTA, a Large Language Model assistance training framework, that enhances the training of downstream task models via prefix prompt. By minimizing data exposure to LLM, the framework addresses the security and legal…

Computation and Language · Computer Science 2024-04-02 Xiao Liu , Jiawei Zhang

The increasingly large size of modern pretrained language models not only makes them inherit more human-like biases from the training corpora, but also makes it computationally expensive to mitigate such biases. In this paper, we…

Computation and Language · Computer Science 2023-06-08 Zhongbin Xie , Thomas Lukasiewicz

Generative pre-trained transformer (GPT) models have revolutionized the field of natural language processing (NLP) with remarkable performance in various tasks and also extend their power to multimodal domains. Despite their success, large…

Computation and Language · Computer Science 2023-08-29 Kaiyuan Gao , Sunan He , Zhenyu He , Jiacheng Lin , QiZhi Pei , Jie Shao , Wei Zhang