English
Related papers

Related papers: Knowledgeable Preference Alignment for LLMs in Dom…

200 papers

Large Language Models (LLMs) have shown the impressive capability of answering questions in a wide range of scenarios. However, when LLMs face different types of questions, it is worth exploring whether LLMs are aware that some questions…

Computation and Language · Computer Science 2024-10-02 Dongjie Yang , Hai Zhao

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge…

LLMs are increasingly used to make or support high-stakes decisions under uncertainty, where alignment depends not only on factual accuracy but on how models weigh tradeoffs between different outcomes. We present an empirical pipeline for…

Machine Learning · Computer Science 2026-05-12 Khurram Yamin , Jingjing Tang , Eric Horvitz , Bryan Wilder

Recent studies have explored integrating large language models (LLMs) into recommendation systems but face several challenges, including training-induced bias and bottlenecks from serialized architecture. To effectively address these…

Information Retrieval · Computer Science 2025-09-16 Donghee Han , Hwanjun Song , Mun Yong Yi

Alignment with human preferences is an important evaluation aspect of LLMs, requiring them to be helpful, honest, safe, and to precisely follow human instructions. Evaluating large language models' (LLMs) alignment typically involves…

Computation and Language · Computer Science 2025-11-26 Yixin Liu , Pengfei Liu , Arman Cohan

Large Language Models (LLMs) have demonstrated remarkable adaptability, showcasing their capacity to excel in tasks for which they were not explicitly trained. However, despite their impressive natural language processing (NLP)…

Computation and Language · Computer Science 2023-09-08 Supun Manathunga , Isuru Hettigoda

Large language models (LLMs) enable in-context learning (ICL) by conditioning on a few labeled training examples as a text-based prompt, eliminating the need for parameter updates and achieving competitive performance. In this paper, we…

Computation and Language · Computer Science 2024-04-02 Jianing Wang , Chengyu Wang , Chuanqi Tan , Jun Huang , Ming Gao

Question-answering for domain-specific applications has recently attracted much interest due to the latest advancements in large language models (LLMs). However, accurately assessing the performance of these applications remains a…

The scarcity of high-quality multimodal biomedical data limits the ability to effectively fine-tune pretrained Large Language Models (LLMs) for specialized biomedical tasks. To address this challenge, we introduce MINT (Multimodal…

Quantitative Methods · Quantitative Biology 2026-02-18 Zhanliang Wang , Da Wu , Quan Nguyen , Zhuoran Xu , Kai Wang

Large Language Models (LLMs) have demonstrated efficacy in various linguistic applications, including question answering and controlled text generation. However, studies into their ability to switch between opposite styles of responses in…

Computation and Language · Computer Science 2024-12-13 Chang Zong , Yuyan Chen , Weiming Lu , Jian Shao , Yongfeng Huang , Heng Chang , Yueting Zhuang

Large Language Models (LLMs) have demonstrated remarkable potential in automating software development tasks. While recent advances leverage Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO) to align models with human…

Software Engineering · Computer Science 2025-12-09 Xin Yin , Chao Ni , Xiaohu Yang

This paper investigates the capabilities of Large Language Models (LLMs) in the context of understanding their knowledge and uncertainty over questions. Specifically, we focus on addressing known-unknown questions, characterized by high…

Computation and Language · Computer Science 2024-07-03 Alfonso Amayuelas , Kyle Wong , Liangming Pan , Wenhu Chen , William Wang

Large Language Models (LLMs) excel at producing broadly relevant text, but this generality becomes a limitation when user-specific preferences are required, such as recommending restaurants or planning travel. In these scenarios, users…

Machine Learning · Computer Science 2025-10-21 Ioannis Tsaknakis , Bingqing Song , Shuyu Gan , Dongyeop Kang , Alfredo Garcia , Gaowen Liu , Charles Fleming , Mingyi Hong

Personalization of Large Language Models (LLMs) often assumes users hold static preferences that reflect globally in all tasks. In reality, humans hold dynamic preferences that change depending on the context. As users interact with an LLM…

Computation and Language · Computer Science 2025-08-08 Tae Soo Kim , Yoonjoo Lee , Yoonah Park , Jiho Kim , Young-Ho Kim , Juho Kim

For aligning large language models (LLMs), prior work has leveraged reinforcement learning via human feedback (RLHF) or variations of direct preference optimization (DPO). While DPO offers a simpler framework based on maximum likelihood…

Artificial Intelligence · Computer Science 2025-05-27 Anirudhan Badrinath , Prabhat Agarwal , Jiajing Xu

Aligning language models to human expectations, e.g., being helpful and harmless, has become a pressing challenge for large language models. A typical alignment procedure consists of supervised fine-tuning and preference learning. Most…

Machine Learning · Computer Science 2024-02-27 Tianchi Cai , Xierui Song , Jiyan Jiang , Fei Teng , Jinjie Gu , Guannan Zhang

Trained on vast corpora, Large Language Models (LLMs) have the potential to encode visualization design knowledge and best practices. However, if they fail to do so, they might provide unreliable visualization recommendations. What…

Human-Computer Interaction · Computer Science 2024-10-22 Huichen Will Wang , Mitchell Gordon , Leilani Battle , Jeffrey Heer

In aligning large language models (LLMs), utilizing feedback from existing advanced AI rather than humans is an important method to scale supervisory signals. However, it is highly challenging for AI to understand human intentions and…

Computation and Language · Computer Science 2024-06-18 Rong Bao , Rui Zheng , Shihan Dou , Xiao Wang , Enyu Zhou , Bo Wang , Qi Zhang , Liang Ding , Dacheng Tao

Large Language Models (LLMs) often require domain-specific fine-tuning to address targeted tasks, which risks degrading their general capabilities. Maintaining a balance between domain-specific enhancements and general model utility is a…

Computation and Language · Computer Science 2025-06-05 Jun Rao , Zepeng Lin , Xuebo Liu , Xiaopeng Ke , Lian Lian , Dong Jin , Shengjun Cheng , Jun Yu , Min Zhang

In order for large language model (LLM)-based assistants to effectively adapt to evolving information needs, it must be possible to update their factual knowledge through continued training on new data. The standard recipe for doing so…

Computation and Language · Computer Science 2024-05-28 Zhengbao Jiang , Zhiqing Sun , Weijia Shi , Pedro Rodriguez , Chunting Zhou , Graham Neubig , Xi Victoria Lin , Wen-tau Yih , Srinivasan Iyer