English
Related papers

Related papers: Aligning What LLMs Do and Say: Towards Self-Consis…

200 papers

Multilingual large-scale Pretrained Language Models (PLMs) have been shown to store considerable amounts of factual knowledge, but large variations are observed across languages. With the ultimate goal of ensuring that users with different…

Computation and Language · Computer Science 2025-05-20 Jirui Qi , Raquel Fernández , Arianna Bisazza

Large language models (LLMs) are deployed in a wide variety of user-facing applications. Typically, these deployments have some specific purpose, like answering questions grounded on documentation or acting as coding assistants, but they…

Computation and Language · Computer Science 2025-11-14 David Yunis , Siyu Huo , Chulaka Gunasekara , Danish Contractor

Alignment with human preferences is an important evaluation aspect of LLMs, requiring them to be helpful, honest, safe, and to precisely follow human instructions. Evaluating large language models' (LLMs) alignment typically involves…

Computation and Language · Computer Science 2025-11-26 Yixin Liu , Pengfei Liu , Arman Cohan

Large Language Models (LLMs) have demonstrated promising capabilities as automatic evaluators in assessing the quality of generated natural language. However, LLMs still exhibit biases in evaluation and often struggle to generate coherent…

Computation and Language · Computer Science 2025-01-20 Yinhong Liu , Han Zhou , Zhijiang Guo , Ehsan Shareghi , Ivan Vulić , Anna Korhonen , Nigel Collier

Test-time scaling has proven effective in further enhancing the performance of pretrained Large Language Models (LLMs). However, mainstream post-training methods (i.e., reinforcement learning (RL) with chain-of-thought (CoT) reasoning)…

Machine Learning · Computer Science 2025-08-19 Yuyang Xu , Yi Cheng , Haochao Ying , Zhuoyun Du , Renjun Hu , Xing Shi , Wei Lin , Jian Wu

Large Language Models (LLMs) are extensively used today across various sectors, including academia, research, business, and finance, for tasks such as text generation, summarization, and translation. Despite their widespread adoption, these…

Computation and Language · Computer Science 2024-04-26 Yash Saxena , Sarthak Chopra , Arunendra Mani Tripathi

As Large Language Models (LLMs) become deeply integrated into human life and increasingly influence decision-making, it's crucial to evaluate whether and to what extent they exhibit subjective preferences, opinions, and beliefs. These…

Artificial Intelligence · Computer Science 2025-05-27 George Kour , Itay Nakash , Ateret Anaby-Tavor , Michal Shmueli-Scheuer

Recent advances in large language models have highlighted their potential for personalized recommendation, where accurately capturing user preferences remains a key challenge. Leveraging their strong reasoning and generalization…

Automatic evaluation by large language models (LLMs) is a prominent topic today; however, judgment and evaluation tasks are often subjective and influenced by various factors, making adaptation challenging. While many studies demonstrate…

Computation and Language · Computer Science 2024-12-11 Javad Seraj , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi

Large Language Models (LLMs) are typically aligned with human values using preference data or predefined principles such as helpfulness, honesty, and harmlessness. However, as AI systems progress toward Artificial General Intelligence (AGI)…

Computation and Language · Computer Science 2025-12-08 Panatchakorn Anantaprayoon , Nataliia Babina , Jad Tarifi , Nima Asgharbeygi

Stated preference (SP) surveys are a key method to research how individuals make trade-offs in hypothetical, also futuristic, scenarios. In energy context this includes key decarbonisation enablement contexts, such as low-carbon…

Computation and Language · Computer Science 2025-08-25 Han Wang , Jacek Pawlak , Aruna Sivakumar

Existing alignment techniques for Large Language Models (LLMs), such as Direct Preference Optimization (DPO), typically treat the model as a monolithic entity, applying uniform optimization pressure across all layers. This approach…

Computation and Language · Computer Science 2025-10-15 Yukun Zhang , Qi Dong

Large Language Models (LLMs) and Large Reasoning Models (LRMs) are increasingly used for critical tasks, yet they provide no guarantees about the correctness of their solutions. Users must decide whether to trust the model's answer, aided…

Human-Computer Interaction · Computer Science 2026-05-19 Vardhan Palod , Upasana Biswas , Subbarao Kambhampati

Self-generated counterfactual explanations (SCEs) are minimally modified inputs (minimality) generated by large language models (LLMs) that flip their own predictions (validity), offering a causally grounded approach to unraveling black-box…

Computation and Language · Computer Science 2026-05-13 Yilong Wang , Qianli Wang , Bohao Chu , Yihong Liu , Jing Yang , Simon Ostermann

Comparative reasoning plays a crucial role in text preference prediction; however, large language models (LLMs) often demonstrate inconsistencies in their reasoning. While approaches like Chain-of-Thought improve accuracy in many other…

Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinical data. While large language models (LLMs) have shown strong performance in biomedical NLP,…

Computation and Language · Computer Science 2025-10-21 Raghu Vamshi Hemadri , Geetha Krishna Guruju , Kristi Topollai , Anna Ewa Choromanska

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

Artificial Intelligence · Computer Science 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

Explainable recommender systems are designed to elucidate the explanation behind each recommendation, enabling users to comprehend the underlying logic. Previous works perform rating prediction and explanation generation in a multi-task…

Information Retrieval · Computer Science 2025-04-09 Shijie Liu , Ruixing Ding , Weihai Lu , Jun Wang , Mo Yu , Xiaoming Shi , Wei Zhang

We have only limited understanding of how and why large language models (LLMs) respond in the ways that they do. Their neural networks have proven challenging to interpret, and we are only beginning to tease out the function of individual…

Computation and Language · Computer Science 2025-11-12 Dillon Plunkett , Adam Morris , Keerthi Reddy , Jorge Morales

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and…

Computation and Language · Computer Science 2026-04-20 Venkata Abhinandan Kancharla