English
Related papers

Related papers: Calibrating LLMs with Preference Optimization on T…

200 papers

Recently, test-time scaling has garnered significant attention from the research community, largely due to the substantial advancements of the o1 model released by OpenAI. By allocating more computational resources during the inference…

The use of machine learning (ML) models to assess and score textual data has become increasingly pervasive in an array of contexts including natural language processing, information retrieval, search and recommendation, and credibility…

Computation and Language · Computer Science 2023-09-27 Marialena Bevilacqua , Kezia Oketch , Ruiyang Qin , Will Stamey , Xinyuan Zhang , Yi Gan , Kai Yang , Ahmed Abbasi

We introduce SATBench, a benchmark for evaluating the logical reasoning capabilities of large language models (LLMs) through logical puzzles derived from Boolean satisfiability (SAT) problems. Unlike prior work that focuses on inference…

Artificial Intelligence · Computer Science 2025-09-23 Anjiang Wei , Yuheng Wu , Yingjia Wan , Tarun Suresh , Huanmi Tan , Zhanke Zhou , Sanmi Koyejo , Ke Wang , Alex Aiken

A common technique for aligning large language models (LLMs) relies on acquiring human preferences by comparing multiple generations conditioned on a fixed context. This method, however, relies solely on pairwise comparisons, where the…

Computation and Language · Computer Science 2025-01-09 Hritik Bansal , Ashima Suvarna , Gantavya Bhatt , Nanyun Peng , Kai-Wei Chang , Aditya Grover

The recent development of chain-of-thought (CoT) decoding has enabled large language models (LLMs) to generate explicit logical reasoning paths for complex problem-solving. However, research indicates that these paths are not always…

Computation and Language · Computer Science 2024-11-01 Xuan Zhang , Chao Du , Tianyu Pang , Qian Liu , Wei Gao , Min Lin

Presupposition projection in conditionals is central to theories of meaning and pragmatics, yet it remains largely unevaluated in large language models. We address this gap through a parallel behavioral study comparing human judgments and…

Computation and Language · Computer Science 2026-05-19 Tara Azin , Yongan Yu , Raj Singh , Olessia Jouravlev

Training large reasoning models (LRMs) with reinforcement learning in STEM domains is hindered by the scarcity of high-quality, diverse, and verifiable problem sets. Existing synthesis methods, such as Chain-of-Thought prompting, often…

Artificial Intelligence · Computer Science 2025-05-27 Xiong Jun Wu , Zhenduo Zhang , ZuJie Wen , Zhiqiang Zhang , Wang Ren , Lei Shi , Cai Chen , Deng Zhao , Qing Wang , Xudong Han , Chengfu Tang , Dingnan Jin , Qing Cui , Jun Zhou

Achieving human-like reasoning capabilities in Multimodal Large Language Models (MLLMs) has long been a goal. Current methods primarily focus on synthesizing positive rationales, typically relying on manual annotations or complex systems.…

Computation and Language · Computer Science 2025-07-29 Wentao Tan , Qiong Cao , Yibing Zhan , Chao Xue , Changxing Ding

With the recent progress of Large Language Models (LLMs), there is a growing interest in applying these models to solve complex and challenging problems. Modern LLMs, capable of processing long contexts and generating verbalized…

Computation and Language · Computer Science 2026-04-14 WonJin Yoon , Kangyu Zhu , Ian Bulovic , Autumn Sehy , Yanjun Gao , Dmitriy Dligach , Majid Afshar , Timothy A. Miller

Large language models are often ranked according to their level of alignment with human preferences -- a model is better than other models if its outputs are more frequently preferred by humans. One of the popular ways to elicit human…

Machine Learning · Computer Science 2024-12-05 Ivi Chatzi , Eleni Straitouri , Suhas Thejaswi , Manuel Gomez Rodriguez

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

This paper presents ReasoningRec, a reasoning-based recommendation framework that leverages Large Language Models (LLMs) to bridge the gap between recommendations and human-interpretable explanations. In contrast to conventional…

Information Retrieval · Computer Science 2024-10-31 Millennium Bismay , Xiangjue Dong , James Caverlee

Alignment algorithms are widely used to align large language models (LLMs) to human users based on preference annotations. Typically these (often divergent) preferences are aggregated over a diverse set of users, resulting in fine-tuned…

Computation and Language · Computer Science 2025-05-21 Cristina Garbacea , Chenhao Tan

For researchers leveraging Large-Language Models (LLMs) in the generation of training datasets, especially for conversational recommender systems - the absence of robust evaluation frameworks has been a long-standing problem. The efficiency…

Computation and Language · Computer Science 2022-12-19 Harsh Lara , Manoj Tiwari

In modern search systems, search engines often suggest relevant queries to users through various panels or components, helping refine their information needs. Traditionally, these recommendations heavily rely on historical search logs to…

Information Retrieval · Computer Science 2025-07-08 Erxue Min , Hsiu-Yuan Huang , Xihong Yang , Min Yang , Xin Jia , Yunfang Wu , Hengyi Cai , Junfeng Wang , Shuaiqiang Wang , Dawei Yin

Recent advancements have showcased the potential of Large Language Models (LLMs) in executing reasoning tasks, particularly facilitated by Chain-of-Thought (CoT) prompting. While tasks like arithmetic reasoning involve clear, definitive…

Information Retrieval · Computer Science 2024-08-05 Alicia Y. Tsai , Adam Kraft , Long Jin , Chenwei Cai , Anahita Hosseini , Taibai Xu , Zemin Zhang , Lichan Hong , Ed H. Chi , Xinyang Yi

Existing automated essay scoring (AES) has solely relied on essay text without using explanatory rationales for the scores, thereby forgoing an opportunity to capture the specific aspects evaluated by rubric indicators in a fine-grained…

Computation and Language · Computer Science 2025-02-06 SeongYeub Chu , JongWoo Kim , Bryan Wong , MunYong Yi

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however,…

Computation and Language · Computer Science 2024-09-04 Zhuo Li , Yuhao Du , Jinpeng Hu , Xiang Wan , Anningzhe Gao

Recent advancements in large language models (LLMs) have sparked considerable interest in automated theorem proving and a prominent line of research integrates stepwise LLM-based provers into tree search. In this paper, we introduce a novel…

Artificial Intelligence · Computer Science 2025-05-20 Junyu Lai , Jiakun Zhang , Shuo Xu , Taolue Chen , Zihang Wang , Yao Yang , Jiarui Zhang , Chun Cao , Jingwei Xu