English
Related papers

Related papers: From Blind Guess to Informed Judgment: Teaching LL…

200 papers

The discovery of high-performance thermoelectric (TE) materials for advancing green energy harvesting from waste heat is an urgent need in the context of looming energy crisis and climate change. The rapid advancement of machine learning…

Materials Science · Physics 2026-03-26 Shoeb Athar , Philippe Jund

Large Language Model (LLM)-based recommendation systems have demonstrated remarkable capabilities in understanding user preferences and generating personalized suggestions. However, existing approaches face critical challenges in…

Information Retrieval · Computer Science 2026-04-24 Sushant Mehta

Accurately identifying the material composition of objects is a critical capability for AI robots powered by large language models (LLMs) to perform context-aware manipulation. Radar technologies offer a promising sensing modality for…

Signal Processing · Electrical Eng. & Systems 2025-08-06 Jiangyou Zhu , Hongyu Deng , He Chen

Existing LLM-as-a-Judge approaches for evaluating text generation suffer from rating inconsistencies, with low agreement and high rating variance across different evaluator models. We attribute this to subjective evaluation criteria…

Computation and Language · Computer Science 2025-11-04 Yukyung Lee , Joonghoon Kim , Jaehee Kim , Hyowon Cho , Jaewook Kang , Pilsung Kang , Najoung Kim

Multimodal Large Language Models (MLLMs) often struggle with fine-grained perception, such as identifying small objects in high-resolution images or detecting key moments in long videos. Existing methods typically rely on complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sanghwan Kim , Rui Xiao , Stephan Alaniz , Yongqin Xian , Zeynep Akata

The rapid evolution of artificial intelligence in drug discovery encounters challenges with generalization and extensive training, yet Large Language Models (LLMs) offer promise in reshaping interactions with complex molecular data. Our…

Biomolecules · Quantitative Biology 2024-12-20 He Cao , Zijing Liu , Xingyu Lu , Yuan Yao , Yu Li

Reward modeling, crucial for aligning large language models (LLMs) with human preferences, is often bottlenecked by the high cost of preference data. Existing textual data synthesis methods are computationally expensive. We propose a novel…

Computation and Language · Computer Science 2025-10-15 Leitian Tao , Xuefeng Du , Sharon Li

Recent progress in large language models (LLMs) has outpaced the development of effective evaluation methods. Traditional benchmarks rely on task-specific metrics and static datasets, which often suffer from fairness issues, limited…

Computation and Language · Computer Science 2025-05-20 Yuhang Zhou , Xutian Chen , Yixin Cao , Yuchen Ni , Yu He , Siyu Tian , Xiang Liu , Jian Zhang , Chuanjun Ji , Guangnan Ye , Xipeng Qiu

Large Language Model (LLM)-based scientific agents have accelerated scientific discovery, yet they often suffer from significant inefficiencies due to adherence to fixed initial priors. Existing approaches predominantly operate within a…

Machine Learning · Computer Science 2026-02-09 Yingming Pu , Tao Lin , Hongyu Chen

Large language models (LLMs) have emerged as a promising alternative to expensive human evaluations. However, the alignment and coverage of LLM-based evaluations are often limited by the scope and potential bias of the evaluation prompts…

Computation and Language · Computer Science 2024-02-27 Yuxuan Liu , Tianchi Yang , Shaohan Huang , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang

The need to evaluate instructional materials for K-12 science education has become increasingly important, as more educators use generative AI to create instructional materials. However, the review of instructional materials is…

Artificial Intelligence · Computer Science 2026-04-29 Zhaohui Li , Peng He , Zhiyuan Chen , Honglu Liu , Zeyuan Wang , Tingting Li , Jinjun Xiong

Generating user-friendly explanations regarding why an item is recommended has become increasingly common, largely due to advances in language generation technology, which can enhance user trust and facilitate more informed decision-making…

Information Retrieval · Computer Science 2024-01-04 Yucong Luo , Mingyue Cheng , Hao Zhang , Junyu Lu , Qi Liu , Enhong Chen

RLHF has emerged as a predominant approach for aligning artificial intelligence systems with human preferences, demonstrating exceptional and measurable efficacy in instruction following tasks; however, it exhibits insufficient compliance…

Artificial Intelligence · Computer Science 2025-05-20 Ruopei Sun , Jianfeng Cai , Jinhua Zhu , Kangwen Zhao , Dongyun Xue , Wengang Zhou , Li Li , Houqiang Li

Due to an exponential increase in published research articles, it is impossible for individual scientists to read all publications, even within their own research field. In this work, we investigate the use of large language models (LLMs)…

Large Language Models (LLMs) are increasingly used to evaluate information retrieval (IR) systems, generating relevance judgments traditionally made by human assessors. Recent empirical studies suggest that LLM-based evaluations often align…

Information Retrieval · Computer Science 2026-01-21 Laura Dietz , Oleg Zendel , Peter Bailey , Charles Clarke , Ellese Cotterill , Jeff Dalton , Faegheh Hasibi , Mark Sanderson , Nick Craswell

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Traditional evaluation of information retrieval (IR) systems relies on human-annotated relevance labels, which can be both biased and costly at scale. In this context, large language models (LLMs) offer an alternative by allowing us to…

Information Retrieval · Computer Science 2024-10-21 Naghmeh Farzi , Laura Dietz

While hallucinations of large language models could been alleviated through retrieval-augmented generation and citation generation, how the model utilizes internal knowledge is still opaque, and the trustworthiness of its generated answers…

Computation and Language · Computer Science 2025-04-22 Jiajun Shen , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

The potential of Machine Learning Control (MLC) in HVAC systems is hindered by its opaque nature and inference mechanisms, which is challenging for users and modelers to fully comprehend, ultimately leading to a lack of trust in MLC-based…

Artificial Intelligence · Computer Science 2024-11-18 Liang Zhang , Zhelun Chen

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, but often exhibit overconfidence and generate plausible yet incorrect answers. This overconfidence, especially in models undergone…

Computation and Language · Computer Science 2025-12-24 Zeguan Xiao , Diyang Dou , Boya Xiong , Yun Chen , Guanhua Chen