中文
相关论文

相关论文: SylloBio-NLI: Evaluating Large Language Models on …

200 篇论文

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

人工智能 · 计算机科学 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

Large language models (LLMs) are a class of language models that have demonstrated outstanding performance across a range of natural language processing (NLP) tasks and have become a highly sought-after research area, because of their…

数字图书馆 · 计算机科学 2023-04-06 Lizhou Fan , Lingyao Li , Zihui Ma , Sanggyu Lee , Huizi Yu , Libby Hemphill

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

计算与语言 · 计算机科学 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

The use of generative artificial intelligence (AI) models is becoming ubiquitous in many fields. Though progress continues to be made, general purpose large language AI models (LLM) show a tendency to deliver creative answers, often called…

Large Language Models (LLMs) have shown promise in various domains, including healthcare, with significant potential to transform mental health applications by enabling scalable and accessible solutions. This study aims to provide a…

人工智能 · 计算机科学 2025-11-25 Abdelrahman Hanafi , Mohammed Saad , Noureldin Zahran , Radwa J. Hanafy , Mohammed E. Fouda

In this article, we explore the shallow heuristics used by transformer-based pre-trained language models (PLMs) that are fine-tuned for natural language inference (NLI). To do so, we construct or own dataset based on syllogistic, and we…

计算与语言 · 计算机科学 2022-01-20 Reto Gubelmann , Siegfried Handschuh

Multimodal large language models (LLMs) are increasingly explored as automated evaluators in clinical settings, yet their scoring behavior on ordinal clinical scales remains poorly understood. We benchmark three frontier LLM families…

Logical reasoning, i.e., deductively inferring the truth value of a conclusion from a set of premises, is an important task for artificial intelligence with wide potential impacts on science, mathematics, and society. While many…

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

人工智能 · 计算机科学 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

The introduction of Large Language Models (LLMs) has significantly impacted various fields, including education, for example, by enabling the creation of personalized learning materials. However, their use in Systematic Reviews (SRs)…

计算机与社会 · 计算机科学 2025-03-04 Vedant Khandelwal , Kaushik Roy , Valerie Lookingbill , Ritvik Garimella , Harshul Surana , Heather Heckman , Amit Sheth

In this paper, we demonstrate a surprising capability of large language models (LLMs): given only input feature names and a description of a prediction task, they are capable of selecting the most predictive features, with performance…

机器学习 · 计算机科学 2025-04-21 Daniel P. Jeong , Zachary C. Lipton , Pradeep Ravikumar

Large Language Models (LLMs) excel in complex reasoning tasks but struggle with consistent rule application, exception handling, and explainability, particularly in domains like legal analysis that require both natural language…

人工智能 · 计算机科学 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

Large language models (LLMs) struggle with formal domains that require rigorous logical deduction and symbolic reasoning, such as mathematical proof generation. We propose a neuro-symbolic approach that combines LLMs' generative strengths…

人工智能 · 计算机科学 2026-05-26 Oren Sultan , Eitan Stern , Dafna Shahaf

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating methodological…

计算与语言 · 计算机科学 2025-10-14 Wenqing Zhang , Trang Nguyen , Elizabeth A. Stuart , Yiqun T. Chen

Large language models (LLMs) show promise in medical diagnosis, but real-world deployment remains challenging due to high-stakes clinical decisions and imperfect reasoning reliability. As a result, careful inspection of model behavior is…

计算与语言 · 计算机科学 2026-04-28 Yurui Xiang , Xingyi Mao , Rui Sheng , Zixin Chen , Zelin Zang , Yuyang Wu , Haipeng Zeng , Huamin Qu , Yushi Sun , Yanna Lin

In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our…

计算与语言 · 计算机科学 2025-12-30 Navid Asgari , Benjamin M. Cole

Phenotype-driven gene prioritization is a critical process in the diagnosis of rare genetic disorders for identifying and ranking potential disease-causing genes based on observed physical traits or phenotypes. While traditional approaches…

定量方法 · 定量生物学 2024-04-04 Junyoung Kim , Jingye Yang , Kai Wang , Chunhua Weng , Cong Liu

Recent developments in large language models (LLMs) have shown promise in enhancing the capabilities of natural language processing (NLP). Despite these successes, there remains a dearth of research dedicated to the NLP problem-solving…

计算与语言 · 计算机科学 2023-10-20 Linxin Song , Jieyu Zhang , Lechao Cheng , Pengyuan Zhou , Tianyi Zhou , Irene Li

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

信息检索 · 计算机科学 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka