中文
相关论文

相关论文: Scientific Reasoning: Assessment of Multimodal Gen…

200 篇论文

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

计算与语言 · 计算机科学 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

计算与语言 · 计算机科学 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Artificially intelligent (AI) co-scientists must be able to sift through research literature cost-efficiently while applying nuanced scientific reasoning. We evaluate Small Language Models (SLMs, <= 8B parameters) for classifying medical…

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

机器学习 · 计算机科学 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models. Our preliminary results show that, translating the native language context, question and answer into a…

计算与语言 · 计算机科学 2024-02-05 Adar Kahana , Jaya Susan Mathew , Said Bleik , Jeremy Reynolds , Oren Elisha

Large Language Models (LLMs) excel in generating personalized content and facilitating interactive dialogues, showcasing their remarkable aptitude for a myriad of applications. However, their capabilities in reasoning and providing…

计算与语言 · 计算机科学 2024-02-16 Min Zhang , Sato Takumi , Jack Zhang , Jun Wang

Large Language Models (LLMs) have demonstrated potential as effective search relevance evaluators. However, there is a lack of comprehensive guidance on which models consistently perform optimally across various contexts or within specific…

机器学习 · 计算机科学 2024-10-29 Silvia Terragni , Hoang Cuong , Joachim Daiber , Pallavi Gudipati , Pablo N. Mendes

Large Language Models (LLMs), originally developed for natural language processing (NLP), have demonstrated the potential to generalize across modalities and domains. With their in-context learning (ICL) capabilities, LLMs can perform…

人工智能 · 计算机科学 2025-08-26 Nikolaos Pavlidis , Vasilis Perifanis , Symeon Symeonidis , Pavlos S. Efraimidis

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

计算与语言 · 计算机科学 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Large language models (LLMs) offer the potential to simulate human-like responses and behaviors, creating new opportunities for psychological science. In the context of self-regulated learning (SRL), if LLMs can reliably simulate survey…

A recent advancement in Multimodal Large Language Models (MLLMs) research is the emergence of "reasoning MLLMs" that offer explicit control over their internal thinking processes (normally referred as the "thinking mode") alongside the…

The impressive performance of large language models (LLMs) has led to their consideration as models of human language processing. Instead, we suggest that the success of LLMs arises from the flexibility of the transformer learning…

计算与语言 · 计算机科学 2024-11-19 Xiaoliang Luo , Michael Ramscar , Bradley C. Love

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

机器人学 · 计算机科学 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

计算与语言 · 计算机科学 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

With the advent of large language models (LLMs), there is a growing interest in applying LLMs to scientific tasks. In this work, we conduct an experimental study to explore applicability of LLMs for configuring, annotating, translating,…

人机交互 · 计算机科学 2025-10-13 Orcun Yildiz , Tom Peterka

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

计算与语言 · 计算机科学 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Deploying Large Language Models (LLMs) for question answering (QA) over lengthy contexts is a significant challenge. In industrial settings, this process is often hindered by high computational costs and latency, especially when multiple…

计算与语言 · 计算机科学 2025-09-29 Xiliang Zhu , Shi Zong , David Rossouw

As large language models (LLMs) are increasingly deployed in multi-turn dialogue and other sustained interactive scenarios, it is essential to understand how extended context affects their performance. Popular benchmarks, focusing primarily…

计算与语言 · 计算机科学 2025-06-03 Robert Hankache , Kingsley Nketia Acheampong , Liang Song , Marek Brynda , Raad Khraishi , Greig A. Cowan

Strong Artificial Intelligence (Strong AI) or Artificial General Intelligence (AGI) with abstract reasoning ability is the goal of next-generation AI. Recent advancements in Large Language Models (LLMs), along with the emerging field of…

计算与语言 · 计算机科学 2024-01-19 Yiqi Wang , Wentao Chen , Xiaotian Han , Xudong Lin , Haiteng Zhao , Yongfei Liu , Bohan Zhai , Jianbo Yuan , Quanzeng You , Hongxia Yang

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

计算与语言 · 计算机科学 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang