English
Related papers

Related papers: OpenScholar: Synthesizing Scientific Literature wi…

200 papers

Academic paper review typically requires substantial time, expertise, and human resources. Large Language Models (LLMs) present a promising method for automating the review process due to their extensive training data, broad knowledge base,…

Computers and Society · Computer Science 2025-06-24 Chuanlei Li , Xu Hu , Minghui Xu , Kun Li , Yue Zhang , Xiuzhen Cheng

Ongoing breakthroughs in large language models (LLMs) are reshaping scholarly search and discovery interfaces. While these systems offer new possibilities for navigating scientific knowledge, they also raise concerns about fairness and…

Computation and Language · Computer Science 2026-04-28 Ghazal Kalhor , Afra Mashhadi

Recent studies have raised concerns about the potential threats large language models (LLMs) pose to academic integrity and copyright protection. Yet, their investigation is predominantly focused on literal copies of original texts. Also,…

Computation and Language · Computer Science 2025-02-18 Jooyoung Lee , Toshini Agrawal , Adaku Uchendu , Thai Le , Jinghui Chen , Dongwon Lee

Recent advances in AI have catalyzed the adoption of intelligent educational tools, yet many semantic retrieval systems remain ill-suited to the unique linguistic and structural characteristics of academic content. This study presents two…

Computation and Language · Computer Science 2025-05-09 Ramteja Sajja , Yusuf Sermet , Ibrahim Demir

This paper introduces a system that integrates large language models (LLMs) into the clinical trial retrieval process, enhancing the effectiveness of matching patients with eligible trials while maintaining information privacy and allowing…

Information Retrieval · Computer Science 2024-11-01 Georgios Peikos , Pranav Kasela , Gabriella Pasi

Recently, using a powerful proprietary Large Language Model (LLM) (e.g., GPT-4) as an evaluator for long-form responses has become the de facto standard. However, for practitioners with large-scale evaluation tasks and custom criteria in…

Computation and Language · Computer Science 2024-03-12 Seungone Kim , Jamin Shin , Yejin Cho , Joel Jang , Shayne Longpre , Hwaran Lee , Sangdoo Yun , Seongjin Shin , Sungdong Kim , James Thorne , Minjoon Seo

The effective training and evaluation of retrieval systems require a substantial amount of relevance judgments, which are traditionally collected from human assessors -- a process that is both costly and time-consuming. Large Language…

Information Retrieval · Computer Science 2024-12-19 Hossein A. Rahmani , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

Given the remarkable performance of Large Language Models (LLMs), an important question arises: Can LLMs conduct human-like scientific research and discover new knowledge, and act as an AI scientist? Scientific discovery is an iterative…

Machine Learning · Computer Science 2025-02-24 Tingting Chen , Srinivas Anumasa , Beibei Lin , Vedant Shah , Anirudh Goyal , Dianbo Liu

This study explores the effectiveness of Large Language Models (LLMs) for Automatic Question Generation in educational settings. Three LLMs are compared in their ability to create questions from university slide text without fine-tuning.…

Computation and Language · Computer Science 2024-09-17 Ivo Lodovico Molina , Valdemar Švábenský , Tsubasa Minematsu , Li Chen , Fumiya Okubo , Atsushi Shimada

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

Large Language Models have taken the cognitive science world by storm. It is perhaps timely now to take stock of the various research paradigms that have been used to make scientific inferences about ``cognition" in these models or about…

Artificial Intelligence · Computer Science 2024-06-17 Desmond C. Ong

In recent years, the rapid advancement of Large Language Models (LLMs) has transformed the landscape of scientific research, offering unprecedented support across various stages of the research cycle. This paper presents the first…

Computation and Language · Computer Science 2025-01-09 Ziming Luo , Zonglin Yang , Zexin Xu , Wei Yang , Xinya Du

Large Language Models (LLMs) generalize well across language tasks, but suffer from hallucinations and uninterpretability, making it difficult to assess their accuracy without ground-truth. Retrieval-Augmented Generation (RAG) models have…

Computation and Language · Computer Science 2023-12-18 Jakub Lála , Odhran O'Donoghue , Aleksandar Shtedritski , Sam Cox , Samuel G. Rodriques , Andrew D. White

Assessing writing in large classes for formal or informal learners presents a significant challenge. Consequently, most large classes, particularly in science, rely on objective assessment tools such as multiple-choice quizzes, which have a…

Computation and Language · Computer Science 2025-01-24 Chris Impey , Matthew Wenger , Nikhil Garuda , Shahriar Golchin , Sarah Stamer

Artificial intelligence chatbots driven by large language models (LLMs) have the potential to increase public science literacy and support scientific research, as they can quickly summarize complex scientific information in accessible…

Computation and Language · Computer Science 2025-04-02 Uwe Peters , Benjamin Chin-Yee

The ever-growing corpus of scientific literature presents significant challenges for researchers with respect to discovery, management, and annotation of relevant publications. Traditional platforms like Semantic Scholar, BibSonomy, and…

Information Retrieval · Computer Science 2024-01-18 Tom Völker , Jan Pfister , Tobias Koopmann , Andreas Hotho

Large language models (LLMs) have been widely adopted in mathematical optimization in scientific scenarios for their extensive knowledge and advanced reasoning capabilities. Existing methods mainly focus on utilizing LLMs to solve…

Optimization and Control · Mathematics 2025-03-18 Qitan Lv , Tianyu Liu , Hong Wang

Large Language Models (LLMs) are transforming AI across industries, but their development and deployment remain complex. This survey reviews 16 key challenges in building and using LLMs and examines how these challenges are addressed by two…

Computation and Language · Computer Science 2025-09-01 Shubham Sharma , Sneha Tuli , Narendra Badam

Machine translation systems for high resource languages perform exceptionally well and produce high quality translations. Unfortunately, the vast majority of languages are not considered high resource and lack the quantity of parallel…

Computation and Language · Computer Science 2024-10-22 Jonathan Hus , Antonios Anastasopoulos