English
Related papers

Related papers: Is GPT-4 a Good Data Analyst?

200 papers

The potential of large language models (LLMs) to reason like humans has been a highly contested topic in Machine Learning communities. However, the reasoning abilities of humans are multifaceted and can be seen in various forms, including…

Computation and Language · Computer Science 2023-03-28 Shrivats Agrawal

Large language models have emerged abilities including chain-of-thought to answer math word problems step by step. Solving math word problems not only requires abilities to disassemble problems via chain-of-thought but also needs to…

Computation and Language · Computer Science 2023-04-06 Zheng Yuan , Hongyi Yuan , Chuanqi Tan , Wei Wang , Songfang Huang

Following the widespread adoption of ChatGPT in early 2023, numerous studies reported that large language models (LLMs) can match or even surpass human performance in creative tasks. However, it remains unclear whether LLMs have become more…

Computation and Language · Computer Science 2025-04-18 Jennifer Haase , Paul H. P. Hanel , Sebastian Pokutta

Recent advances in Large Language Models (LLMs) have presented new opportunities for integrating Artificial General Intelligence (AGI) into biological research and education. This study evaluated the capabilities of leading LLMs, including…

Computation and Language · Computer Science 2023-11-15 Xinyu Gong , Jason Holmes , Yiwei Li , Zhengliang Liu , Qi Gan , Zihao Wu , Jianli Zhang , Yusong Zou , Yuxi Teng , Tian Jiang , Hongtu Zhu , Wei Liu , Tianming Liu , Yajun Yan

The rapid emergence of large language models (LLMs) has raised urgent questions across the modern workforce about this new technology's strengths, weaknesses, and capabilities. For privacy professionals, the question is whether these AI…

Computers and Society · Computer Science 2025-08-13 Zane Witherspoon , Thet Mon Aye , YingYing Hao

The rapid advancement of large language models (LLMs) such as GPT-4 has revolutionized the landscape of software engineering, positioning these models at the core of modern development practices. As we anticipate these models to evolve into…

Software Engineering · Computer Science 2025-06-16 Jianian Gong , Nachuan Duan , Ziheng Tao , Zhaohui Gong , Yuan Yuan , Minlie Huang

Artificial intelligence (AI) has gained significant attention in healthcare consultation due to its potential to improve clinical workflow and enhance medical communication. However, owing to the complex nature of medical information, large…

Computation and Language · Computer Science 2024-03-05 Xiaolan Chen , Ziwei Zhao , Weiyi Zhang , Pusheng Xu , Le Gao , Mingpu Xu , Yue Wu , Yinwen Li , Danli Shi , Mingguang He

Better understanding of Large Language Models' (LLMs) legal analysis abilities can contribute to improving the efficiency of legal services, governing artificial intelligence, and leveraging LLMs to identify inconsistencies in law. This…

Computation and Language · Computer Science 2023-06-13 John J. Nay , David Karamardian , Sarah B. Lawsky , Wenting Tao , Meghana Bhat , Raghav Jain , Aaron Travis Lee , Jonathan H. Choi , Jungo Kasai

Large Language Models (LLMs) have shown impressive capabilities across a wide variety of tasks. However, they still face challenges with long-horizon planning. To study this, we propose path planning tasks as a platform to evaluate LLMs'…

Artificial Intelligence · Computer Science 2024-06-24 Mohamed Aghzal , Erion Plaku , Ziyu Yao

We investigate the potential implications of large language models (LLMs), such as Generative Pre-trained Transformers (GPTs), on the U.S. labor market, focusing on the increased capabilities arising from LLM-powered software compared to…

General Economics · Economics 2023-08-22 Tyna Eloundou , Sam Manning , Pamela Mishkin , Daniel Rock

With the advent of large language models (LLMs), in both the open source and proprietary domains, attention is turning to how to exploit such artificial intelligence (AI) systems in assisting complex scientific tasks, such as material…

Human-Computer Interaction · Computer Science 2024-01-26 Yongtao Liu , Marti Checa , Rama K. Vasudevan

Large language models (LLMs) have performed well on several reasoning benchmarks, including ones that test analogical reasoning abilities. However, it has been debated whether they are actually performing humanlike abstract reasoning or…

Artificial Intelligence · Computer Science 2024-02-15 Martha Lewis , Melanie Mitchell

Large language models (LLMs) have shown remarkable capabilities across a broad range of tasks involving question answering and the generation of coherent text and code. Comprehensively understanding the strengths and weaknesses of LLMs is…

Computation and Language · Computer Science 2023-06-02 Jonathan Roberts , Timo Lüddecke , Sowmen Das , Kai Han , Samuel Albanie

Large language models (LLMs) such as ChatGPT have gained considerable interest across diverse research communities. Their notable ability for text completion and generation has inaugurated a novel paradigm for language-interfaced problem…

Quantitative Methods · Quantitative Biology 2024-02-22 Hengchuang Yin , Zhonghui Gu , Fanhao Wang , Yiparemu Abuduhaibaier , Yanqiao Zhu , Xinming Tu , Xian-Sheng Hua , Xiao Luo , Yizhou Sun

OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their…

Artificial Intelligence · Computer Science 2024-09-24 Goran Bubaš

The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now…

Computation and Language · Computer Science 2025-02-11 Andrea Matarazzo , Riccardo Torlone

The introduction of ChatGPT has garnered widespread attention in both academic and industrial communities. ChatGPT is able to respond effectively to a wide range of human questions, providing fluent and comprehensive answers that…

Computation and Language · Computer Science 2023-01-19 Biyang Guo , Xin Zhang , Ziyuan Wang , Minqi Jiang , Jinran Nie , Yuxuan Ding , Jianwei Yue , Yupeng Wu

Large Language Models (LLMs) could be a useful tool for lawyers. However, empirical research on their effectiveness in conducting legal tasks is scant. We study securities cases involving cryptocurrencies as one of numerous contexts where…

Artificial Intelligence · Computer Science 2024-02-23 Arianna Trozze , Toby Davies , Bennett Kleinberg

The disruptive application of ChatGPT (GPT-3.5, GPT-4) to a variety of domains has become a topic of much discussion in the scientific community and society at large. Large Language Models (LLMs), e.g., BERT, Bard, Generative Pre-trained…

Cryptography and Security · Computer Science 2023-07-21 Mark Scanlon , Frank Breitinger , Christopher Hargreaves , Jan-Niclas Hilgert , John Sheppard

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

Computation and Language · Computer Science 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun