English

Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models

Computation and Language 2024-03-19 v2 Artificial Intelligence

Abstract

Recent progress in large language models (LLMs) has enabled the deployment of many generative NLP applications. At the same time, it has also led to a misleading public discourse that ``it's all been solved.'' Not surprisingly, this has, in turn, made many NLP researchers -- especially those at the beginning of their careers -- worry about what NLP research area they should focus on. Has it all been solved, or what remaining questions can we work on regardless of LLMs? To address this question, this paper compiles NLP research directions rich for exploration. We identify fourteen different research areas encompassing 45 research directions that require new research and are not directly solvable by LLMs. While we identify many research areas, many others exist; we do not cover areas currently addressed by LLMs, but where LLMs lag behind in performance or those focused on LLM development. We welcome suggestions for other research directions to include: https://bit.ly/nlp-era-llm

Keywords

Cite

@article{arxiv.2305.12544,
  title  = {Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models},
  author = {Oana Ignat and Zhijing Jin and Artem Abzaliev and Laura Biester and Santiago Castro and Naihao Deng and Xinyi Gao and Aylin Gunal and Jacky He and Ashkan Kazemi and Muhammad Khalifa and Namho Koh and Andrew Lee and Siyang Liu and Do June Min and Shinka Mori and Joan Nwatu and Veronica Perez-Rosas and Siqi Shen and Zekun Wang and Winston Wu and Rada Mihalcea},
  journal= {arXiv preprint arXiv:2305.12544},
  year   = {2024}
}

Comments

Accepted at COLING 2024

R2 v1 2026-06-28T10:40:38.493Z