English
Related papers

Related papers: Rethinking Text-based Protein Understanding: Retri…

200 papers

Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding…

Computation and Language · Computer Science 2024-04-19 Nicholas Harris , Anand Butani , Syed Hashmy

The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements:…

Computation and Language · Computer Science 2024-03-18 Guanghua Li , Wensheng Lu , Wei Zhang , Defu Lian , Kezhong Lu , Rui Mao , Kai Shu , Hao Liao

The foundational capabilities of large language models (LLMs) are deeply influenced by the quality of their pre-training corpora. However, enhancing data quality at scale remains a significant challenge, primarily due to the trade-off…

Computation and Language · Computer Science 2025-07-10 Baolong Bi , Shenghua Liu , Xingzhang Ren , Dayiheng Liu , Junyang Lin , Yiwei Wang , Lingrui Mei , Junfeng Fang , Jiafeng Guo , Xueqi Cheng

Retrieval-augmented language models (RALMs) hold promise to produce language understanding systems that are are factual, efficient, and up-to-date. An important desideratum of RALMs, is that retrieved information helps model performance…

Computation and Language · Computer Science 2024-05-07 Ori Yoran , Tomer Wolfson , Ori Ram , Jonathan Berant

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

This study applies Large Language Models (LLMs) to two foundational Electronic Health Record (EHR) data science tasks: structured data querying (using programmatic languages, Python/Pandas) and information extraction from unstructured…

Computation and Language · Computer Science 2026-01-29 Juan Jose Rubio Jan , Jack Wu , Julia Ive

Identification of protein-protein interactions (PPIs) helps derive cellular mechanistic understanding, particularly in the context of complex conditions such as neurodegenerative disorders, metabolic syndromes, and cancer. Large Language…

Machine Learning · Computer Science 2025-08-18 Sanket Jantre , Tianle Wang , Gilchan Park , Kriti Chopra , Nicholas Jeon , Xiaoning Qian , Nathan M. Urban , Byung-Jun Yoon

Large language models (LLMs) have achieved remarkable success across various natural language processing (NLP) tasks. However, recent studies suggest that they still face challenges in performing fundamental NLP tasks essential for deep…

Computation and Language · Computer Science 2025-04-22 Ziyan Zhang , Yang Hou , Chen Gong , Zhenghua Li

Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is…

Computation and Language · Computer Science 2025-08-19 Xin Chen , Junchao Wu , Shu Yang , Runzhe Zhan , Zeyu Wu , Ziyang Luo , Di Wang , Min Yang , Lidia S. Chao , Derek F. Wong

Text retrieval plays a crucial role in incorporating factual knowledge for decision making into language processing pipelines, ranging from chat-based web search to question answering systems. Current state-of-the-art text retrieval models…

Computation and Language · Computer Science 2024-11-26 Ge Gao , Jonathan D. Chang , Claire Cardie , Kianté Brantley , Thorsten Joachim

LaTeX's precision and flexibility in typesetting have made it the gold standard for the preparation of scientific documentation. Large Language Models (LLMs) present a promising opportunity for researchers to produce publication-ready…

Computation and Language · Computer Science 2025-09-16 Sahil Kale , Vijaykant Nadadur

Large Language Models (LLMs) have emerged as a powerful tool in advancing the Text-to-SQL task, significantly outperforming traditional methods.Nevertheless, as a nascent research field, there is still no consensus on the optimal prompt…

Computation and Language · Computer Science 2026-03-20 Bin Zhang , Yuxiao Ye , Guoqing Du , Xiaoru Hu , Zhishuai Li , Chi Harold Liu , Zhiwei Xu , Guoliang Fan , Rui Zhao , Ziyue Li , Hangyu Mao

In recent years, Large Language Models (LLMs) have emerged as a prominent area of interest across various research domains, including Process Mining (PM). Current applications in PM have predominantly centered on prompt engineering…

Computation and Language · Computer Science 2025-09-04 Rafael Seidi Oyamada , Jari Peeperkorn , Jochen De Weerdt , Johannes De Smedt

The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and…

Information Retrieval · Computer Science 2024-07-04 Lemei Zhang , Peng Liu , Yashar Deldjoo , Yong Zheng , Jon Atle Gulla

Existing Protein Language Models (PLMs) often suffer from limited adaptability to multiple tasks and exhibit poor generalization across diverse biological contexts. In contrast, general-purpose Large Language Models (LLMs) lack the…

Machine Learning · Computer Science 2026-02-23 Yujia Wang , Jihong Guan , Wengen Li , Shuigeng Zhou , Xuhong Wang

The rapid adoption of large language models (LLMs), such as GPT-4 and Claude 3.5, underscores the need to distinguish LLM-generated text from human-written content to mitigate the spread of misinformation and misuse in education. One…

Machine Learning · Statistics 2025-11-11 Xingchi Li , Xiaochi Liu , Guanxun Li

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical…

Artificial Intelligence · Computer Science 2026-03-03 Congying Liu , Taihao Li , Ming Huang , Xingyuan Wei , Peipei Liu , Yiqing Shen , Yanxu Mao , Tiehan Cui

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning Large Language Models (LLMs) for text generation. In particular, recent LLMs such as ChatGPT and GPT-4 can engage in fluent conversations with users after…

Machine Learning · Computer Science 2023-11-14 Jonathan D. Chang , Kiante Brantley , Rajkumar Ramamurthy , Dipendra Misra , Wen Sun

Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language.…

Machine Learning · Computer Science 2023-05-10 Michael Kuchnik , Virginia Smith , George Amvrosiadis

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen