English
Related papers

Related papers: Rethinking Text-based Protein Understanding: Retri…

200 papers

Proteins, as essential biomolecules, play a central role in biological processes, including metabolic reactions and DNA replication. Accurate prediction of their properties and functions is crucial in biological applications. Recent…

Computation and Language · Computer Science 2025-05-30 Wei Wu , Chao Wang , Liyi Chen , Mingze Yin , Yiheng Zhu , Kun Fu , Jieping Ye , Hui Xiong , Zheng Wang

Large language models (LLMs) have garnered considerable attention for their proficiency in tackling intricate tasks, particularly leveraging their capacities for zero-shot and in-context learning. However, their utility has been…

Biomolecules · Quantitative Biology 2024-05-14 Yiqing Shen , Outongyi Lv , Houying Zhu , Yu Guang Wang

Recent advancements in large language models (LLMs) have demonstrated their remarkable capabilities across various language tasks. Inspired by the success of text-to-text translation refinement, this paper investigates how LLMs can improve…

Computation and Language · Computer Science 2025-01-28 Huaixia Dou , Xinyu Tian , Xinglin Lyu , Jie Zhu , Junhui Li , Lifan Guo

Parametric language models (LMs), which are trained on vast amounts of web data, exhibit remarkable flexibility and capability. However, they still face practical challenges such as hallucinations, difficulty in adapting to new data…

Computation and Language · Computer Science 2024-03-06 Akari Asai , Zexuan Zhong , Danqi Chen , Pang Wei Koh , Luke Zettlemoyer , Hannaneh Hajishirzi , Wen-tau Yih

Language models serve as a cornerstone in natural language processing (NLP), utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling…

Computation and Language · Computer Science 2024-09-24 Zichong Wang , Zhibo Chu , Thang Viet Doan , Shiwen Ni , Min Yang , Wenbin Zhang

We introduce MMTR-Bench, a benchmark designed to evaluate the intrinsic ability of Multimodal Large Language Models (MLLMs) to reconstruct masked text directly from visual context. Unlike conventional question-answering tasks, MMTR-Bench…

Artificial Intelligence · Computer Science 2026-04-28 Jindi Guo , Chaozheng Huang , Xi Fang

The emergence of large language models (LLMs) has resulted in the production of LLM-generated texts that is highly sophisticated and almost indistinguishable from texts written by humans. However, this has also sparked concerns about the…

Computation and Language · Computer Science 2023-06-06 Ruixiang Tang , Yu-Neng Chuang , Xia Hu

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

With the advancement of large language models (LLMs) and the expansion of their context windows, existing long-context benchmarks fall short in effectively evaluating the models' comprehension and reasoning abilities in extended texts.…

Computation and Language · Computer Science 2024-06-27 Lei Zhang , Yunshui Li , Ziqiang Liu , Jiaxi yang , Junhao Liu , Longze Chen , Run Luo , Min Yang

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

Computation and Language · Computer Science 2025-06-27 Zhengyan Shi

Text classification is fundamental in Natural Language Processing (NLP), and the advent of Large Language Models (LLMs) has revolutionized the field. This paper introduces an adaptable and reliable text classification paradigm, which…

Computation and Language · Computer Science 2024-12-10 Zhiqiang Wang , Yiran Pang , Yanbin Lin , Xingquan Zhu

Pretrained large Language Models (LLMs) are able to answer questions that are unlikely to have been encountered during training. However a diversity of potential applications exist in the broad domain of reasoning systems and considerations…

Computation and Language · Computer Science 2024-11-27 Tim Hartill

Multimodal information retrieval (MMIR) has gained attention for its flexibility in handling text, images, or mixed queries and candidates. Recent breakthroughs in multimodal large language models (MLLMs) boost MMIR performance by…

Information Retrieval · Computer Science 2026-02-27 Dawei Su , Dongsheng Wang

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models…

Computation and Language · Computer Science 2024-12-20 Yuan Xia , Jingbo Zhou , Zhenhui Shi , Jun Chen , Haifeng Huang

Large language models (LLMs) exhibit remarkable performance across various NLP tasks. However, they often generate incorrect or hallucinated information, which hinders their practical applicability in real-world scenarios. Human feedback…

Computation and Language · Computer Science 2023-05-24 Wenhao Yu , Zhihan Zhang , Zhenwen Liang , Meng Jiang , Ashish Sabharwal

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

The swift advancement in the scales and capabilities of Large Language Models (LLMs) positions them as promising tools for a variety of downstream tasks. In addition to the pursuit of better performance and the avoidance of violent feedback…

Computation and Language · Computer Science 2023-09-28 Haoyu Wang , Guozheng Ma , Cong Yu , Ning Gui , Linrui Zhang , Zhiqi Huang , Suwei Ma , Yongzhe Chang , Sen Zhang , Li Shen , Xueqian Wang , Peilin Zhao , Dacheng Tao

This study addresses construction site hazard identification by proposing a retrieval-augmented framework that enhances large language models (LLMs) without requiring fine-tuning. Current LLM-based approaches face limitations: image-text…

Artificial Intelligence · Computer Science 2025-11-11 Jiawei Li , Chengye Yang , Yaochen Zhang , Weilin Sun , Lei Meng , Xiangxu Meng

In the field of language modeling, models augmented with retrieval components have emerged as a promising solution to address several challenges faced in the natural language processing (NLP) field, including knowledge grounding,…

Machine Learning · Computer Science 2024-10-22 To Eun Kim , Alireza Salemi , Andrew Drozdov , Fernando Diaz , Hamed Zamani