English
Related papers

Related papers: ControllableGPT: A Ground-Up Designed Controllable…

200 papers

Large language models (LLMs) have attracted great attention given their strong performance on a wide range of NLP tasks. In practice, users often expect generated texts to fall within a specific length range, making length controlled…

Computation and Language · Computer Science 2024-06-18 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu

Multimodal large language models (MLLMs) have made impressive progress in many applications in recent years. However, chemical MLLMs that can handle cross-modal understanding and generation remain underexplored. To fill this gap, we propose…

Machine Learning · Computer Science 2025-08-05 Qian Tan , Dongzhan Zhou , Peng Xia , Wanhao Liu , Wanli Ouyang , Lei Bai , Yuqiang Li , Tianfan Fu

Generative Pretrained Transformers (GPTs) are foundational Large Language Models (LLMs) for text generation. However, individual LLMs often produce inconsistent outputs and exhibit biases, limiting their representation of diverse language…

Computation and Language · Computer Science 2025-08-06 Mari Ashiga , Wei Jie , Fan Wu , Vardan Voskanyan , Fateme Dinmohammadi , Paul Brookes , Jingzhi Gong , Zheng Wang

Large Language Models (LLMs) excel at generating fluent text but struggle to enforce external constraints because they generate tokens sequentially without explicit control mechanisms. GenCP addresses this limitation by combining LLM…

Computation and Language · Computer Science 2025-06-02 Alexandre Bonlarron , Florian Régin , Elisabetta De Maria , Jean-Charles Régin

Optimization problems are prevalent across various scenarios. Formulating and then solving optimization problems described by natural language often requires highly specialized human expertise, which could block the widespread application…

Artificial Intelligence · Computer Science 2025-03-04 Caigao Jiang , Xiang Shu , Hong Qian , Xingyu Lu , Jun Zhou , Aimin Zhou , Yang Yu

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

Computation and Language · Computer Science 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in handling the…

Biomolecules · Quantitative Biology 2024-05-14 Xianggen Liu , Yan Guo , Haoran Li , Jin Liu , Shudong Huang , Bowen Ke , Jiancheng Lv

In real-world drug design, molecule optimization requires selectively improving multiple molecular properties up to pharmaceutically relevant levels, while maintaining others that already meet such criteria. However, existing computational…

Machine Learning · Computer Science 2025-06-02 Vishal Dey , Xiao Hu , Xia Ning

The advancement of Large Language Models (LLMs), including GPT-4, provides exciting new opportunities for generative design. We investigate the application of this tool across the entire design and manufacturing workflow. Specifically, we…

Recent research explores optimization using large language models (LLMs) by either iteratively seeking next-step solutions from LLMs or directly prompting LLMs for an optimizer. However, these approaches exhibit inherent limitations,…

Optimization and Control · Mathematics 2024-03-06 Zeyuan Ma , Hongshu Guo , Jiacheng Chen , Guojun Peng , Zhiguang Cao , Yining Ma , Yue-Jiao Gong

The number of large language models (LLMs) with varying parameter scales and vocabularies is increasing. While they deliver powerful performance, they also face a set of common optimization needs to meet specific requirements or standards,…

Computation and Language · Computer Science 2024-10-24 Jiayi Wu , Hao Sun , Hengyi Cai , Lixin Su , Shuaiqiang Wang , Dawei Yin , Xiang Li , Ming Gao

Pre-trained large language models (PLMs) underlie most new developments in natural language processing. They have shifted the field from application-specific model pipelines to a single model that is adapted to a wide range of tasks.…

Computation and Language · Computer Science 2023-06-30 Joshua Maynez , Priyanka Agrawal , Sebastian Gehrmann

General-purpose embedding models have demonstrated strong performance in text retrieval but remain suboptimal for table retrieval, where highly structured content leads to semantic compression and query-table mismatch. Recent LLM-based…

Information Retrieval · Computer Science 2026-01-23 Tsung-Hsiang Chou , Chen-Jui Yu , Shui-Hsiang Hsu , Yao-Chung Fan

The ability to design molecules while preserving similarity to a target molecule and/or property is crucial for various applications in drug discovery, chemical design, and biology. We introduce in this paper an efficient training-free…

Machine Learning · Computer Science 2025-11-18 Jiri Navratil , Jarret Ross , Payel Das , Youssef Mroueh , Samuel C Hoffman , Vijil Chenthamarakshan , Brian Belgodere

Generative Large Language Models (LLMs) hold significant promise in healthcare, demonstrating capabilities such as passing medical licensing exams and providing clinical knowledge. However, their current use as information retrieval tools…

Multimodal Large Language Models (MLLMs) are widely regarded as crucial in the exploration of Artificial General Intelligence (AGI). The core of MLLMs lies in their capability to achieve cross-modal alignment. To attain this goal, current…

Computation and Language · Computer Science 2024-11-26 Fei Zhao , Taotian Pang , Chunhui Li , Zhen Wu , Junjie Guo , Shangyu Xing , Xinyu Dai

Large language models (LLMs) have garnered significant attention for their remarkable capabilities across various domains, whose vast parameter scales present challenges for practical deployment. Structured pruning is an effective method to…

Artificial Intelligence · Computer Science 2024-12-25 Gui Ling , Ziyang Wang , Yuliang Yan , Qingwen Liu

Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging requirements of digital humans.Despite impressive advances, existing approaches are often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuan Wang , Di Huang , Yaqi Zhang , Wanli Ouyang , Jile Jiao , Xuetao Feng , Yan Zhou , Pengfei Wan , Shixiang Tang , Dan Xu

There is enormous enthusiasm and concerns in using large language models (LLMs) in healthcare, yet current assumptions are all based on general-purpose LLMs such as ChatGPT. This study develops a clinical generative LLM, GatorTronGPT, using…

Large language models (LLMs) are having transformative impacts across a wide range of scientific fields, particularly in the biomedical sciences. Just as the goal of Natural Language Processing is to understand sequences of words, a major…

Genomics · Quantitative Biology 2024-09-24 Gonzalo Benegas , Chengzhong Ye , Carlos Albors , Jianan Canal Li , Yun S. Song