English
Related papers

Related papers: Tuna: Instruction Tuning using Feedback from Large…

200 papers

The inherent uncertainty in the environmental transition model of Reinforcement Learning (RL) necessitates a delicate balance between exploration and exploitation. This balance is crucial for optimizing computational resources to accurately…

Machine Learning · Computer Science 2025-05-21 Yongxin Deng , Xihe Qiu , Jue Chen , Xiaoyu Tan

Optimizing training performance in large language models (LLMs) remains an essential challenge, particularly in improving model performance while maintaining computational costs. This work challenges the conventional approach of training…

Computation and Language · Computer Science 2025-11-04 Chun-Hao Yang , Bo-Han Feng , Tzu-Yuan Lai , Yan Yu Chen , Yin-Kai Dean Huang , Shou-De Lin

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

In the past decades, recommender systems have attracted much attention in both research and industry communities, and a large number of studies have been devoted to developing effective recommendation models. Basically speaking, these…

Information Retrieval · Computer Science 2023-05-12 Junjie Zhang , Ruobing Xie , Yupeng Hou , Wayne Xin Zhao , Leyu Lin , Ji-Rong Wen

Pre-trained large-scale language models (LLMs) excel at producing coherent articles, yet their outputs may be untruthful, toxic, or fail to align with user expectations. Current approaches focus on using reinforcement learning with human…

Computation and Language · Computer Science 2024-06-06 Dehong Xu , Liang Qiu , Minseok Kim , Faisal Ladhak , Jaeyoung Do

Finding preferences expressed in natural language is an important but challenging task. State-of-the-art(SotA) methods leverage transformer-based models such as BERT, RoBERTa, etc. and graph neural architectures such as graph attention…

Computation and Language · Computer Science 2023-10-13 Inwon Kang , Sikai Ruan , Tyler Ho , Jui-Chien Lin , Farhad Mohsin , Oshani Seneviratne , Lirong Xia

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as science, law, and healthcare, where accurate expressions of uncertainty are essential for reliability and trust. However, current LLMs are often observed…

Computation and Language · Computer Science 2025-11-26 Yibo Li , Miao Xiong , Jiaying Wu , Bryan Hooi

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Effective passage retrieval and reranking methods have been widely utilized to identify suitable candidates in open-domain question answering tasks, recent studies have resorted to LLMs for reranking the retrieved passages by the…

Computation and Language · Computer Science 2024-06-24 Xuyang Wu , Zhiyuan Peng , Krishna Sravanthi Rajanala Sai , Hsin-Tai Wu , Yi Fang

Large Language Models (LLMs) have demonstrated human-like instruction-following abilities, particularly those exceeding 100 billion parameters. The combined capability of some smaller, resource-friendly LLMs can address most of the…

Computation and Language · Computer Science 2025-02-25 Yi-Kai Zhang , De-Chuan Zhan , Han-Jia Ye

Course evaluation plays a critical role in ensuring instructional quality and guiding curriculum development in higher education. However, traditional evaluation methods, such as student surveys, classroom observations, and expert reviews,…

Computation and Language · Computer Science 2025-12-29 Bo Yuan , Jiazi Hu

The increasing size and complexity of pre-trained language models have demonstrated superior performance in many applications, but they usually require large training datasets to be adequately trained. Insufficient training sets could…

Computation and Language · Computer Science 2025-02-03 Yaping Chai , Haoran Xie , Joe S. Qin

Recently, the number of off-the-shelf Large Language Models (LLMs) has exploded with many open-source options. This creates a diverse landscape regarding both serving options (e.g., inference on local hardware vs remote LLM APIs) and model…

Machine Learning · Computer Science 2024-12-18 Dimitrios Sikeridis , Dennis Ramdass , Pranay Pareek

Instruction tuning large language models (LLMs) using machine-generated instruction-following data has improved zero-shot capabilities on new tasks, but the idea is less explored in the multimodal field. In this paper, we present the first…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Haotian Liu , Chunyuan Li , Qingyang Wu , Yong Jae Lee

In search settings, calibrating the scores during the ranking process to quantities such as click-through rates or relevance levels enhances a system's usefulness and trustworthiness for downstream users. While previous research has…

Information Retrieval · Computer Science 2024-08-28 Puxuan Yu , Daniel Cohen , Hemank Lamba , Joel Tetreault , Alex Jaimes

As humans, we consistently interact with our peers and receive feedback in the form of natural language. This language feedback allows us to maintain appropriate behavior, and rectify potential errors. The question arises naturally: can we…

Computation and Language · Computer Science 2024-06-07 Weiwen Xu , Deng Cai , Zhisong Zhang , Wai Lam , Shuming Shi

Large Language Models (LLMs) for public use require continuous pre-training to remain up-to-date with the latest data. The models also need to be fine-tuned with specific instructions to maintain their ability to follow instructions…

Computation and Language · Computer Science 2024-10-15 Ishan Jindal , Chandana Badrinath , Pranjal Bharti , Lakkidi Vinay , Sachin Dev Sharma

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan