English
Related papers

Related papers: A Large Language Model for Corporate Credit Scorin…

200 papers

Despite their sophisticated capabilities, large language models (LLMs) encounter a major hurdle in effective assessment. This paper first revisits the prevalent evaluation method-multiple choice question answering (MCQA), which allows for…

Computation and Language · Computer Science 2024-03-13 Fangyun Wei , Xi Chen , Lin Luo

Large Language Models (LLMs) excel in various Natural Language Processing (NLP) tasks, yet their evaluation, particularly in languages beyond the top $20$, remains inadequate due to existing benchmarks and metrics limitations. Employing…

Computation and Language · Computer Science 2024-02-14 Rishav Hada , Varun Gumma , Adrian de Wynter , Harshita Diddee , Mohamed Ahmed , Monojit Choudhury , Kalika Bali , Sunayana Sitaram

We study whether Large Language Models (LLMs) can perform feature model analysis operations (AOs) directly on semi-formal textual blueprints, i.e., concise constrained-language descriptions of feature hierarchies and constraints, enabling…

Software Engineering · Computer Science 2026-04-23 Viet-Man Le , Thi Ngoc Trang Tran , Sebastian Lubos , Alexander Felfernig , Damian Garber

The growing availability of building operational data motivates the use of reinforcement learning (RL), which can learn control policies directly from data and cope with the complexity and uncertainty of large-scale building clusters.…

Artificial Intelligence · Computer Science 2026-03-30 Borui Zhang , Nariman Mahdavi , Subbu Sethuvenkatraman , Shuang Ao , Flora Salim

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

This study reviewed the use of Large Language Models (LLMs) in healthcare, focusing on their training corpora, customization techniques, and evaluation metrics. A systematic search of studies from 2021 to 2024 identified 61 articles. Four…

Computation and Language · Computer Science 2025-02-18 Shuqi Yang , Mingrui Jing , Shuai Wang , Jiaxin Kou , Manfei Shi , Weijie Xing , Yan Hu , Zheng Zhu

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

Computation and Language · Computer Science 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

Large Language Model (LLM) has gained popularity and achieved remarkable results in open-domain tasks, but its performance in real industrial domain-specific scenarios is average due to its lack of specific domain knowledge. This issue has…

Computation and Language · Computer Science 2023-10-17 Fangkai Yang , Pu Zhao , Zezhong Wang , Lu Wang , Jue Zhang , Mohit Garg , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

As large language models (LLMs) proliferate in scale, specialization, and latency profiles, the challenge of routing user prompts to the most appropriate model has become increasingly critical for balancing performance and cost. We…

Software Engineering · Computer Science 2025-09-19 Amine Barrak , Yosr Fourati , Michael Olchawa , Emna Ksontini , Khalil Zoghlami

The remarkable achievements and rapid advancements of Large Language Models (LLMs) such as ChatGPT and GPT-4 have showcased their immense potential in quantitative investment. Traders can effectively leverage these LLMs to analyze financial…

Computation and Language · Computer Science 2023-10-11 Yujie Ding , Shuai Jia , Tianyi Ma , Bingcheng Mao , Xiuze Zhou , Liuliu Li , Dongming Han

Competency modeling is widely used in human resource management to select, develop, and evaluate talent. However, traditional expert-driven approaches rely heavily on manual analysis of large volumes of interview transcripts, making them…

Computation and Language · Computer Science 2026-02-16 Silin Du , Manqing Xin , Raymond Jia Wang

Current evaluation frameworks for multimodal generative AI struggle to establish trustworthiness, hindering enterprise adoption where reliability is paramount. We introduce a systematic, quantitative benchmarking framework to measure the…

Information Retrieval · Computer Science 2025-06-30 Varun Mannam , Fang Wang , Xin Chen

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

Computation and Language · Computer Science 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

Context: Large Language Models (LLMs) enable automation of complex natural language processing across domains, but research on domain-specific applications like Finance remains limited. Objectives: This study explored open-source and…

Software Engineering · Computer Science 2025-09-30 Theo Koraag , Niklas Wagner , Felix Dobslaw , Lucas Gren

Large-scale multilingual evaluations, such as MEGA, often include only a handful of African languages due to the scarcity of high-quality evaluation data and the limited discoverability of existing African datasets. This lack of…

Computation and Language · Computer Science 2025-06-10 Jessica Ojo , Odunayo Ogundepo , Akintunde Oladipo , Kelechi Ogueji , Jimmy Lin , Pontus Stenetorp , David Ifeoluwa Adelani

In this paper we explore the use of quantum machine learning (QML) applied to credit scoring for small and medium-sized enterprises (SME). A quantum/classical hybrid approach has been used with several models, activation functions, epochs…

A Language Model is a term that encompasses various types of models designed to understand and generate human communication. Large Language Models (LLMs) have gained significant attention due to their ability to process text with human-like…

Computation and Language · Computer Science 2024-06-12 Sylvio Barbon Junior , Paolo Ceravolo , Sven Groppe , Mustafa Jarrar , Samira Maghool , Florence Sèdes , Soror Sahri , Maurice Van Keulen

The aim of this project is to develop and test advanced analytical methods to improve the prediction accuracy of Credit Risk Models, preserving at the same time the model interpretability. In particular, the project focuses on applying an…

Machine Learning · Computer Science 2021-08-09 Neus Llop Torrent , Giorgio Visani , Enrico Bagli

Online reviews play a pivotal role in influencing consumer decisions across various domains, from purchasing products to selecting hotels or restaurants. However, the sheer volume of reviews -- often containing repetitive or irrelevant…

Computation and Language · Computer Science 2024-10-18 Mir Tafseer Nayeem , Davood Rafiei

Large language models have undergone rapid evolution, emerging as a pivotal technology for intelligence in financial operations. However, existing benchmarks are often constrained by pitfalls such as reliance on simulated or general-purpose…

Artificial Intelligence · Computer Science 2026-01-13 Xin Guo , Rongjunchen Zhang , Guilong Lu , Xuntao Guo , Shuai Jia , Zhi Yang , Liwen Zhang