English
Related papers

Related papers: Epistemic diversity across language models mitigat…

200 papers

Large language models produce repetitive output when prompted independently across many batches, a phenomenon we term cross-batch mode collapse: the progressive loss of output diversity when a language model is prompted repeatedly without…

Computation and Language · Computer Science 2026-04-09 Ryan Lingo , Rajeev Chhajer

Currently, data and model size dominate the narrative in the training of super-large, powerful models. However, there has been a lack of exploration on the effect of other attributes of the training dataset on model performance. We…

Machine Learning · Computer Science 2025-01-22 Kavita Selva , Satita Vittayaareekul , Brando Miranda

Prior work has provided strong evidence that, within organizational settings, teams that bring a diversity of information and perspectives to a task are more effective than teams that do not. If this form of informational diversity confers…

Computer Science and Game Theory · Computer Science 2023-01-31 Hoda Heidari , Solon Barocas , Jon Kleinberg , Karen Levy

Instruction-tuned large language models (LLMs) employ structured templates, such as role markers and special tokens, to enforce format consistency during inference. However, we identify a critical limitation of such formatting: it induces a…

Computation and Language · Computer Science 2025-05-27 Longfei Yun , Chenyang An , Zilong Wang , Letian Peng , Jingbo Shang

Artificial intelligence (AI) is increasingly integrated into modern healthcare, offering powerful support for clinical decision-making. However, in real-world settings, AI systems may experience performance degradation over time, due to…

Artificial Intelligence · Computer Science 2026-02-05 Hao Guan , David Bates , Li Zhou

Addressing the need for explainable Machine Learning has emerged as one of the most important research directions in modern Artificial Intelligence (AI). While the current dominant paradigm in the field is based on black-box models,…

Neural and Evolutionary Computing · Computer Science 2022-08-29 Andrea Ferigo , Leonardo Lucio Custode , Giovanni Iacca

Growing role of intellectual capital within organizations is affecting new strategies related to knowledge management and competence development. Among different aspects related to this field, knowledge diffusion has become one of…

Social and Information Networks · Computer Science 2015-10-07 Przemyslaw Rozewski , Jaroslaw Jankowski

This research introduces an innovative artificial intelligence-driven educational concept designed to optimize self-directed learning through personalized course delivery and automated teaching assistance. The system leverages fine-tuned AI…

Artificial Intelligence · Computer Science 2024-11-13 Tejas Satish Gotavade

Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of…

Machine Learning · Computer Science 2022-05-19 Akihito Yoshii , Susumu Tokumoto , Fuyuki Ishikawa

Rapid biodiversity loss underscore the urgency of effective monitoring, yet manual surveys remain resource-intensive. While on-device AI offers a scalable alternative, its performance in the wild is often challenged by environmental…

Artificial Intelligence · Computer Science 2026-05-19 Jiaxing Li , Hao Fang , Chi Xu , Miao Zhang , Jiangchuan Liu , William I. Atlas , Katrina M. Connors , Mark A. Spoljaric

Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood. In this…

Robotics · Computer Science 2025-07-09 Modi Shi , Li Chen , Jin Chen , Yuxiang Lu , Chiming Liu , Guanghui Ren , Ping Luo , Di Huang , Maoqing Yao , Hongyang Li

As artificial intelligence systems spread to more diverse and larger tasks in many domains, the machine learning algorithms, and in particular the deep learning models and the databases required to train them are getting bigger themselves.…

Machine Learning · Computer Science 2019-04-22 Philippe Lacaille

Ensembles depend on diversity for improved performance. Many ensemble training methods, therefore, attempt to optimize for diversity, which they almost always define in terms of differences in training set predictions. In this paper,…

Machine Learning · Computer Science 2020-02-10 Andrew Slavin Ross , Weiwei Pan , Leo Anthony Celi , Finale Doshi-Velez

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Can intelligence optimise Digital Ecosystems? How could a distributed intelligence interact with the ecosystem dynamics? Can the software components that are part of genetic selection be intelligent in themselves, as in an adaptive…

Neural and Evolutionary Computing · Computer Science 2009-09-21 G. Briscoe , P. De Wilde

Ensemble learning boosts performance by aggregating predictions from multiple base learners. A core challenge is balancing individual learner accuracy with diversity. Traditional methods like Bagging and Boosting promote diversity through…

Machine Learning · Computer Science 2025-08-08 Rui Zou

Quantitative population modelling is an invaluable tool for identifying the cascading effects of ecosystem management and interventions. Ecosystem models are often constructed by assuming stability and coexistence in ecological communities…

Populations and Evolution · Quantitative Biology 2024-09-06 Sarah A. Vollert , Christopher Drovandi , Matthew P. Adams

Modeling coordination among generative agents in complex multi-round decision-making presents a core challenge for AI and operations management. Although behavioral experiments have revealed cognitive biases behind supply chain…

Multiagent Systems · Computer Science 2026-04-21 Jiuyun Jiang , Yuecheng Hong , Bo Yang , Jin Yang , Guangxin Jiang , Xiaomeng Guo , Guang Xiao

Scaling reinforcement learning to tens of thousands of parallel environments requires overcoming the limited exploration capacity of a single policy. Ensemble-based policy gradient methods, which employ multiple policies to collect diverse…

Machine Learning · Computer Science 2026-03-04 Naoki Shitanda , Motoki Omura , Tatsuya Harada , Takayuki Osa

Model multiplicity refers to the existence of multiple machine learning models that describe the data equally well but may produce different predictions on individual samples. In medicine, these models can admit conflicting predictions for…