English
Related papers

Related papers: Preference-Based Batch and Sequential Teaching

200 papers

How should we decide which fairness criteria or definitions to adopt in machine learning systems? To answer this question, we must study the fairness preferences of actual users of machine learning systems. Stringent parity constraints on…

Artificial Intelligence · Computer Science 2020-12-09 Angie Peng , Jeff Naecker , Ben Hutchinson , Andrew Smart , Nyalleng Moorosi

Multi-task learning has emerged as a powerful machine learning paradigm for integrating data from multiple sources, leveraging similarities between tasks to improve overall model performance. However, the application of multi-task learning…

Methodology · Statistics 2024-02-09 Parker Knight , Rui Duan

In machine learning, metric elicitation refers to the selection of performance metrics that best reflect an individual's implicit preferences for a given application. Currently, metric elicitation methods only consider metrics that depend…

Machine Learning · Computer Science 2025-01-03 Chethan Bhateja , Joseph O'Brien , Afnaan Hashmi , Eva Prakash

Preference-based reinforcement learning has gained prominence as a strategy for training agents in environments where the reward signal is difficult to specify or misaligned with human intent. However, its effectiveness is often limited by…

Machine Learning · Computer Science 2025-08-27 Jonathan Erskine , Taku Yamagata , Raúl Santos-Rodríguez

Sequential and temporal data arise in many fields of research, such as quantitative finance, medicine, or computer vision. A novel approach for sequential learning, called the signature method and rooted in rough path theory, is considered.…

Machine Learning · Statistics 2020-12-10 Adeline Fermanian

A growing number of universities worldwide use various forms of online and blended learning as part of their academic curricula. Furthermore, the recent changes caused by the COVID-19 pandemic have led to a drastic increase in importance…

Machine Learning · Computer Science 2022-09-05 Galina Deeva , Johannes De Smedt , Cecilia Saint-Pierre , Richard Weber , Jochen De Weerdt

Real-life combinatorial optimization problems often involve several conflicting objectives, such as price, product quality and sustainability. A computationally-efficient way to tackle multiple objectives is to aggregate them into a…

Artificial Intelligence · Computer Science 2025-08-28 Marianne Defresne , Jayanta Mandi , Tias Guns

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

Increasingly, researchers have suggested the benefits of temporal analysis to improve our understanding of the learning process. Sequential pattern mining (SPM), as a pattern recognition technique, has the potential to reveal the temporal…

Machine Learning · Computer Science 2023-05-02 Yingbin Zhang , Luc Paquette

Machine translation systems based on deep neural networks are expensive to train. Curriculum learning aims to address this issue by choosing the order in which samples are presented during training to help train better models faster. We…

Computation and Language · Computer Science 2018-11-05 Xuan Zhang , Gaurav Kumar , Huda Khayrallah , Kenton Murray , Jeremy Gwinnup , Marianna J Martindale , Paul McNamee , Kevin Duh , Marine Carpuat

Learning human preferences in language models remains fundamentally challenging, as reward modeling relies on subtle, subjective comparisons or shades of gray rather than clear-cut labels. This study investigates the limits of current…

Computation and Language · Computer Science 2026-04-03 Simona-Vasilica Oprea , Adela Bâra

We present a formal language for specifying qualitative preferences over temporal goals and a preference-based planning method in stochastic systems. Using automata-theoretic modeling, the proposed specification allows us to express…

Artificial Intelligence · Computer Science 2021-03-29 Jie Fu

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

Information Retrieval · Computer Science 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong

We present a novel preference learning framework to capture participant preferences efficiently within limited interaction rounds. It involves three main contributions. First, we develop a variational Bayesian approach to infer the…

Machine Learning · Computer Science 2025-03-20 Yan Wang , Jiapeng Liu , Milosz Kadziński , Xiuwu Liao

Effective teaching requires adapting instructional strategies to accommodate the diverse cognitive and behavioral profiles of students, a persistent challenge in education and teacher training. While Large Language Models (LLMs) offer…

Artificial Intelligence · Computer Science 2025-05-27 Debdeep Sanyal , Agniva Maiti , Umakanta Maharana , Dhruv Kumar , Ankur Mali , C. Lee Giles , Murari Mandal

Reinforcement learning is a general method for learning in sequential settings, but it can often be difficult to specify a good reward function when the task is complex. In these cases, preference feedback or expert demonstrations can be…

Machine Learning · Computer Science 2025-08-20 Jason R Brown , Carl Henrik Ek , Robert D Mullins

The effectiveness of Multimodal Chain-of-Thought (MCoT) prompting is often limited by the use of randomly or manually selected examples. These examples fail to account for both model-specific knowledge distributions and the intrinsic…

Computation and Language · Computer Science 2025-10-14 Xinglong Yang , Quan Feng , Zhongying Pan , Xiang Chen , Yu Tian , Wentong Li , Shuofei Qiao , Yuxia Geng , Xingyu Zhao , Sheng-Jun Huang

We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential…

Machine Learning · Computer Science 2019-12-10 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Data-driven predictive models are increasingly used in education to support students, instructors, and administrators. However, there are concerns about the fairness of the predictions and uses of these algorithmic systems. In this…

Computers and Society · Computer Science 2021-04-13 René F. Kizilcec , Hansol Lee

Intelligent Tutoring Systems often grant learners shared control over skill and problem selection. This choice brings motivational and metacognitive benefits. At the same time, past literature suggests that learners exhibit diverse…

Human-Computer Interaction · Computer Science 2026-05-26 Haley Noh , Aarna Chowdhary , Jeroen Ooge , Vincent Aleven , Conrad Borchers