中文
相关论文

相关论文: Oracle-Robust Online Alignment for Large Language …

200 篇论文

We propose a general solution approach for min-max-robust counterparts of combinatorial optimization problems with uncertain linear objectives. We focus on the discrete scenario case, but our approach can be extended to other types of…

最优化与控制 · 数学 2022-01-05 Enrico Bettiol , Christoph Buchheim , Marianna De Santis , Francesco Rinaldi

There are many methods and systems to tackle the ontology alignment problem, yet a major challenge persists in producing high-quality mappings among a set of input ontologies. Adopting a human-in-the-loop approach during the alignment…

In this paper, we study oracle-efficient algorithms for beyond worst-case analysis of online learning. We focus on two settings. First, the smoothed analysis setting of [RST11,HRS22] where an adversary is constrained to generating samples…

机器学习 · 计算机科学 2022-11-23 Nika Haghtalab , Yanjun Han , Abhishek Shetty , Kunhe Yang

We study \emph{online multicalibration}, a framework for ensuring calibrated predictions across multiple groups in adversarial settings, across $T$ rounds. Although online calibration is typically studied in the $\ell_1$ norm, prior…

机器学习 · 计算机科学 2025-05-30 Rohan Ghuge , Vidya Muthukumar , Sahil Singla

We consider the offline reinforcement learning (RL) setting where the agent aims to optimize the policy solely from the data without further environment interactions. In offline RL, the distributional shift becomes the primary source of…

机器学习 · 计算机科学 2021-06-22 Jongmin Lee , Wonseok Jeon , Byung-Jun Lee , Joelle Pineau , Kee-Eung Kim

With the increasing adoption of Large Language Models (LLMs), more customization is needed to ensure privacy-preserving and safe generation. We address this objective from two critical aspects: unlearning of sensitive information and…

机器学习 · 计算机科学 2025-10-17 Fatmazohra Rezkellah , Ramzi Dakhmouche

Large Vision-Language Models (LVLMs) often suffer from hallucinations, generating descriptions that include visual details absent from the input image. Recent preference alignment methods typically rely on supervision distilled from…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Minghui Chen , Chenxu Yang , Hengjie Zhu , Dayan Wu , Zheng Lin , Qingyi Si

Decision-focused learning (DFL) is an increasingly popular paradigm for training predictive models whose outputs are used in decision-making tasks. Instead of merely optimizing for predictive accuracy, DFL trains models to directly minimize…

Online optimization covers problems such as online resource allocation, online bipartite matching, adwords (a central problem in e-commerce and advertising), and adwords with separable concave returns. We analyze the worst case competitive…

数据结构与算法 · 计算机科学 2016-11-03 Reza Eghbali , Maryam Fazel

The vulnerability of Deep Neural Networks to Adversarial Attacks has fuelled research towards building robust models. While most Adversarial Training algorithms aim at defending attacks constrained within low magnitude Lp norm bounds,…

机器学习 · 计算机科学 2022-10-19 Sravanti Addepalli , Samyak Jain , Gaurang Sriramanan , R. Venkatesh Babu

We consider non-differentiable dynamic optimization problems such as those arising in robotics and subspace tracking. Given the computational constraints and the time-varying nature of the problem, a low-complexity algorithm is desirable,…

最优化与控制 · 数学 2019-02-20 Rishabh Dixit , Amrit Singh Bedi , Ruchi Tripathi , Ketan Rajawat

We investigate the finite-time analysis of finding ($\delta,\epsilon$)-stationary points for nonsmooth nonconvex objectives in decentralized stochastic optimization. A set of agents aim at minimizing a global function using only their local…

最优化与控制 · 数学 2024-06-04 Emre Sahinoglu , Shahin Shahrampour

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

计算与语言 · 计算机科学 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth

While Large Language Models (LLMs) demonstrate remarkable reasoning, complex optimization tasks remain challenging, requiring domain knowledge and robust implementation. However, existing benchmarks focus narrowly on Mathematical…

计算与语言 · 计算机科学 2026-04-24 Xinyu Zhang , Boxuan Zhang , Yuchen Wan , Lingling Zhang , YiXing Yao , Bifan Wei , Yaqiang Wu , Jun Liu

Online Set Cover and Load Balancing are central problems in online optimization, and there is a long line of work on developing algorithms for these problems with convex objectives. Although we know optimal online algorithms with…

数据结构与算法 · 计算机科学 2025-08-27 Thomas Kesselheim , Marco Molinaro , Kalen Patton , Sahil Singla

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

机器学习 · 计算机科学 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

We study the Online Traveling Salesperson Problem (OLTSP) with predictions. In OLTSP, a sequence of initially unknown requests arrive over time at points (locations) of a metric space. The goal is, starting from a particular point of the…

数据结构与算法 · 计算机科学 2023-05-04 Evripidis Bampis , Bruno Escoffier , Themis Gouleakis , Niklas Hahn , Kostas Lakis , Golnoosh Shahkarami , Michalis Xefteris

Alignment is a crucial step to enhance the instruction-following and conversational abilities of language models. Despite many recent work proposing new algorithms, datasets, and training pipelines, there is a lack of comprehensive studies…

计算与语言 · 计算机科学 2024-10-04 Xiao Yu , Qingyang Wu , Yu Li , Zhou Yu

We revisit multi-agent asynchronous online optimization with delays, where only one of the agents becomes active for making the decision at each round, and the corresponding feedback is received by all the agents after unknown delays.…

机器学习 · 计算机科学 2026-02-05 Lingchan Bao , Tong Wei , Yuanyu Wan

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

信息检索 · 计算机科学 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu