中文
相关论文

相关论文: Test-Time Adaptation for Unsupervised Combinatoria…

200 篇论文

The hardness of combinatorial optimization (CO) problems hinders collecting solutions for supervised learning. However, learning neural networks for CO problems is notoriously difficult in lack of the labeled data as the training is easily…

机器学习 · 计算机科学 2022-07-26 Haoran Sun , Etash K. Guha , Hanjun Dai

Large reasoning models have achieved remarkable performance through extended chain-of-thought sequences, yet this computational freedom leads to excessive token generation even for simple problems. We present Length-Adaptive Policy…

人工智能 · 计算机科学 2025-08-15 Xingyu Wu , Yuchen Yan , Shangke Lyu , Linjuan Wu , Yiwen Qiu , Yongliang Shen , Weiming Lu , Jian Shao , Jun Xiao , Yueting Zhuang

Relevant combinatorial optimization problems (COPs) are often NP-hard. While they have been tackled mainly via handcrafted heuristics in the past, advances in neural networks have motivated the development of general methods to learn…

机器学习 · 计算机科学 2025-09-05 Tim Dernedde , Daniela Thyssens , Sören Dittrich , Maximilian Stubbemann , Lars Schmidt-Thieme

From CNNs to attention mechanisms, encoding inductive biases into neural networks has been a fruitful source of improvement in machine learning. Adding auxiliary losses to the main objective function is a general way of encoding biases that…

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

机器学习 · 计算机科学 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Representation learning is a fundamental aspect of modern artificial intelligence, driving substantial improvements across diverse applications. While selfsupervised contrastive learning has led to significant advancements in fields like…

Handling communication overhead in large-scale tensor-parallel training remains a critical challenge due to the dense, near-zero distributions of intermediate tensors, which exacerbate errors under frequent communication and introduce…

分布式、并行与集群计算 · 计算机科学 2026-04-28 Man Liu , Xingchen Liu , Xingjian Tian , Bing Lu , Shengkay Lyu , Shengquan Yin , Wenjing Huang , Zheng Wei , Hairui Zhao , Guangming Tan , Dingwen Tao

Data-driven approaches to predict-then-optimize decision-making problems seek to mitigate the risk of uncertainty region misspecification in safety-critical settings. Current approaches, however, suffer from considering overly conservative…

统计方法学 · 统计学 2023-10-17 Yash Patel , Sahana Rayan , Ambuj Tewari

Neural models have shown promise in solving NP-hard graph combinatorial optimization (CO) problems. Once trained, they offer fast inference and reasonably high-quality solutions for in-distribution testing instances, but they generally fall…

机器学习 · 计算机科学 2025-11-26 Jialiang Li , Weitong Chen , Mingyu Guo

Modern learning systems increasingly rely on amortized learning - the idea of reusing computation or inductive biases shared across tasks to enable rapid generalization to novel problems. This principle spans a range of approaches,…

机器学习 · 计算机科学 2025-10-14 Sarthak Mittal , Divyat Mahajan , Guillaume Lajoie , Mohammad Pezeshki

Leveraging temporal information has been regarded as essential for developing video understanding models. However, how to properly incorporate temporal information into the recent successful instance discrimination based contrastive…

计算机视觉与模式识别 · 计算机科学 2020-11-30 Yutong Bai , Haoqi Fan , Ishan Misra , Ganesh Venkatesh , Yongyi Lu , Yuyin Zhou , Qihang Yu , Vikas Chandra , Alan Yuille

Recent advances in large language models (LLMs) have popularized test-time scaling, where models generate additional reasoning tokens before producing final answers. These approaches have demonstrated significant performance improvements on…

人工智能 · 计算机科学 2026-01-13 Wenxun Wu , Yuanyang Li , Guhan Chen , Linyue Wang , Hongyang Chen

Instance contrast for unsupervised representation learning has achieved great success in recent years. In this work, we explore the idea of instance contrastive learning in unsupervised domain adaptation (UDA) and propose a novel Category…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu , Ling Shao

Training state-of-the-art vision models has become prohibitively expensive for researchers and practitioners. For the sake of accessibility and resource reuse, it is important to focus on adapting these models to a variety of downstream…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Malik Boudiaf , Romain Mueller , Ismail Ben Ayed , Luca Bertinetto

Several recent unsupervised learning methods use probabilistic approaches to solve combinatorial optimization (CO) problems based on the assumption of statistically independent solution variables. We demonstrate that this assumption imposes…

机器学习 · 计算机科学 2023-11-27 Sebastian Sanokowski , Wilhelm Berghammer , Sepp Hochreiter , Sebastian Lehner

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

机器学习 · 计算机科学 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast but may sacrifice the…

机器学习 · 计算机科学 2021-10-26 Runzhong Wang , Zhigang Hua , Gan Liu , Jiayi Zhang , Junchi Yan , Feng Qi , Shuang Yang , Jun Zhou , Xiaokang Yang

In this work, we propose a meta-learning-based Koopman modeling and predictive control approach for nonlinear systems with parametric uncertainties. An adaptive deep meta-learning-based modeling approach, called Meta Adaptive Koopman…

系统与控制 · 电气工程与系统科学 2025-12-01 Minghao Han , Kiwan Wong , Adrian Wing-Keung Law , Xunyuan Yin

Combinatorial optimization (CO) is fundamental to several real-world applications, from logistics and scheduling to hardware design and resource allocation. Deep reinforcement learning (RL) has recently shown significant benefits in solving…

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

机器学习 · 计算机科学 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng