English
Related papers

Related papers: CAMBranch: Contrastive Learning with Augmented MIL…

200 papers

As LLMs evolve, significant effort is spent on manually crafting prompts. While existing prompt optimization methods automate this process, they rely solely on learning from incorrect samples, leading to a sub-optimal performance.…

Computation and Language · Computer Science 2024-09-24 Mingqi Li , Karan Aggarwal , Yong Xie , Aitzaz Ahmad , Stephen Lau

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

Data augmentation has been proven effective for training high-accuracy convolutional neural network classifiers by preventing overfitting. However, building deep neural networks in real-world scenarios requires not only high accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Zhenglin Huang , Xiaoan Bao , Na Zhang , Qingqi Zhang , Xiaomei Tu , Biao Wu , Xi Yang

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Representation learning has been evolving from traditional supervised training to Contrastive Learning (CL) and Masked Image Modeling (MIM). Previous works have demonstrated their pros and cons in specific scenarios, i.e., CL and supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Bowen Shi , Xiaopeng Zhang , Yaoming Wang , Jin Li , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

For mixed-integer programs (MIPs), strong branching is a highly effective variable selection method to reduce the number of nodes in the branch-and-bound algorithm. Extending it to nonlinear problems is conceptually simple but practically…

Optimization and Control · Mathematics 2025-10-24 Santanu S. Dey , Dahye Han , Yang Wang

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Contrastive learning (CL) has been successful as a powerful representation learning method. In this work we propose CLIM: Contrastive Learning with mutual Information Maximization, to explore the potential of CL on cross-domain sentiment…

Computation and Language · Computer Science 2020-11-13 Tian Li , Xiang Chen , Shanghang Zhang , Zhen Dong , Kurt Keutzer

State-of-the-art Mixed Integer Linear Program (MILP) solvers combine systematic tree search with a plethora of hard-coded heuristics, such as the branching rule. The idea of learning branching rules from data has received increasing…

Machine Learning · Computer Science 2022-10-14 Lara Scavuzzo , Feng Yang Chen , Didier Chételat , Maxime Gasse , Andrea Lodi , Neil Yorke-Smith , Karen Aardal

With the rapid advancement of multi-modal large language models (MLLMs) in recent years, the foundational Contrastive Language-Image Pretraining (CLIP) framework has been successfully extended to MLLMs, enabling more powerful and universal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Youze Xue , Dian Li , Gang Liu

Mixed-Integer Linear Programming (MILP) is a foundational tool for complex decision-making problems. However, the NP-hard nature of MILP presents a significant computational challenge, motivating the development of machine learning-based…

Optimization and Control · Mathematics 2026-03-03 Hongpei Li , Hui Yuan , Han Zhang , Jianghao Lin , Dongdong Ge , Mengdi Wang , Yinyu Ye

Mixed-integer linear programming (MILP) is one of the most popular mathematical formulations with numerous applications. In practice, improving the performance of MILP solvers often requires a large amount of high-quality data, which can be…

Machine Learning · Computer Science 2024-11-01 Haoyang Liu , Jie Wang , Wanbo Zhang , Zijie Geng , Yufei Kuang , Xijun Li , Bin Li , Yongdong Zhang , Feng Wu

Multi-prompt learning methods have emerged as an effective approach for facilitating the rapid adaptation of vision-language models to downstream tasks with limited resources. Existing multi-prompt learning methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Fei Song , Yi Li , Jiangmeng Li , Rui Wang , Changwen Zheng , Fanjiang Xu , Hui Xiong

By exploiting the correlation between the structure and the solution of Mixed-Integer Linear Programming (MILP), Machine Learning (ML) has become a promising method for solving large-scale MILP problems. Existing ML-based MILP solvers…

Machine Learning · Computer Science 2025-01-03 Yixuan Li , Can Chen , Jiajun Li , Jiahui Duan , Xiongwei Han , Tao Zhong , Vincent Chau , Weiwei Wu , Wanyuan Wang

Recently, large language models (LLMs) have emerged as a groundbreaking technology and their unparalleled text generation capabilities have sparked interest in their application to the fundamental sentence representation learning task.…

Computation and Language · Computer Science 2024-05-20 Huiming Wang , Zhaodonghui Li , Liying Cheng , Soh De Wen , Lidong Bing

Mixed-Integer Linear Programming (MILP) is a fundamental and powerful framework for modeling complex optimization problems across diverse domains. Recently, learning-based methods have shown great promise in accelerating MILP solvers by…

Machine Learning · Computer Science 2025-11-05 Tianle Pu , Zijie Geng , Haoyang Liu , Shixuan Liu , Jie Wang , Li Zeng , Chao Chen , Changjun Fan

Previous deep learning approaches for survival analysis have primarily relied on ranking losses to improve discrimination performance, which often comes at the expense of calibration performance. To address such an issue, we propose a novel…

Machine Learning · Computer Science 2024-11-22 Dongjoon Lee , Hyeryn Park , Changhee Lee

It is common to address the curse of dimensionality in Markov decision processes (MDPs) by exploiting low-rank representations. This motivates much of the recent theoretical study on linear MDPs. However, most approaches require a given…

Machine Learning · Computer Science 2022-12-09 Tianjun Zhang , Tongzheng Ren , Mengjiao Yang , Joseph E. Gonzalez , Dale Schuurmans , Bo Dai

Large Language Models (LLMs) adapted via contrastive learning excel in general representation learning but struggle in vertical domains like chemistry and law, primarily due to a lack of domain-specific knowledge. This work identifies a…

Information Retrieval · Computer Science 2026-01-19 Xiaoyu Liang , Yuchen Peng , Jiale Luo , Wenhao Wang , Haoji Hu , Xincheng Zhou