English
Related papers

Related papers: Linear Causal Representation Learning by Topologic…

200 papers

Causal representation learning has emerged as the center of action in causal machine learning research. In particular, multi-domain datasets present a natural opportunity for showcasing the advantages of causal representation learning over…

Machine Learning · Computer Science 2023-12-12 Kartik Ahuja , Amin Mansouri , Yixin Wang

This paper presents a novel self-supervised learning method for handling conversational documents consisting of transcribed text of human-to-human conversations. One of the key technologies for understanding conversational documents is…

Computation and Language · Computer Science 2021-02-17 Ryo Masumura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

Class incremental learning (CIL) algorithms aim to continually learn new object classes from incrementally arriving data while not forgetting past learned classes. The common evaluation protocol for CIL algorithms is to measure the average…

Machine Learning · Computer Science 2024-06-26 Sungmin Cha , Jihwan Kwak , Dongsub Shim , Hyunwoo Kim , Moontae Lee , Honglak Lee , Taesup Moon

Representation learning is a key technique in modern machine learning that enables models to identify meaningful patterns in complex data. However, different methods tend to extract distinct aspects of the data, and relying on a single…

Machine Learning · Statistics 2025-09-30 Wenhui Li , Shijin Gong , Xinyu Zhang

Estimating individual-level treatment effect from observational data is a fundamental problem in causal inference and has attracted increasing attention in the fields of education, healthcare, and public policy.In this work, we concentrate…

Machine Learning · Computer Science 2025-07-10 Hui Meng , Keping Yang , Xuyu Peng , Bo Zheng

Network representation learning (NRL) advances the conventional graph mining of social networks, knowledge graphs, and complex biomedical and physics information networks. Over dozens of network representation learning algorithms have been…

Social and Information Networks · Computer Science 2021-10-15 Jingya Zhou , Ling Liu , Wenqi Wei , Jianxi Fan

We introduce Consistent Assignment for Representation Learning (CARL), an unsupervised learning method to learn visual representations by combining ideas from self-supervised contrastive learning and deep clustering. By viewing contrastive…

Machine Learning · Computer Science 2023-10-23 Thalles Silva , Adín Ramírez Rivera

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

Domain generalization (DG) is essentially an out-of-distribution problem, aiming to generalize the knowledge learned from multiple source domains to an unseen target domain. The mainstream is to leverage statistical models to model the…

Machine Learning · Computer Science 2022-03-29 Fangrui Lv , Jian Liang , Shuang Li , Bin Zang , Chi Harold Liu , Ziteng Wang , Di Liu

Decentralized learning has emerged as an alternative method to the popular parameter-server framework which suffers from high communication burden, single-point failure and scalability issues due to the need of a central server. However,…

Machine Learning · Computer Science 2023-12-19 Guojun Xiong , Gang Yan , Shiqiang Wang , Jian Li

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

Machine Learning · Computer Science 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh

Current Hierarchical Reinforcement Learning (HRL) algorithms excel in long-horizon sequential decision-making tasks but still face two challenges: delay effects and spurious correlations. To address them, we propose a causal HRL approach…

Machine Learning · Computer Science 2025-05-06 Chenran Zhao , Dianxi Shi , Mengzhu Wang , Jianqiang Xia , Huanhuan Yang , Songchang Jin , Shaowu Yang , Chunping Qiu

Causal reasoning (CR) is a crucial aspect of intelligence, essential for problem-solving, decision-making, and understanding the world. While language models (LMs) can generate rationales for their outputs, their ability to reliably perform…

Artificial Intelligence · Computer Science 2025-02-19 Longxuan Yu , Delin Chen , Siheng Xiong , Qingyang Wu , Qingzhen Liu , Dawei Li , Zhikai Chen , Xiaoze Liu , Liangming Pan

Discovering causal structures with latent variables from observational data is a fundamental challenge in causal discovery. Existing methods often rely on constraint-based, iterative discrete searches, limiting their scalability to large…

Machine Learning · Computer Science 2024-12-02 Parjanya Prashant , Ignavier Ng , Kun Zhang , Biwei Huang

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim

Causal graph recovery is traditionally done using statistical estimation-based methods or based on individual's knowledge about variables of interests. They often suffer from data collection biases and limitations of individuals' knowledge.…

Computation and Language · Computer Science 2024-06-19 Yuzhe Zhang , Yipeng Zhang , Yidong Gan , Lina Yao , Chen Wang

Contrastive Representation Learning (CRL) has achieved strong empirical success in multiple machine learning disciplines, yet its theoretical sample complexity remains poorly understood. Existing analyses usually assume that input tuples…

Machine Learning · Statistics 2026-05-29 Nong Minh Hieu , Antoine Ledent

Causal chain reasoning (CCR) is an essential ability for many decision-making AI systems, which requires the model to build reliable causal chains by connecting causal pairs. However, CCR suffers from two main transitive problems: threshold…

Artificial Intelligence · Computer Science 2024-11-15 Kai Xiong , Xiao Ding , Zhongyang Li , Li Du , Bing Qin , Yi Zheng , Baoxing Huai