English
Related papers

Related papers: A Theory of General Difference in Continuous and D…

200 papers

Domain Generalized Semantic Segmentation (DGSS) seeks to utilize source domain data exclusively to enhance the generalization of semantic segmentation across unknown target domains. Prevailing studies predominantly concentrate on feature…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hongwei Niu , Linhuang Xie , Jianghang Lin , Shengchuan Zhang

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

Stochastic gradient descent (SGD) performed in an asynchronous manner plays a crucial role in training large-scale machine learning models. However, the generalization performance of asynchronous delayed SGD, which is an essential metric…

Machine Learning · Computer Science 2025-05-27 Xiaoge Deng , Li Shen , Shengwei Li , Tao Sun , Dongsheng Li , Dacheng Tao

We present a novel set of rigorous and computationally efficient topology-based complexity notions that exhibit a strong correlation with the generalization gap in modern deep neural networks (DNNs). DNNs show remarkable generalization…

Machine Learning · Computer Science 2024-12-17 Rayna Andreeva , Benjamin Dupuis , Rik Sarkar , Tolga Birdal , Umut Şimşekli

Generalized Class Discovery (GCD) clusters base and novel classes in a target domain using supervision from a source domain with only base classes. Current methods often falter with distribution shifts and typically require access to target…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Vaibhav Rathore , Shubhranil B , Saikat Dutta , Sarthak Mehrotra , Zsolt Kira , Biplab Banerjee

Recent research on the time-domain audio separation networks (TasNets) has brought great success to speech separation. Nevertheless, conventional TasNets struggle to satisfy the memory and latency constraints in industrial applications. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-14 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

Anomaly detection in complex, high-dimensional data, such as UAV sensor readings, is essential for operational safety but challenging for existing methods due to their limited sensitivity, scalability, and inability to capture intricate…

Machine Learning · Computer Science 2025-10-28 Mingze Gong , Juan Du , Jianbang You

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

While continuous diffusion has shown remarkable success in continuous domains such as image generation, its direct application to discrete data has underperformed compared to purely discrete formulations. This gap is counterintuitive, given…

Machine Learning · Computer Science 2025-10-30 Patrick Pynadath , Jiaxin Shi , Ruqi Zhang

There exists a well established differential topological theory of singularities of ordinary differential equations. It has mainly studied scalar equations of low order. We propose an extension of the key concepts to arbitrary systems of…

Commutative Algebra · Mathematics 2021-03-12 Markus Lange-Hegermann , Daniel Robertz , Werner M. Seiler , Matthias Seiss

This paper presents an analysis of properties of two hybrid discretization methods for Gaussian derivatives, based on convolutions with either the normalized sampled Gaussian kernel or the integrated Gaussian kernel followed by central…

Numerical Analysis · Mathematics 2025-01-31 Tony Lindeberg

Generic event boundary detection (GEBD) aims to identify natural boundaries in a video, segmenting it into distinct and meaningful chunks. Despite the inherent subjectivity of event boundaries, previous methods have focused on deterministic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jaejun Hwang , Dayoung Gong , Manjin Kim , Minsu Cho

Temporal difference learning (TD) is a simple iterative algorithm used to estimate the value function corresponding to a given policy in a Markov decision process. Although TD is one of the most widely used algorithms in reinforcement…

Machine Learning · Computer Science 2018-11-07 Jalaj Bhandari , Daniel Russo , Raghav Singal

While state-of-the-art language models achieve impressive results through next-token prediction, they have inherent limitations such as the inability to revise already generated tokens. This has prompted exploration of alternative…

Computation and Language · Computer Science 2025-06-10 Dimitri von Rütte , Janis Fluri , Yuhui Ding , Antonio Orvieto , Bernhard Schölkopf , Thomas Hofmann

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

Machine Learning · Computer Science 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

The emergence of 3D artificial intelligence-generated content (3D-AIGC) has enabled rapid synthesis of intricate geometries. However, a fundamental disconnect persists between AI-generated content and human-centric design paradigms, rooted…

Graphics · Computer Science 2025-08-29 Xiaoyang Huang , Bingbing Ni , Wenjun Zhang

Domain Generalization (DG) techniques have emerged as a popular approach to address the challenges of domain shift in Deep Learning (DL), with the goal of generalizing well to the target domain unseen during the training. In recent years,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Aveen Dayal , Vimal K. B. , Linga Reddy Cenkeramaddi , C. Krishna Mohan , Abhinav Kumar , Vineeth N Balasubramanian

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains. Data augmentation approaches have emerged as a promising alternative for DG. However,…

Machine Learning · Computer Science 2020-12-29 Hoang Son Le , Rini Akmeliawati , Gustavo Carneiro

Semantic segmentation in 3D indoor scenes has achieved remarkable performance under the supervision of large-scale annotated data. However, previous works rely on the assumption that the training and testing data are of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Yuyang Zhao , Na Zhao , Gim Hee Lee

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen