English
Related papers

Related papers: Large-scale semi-supervised learning with online s…

200 papers

We introduce a method for sparsifying distributed algorithms and exhibit how it leads to improvements that go past known barriers in two algorithmic settings of large-scale graph processing: Massively Parallel Computation (MPC), and Local…

Data Structures and Algorithms · Computer Science 2018-07-18 Mohsen Ghaffari , Jara Uitto

We introduce a new notion of graph sparsificaiton based on spectral similarity of graph Laplacians: spectral sparsification requires that the Laplacian quadratic form of the sparsifier approximate that of the original. This is equivalent to…

Data Structures and Algorithms · Computer Science 2010-07-22 Daniel A. Spielman , Shang-Hua Teng

To effectively manage and utilize massive distributed data at the network edge, Federated Learning (FL) has emerged as a promising edge computing paradigm across data silos. However, FL still faces two challenges: system heterogeneity…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Jingjing Xue , Sheng Sun , Min Liu , Yuwei Wang , Zhuotao Liu , Jingyuan Wang

A sparsifier of a graph $G$ (Bencz\'ur and Karger; Spielman and Teng) is a sparse weighted subgraph $\tilde G$ that approximately retains the cut structure of $G$. For general graphs, non-trivial sparsification is possible only by using…

Data Structures and Algorithms · Computer Science 2019-05-07 Nikhil Bansal , Ola Svensson , Luca Trevisan

We present a sparse analogue to stochastic gradient descent that is guaranteed to perform well under similar conditions to the lasso. In the linear regression setup with irrepresentable noise features, our algorithm recovers the support set…

Statistics Theory · Mathematics 2014-12-16 Jacob Steinhardt , Stefan Wager , Percy Liang

We study $\textit{sparse singular value certificates}$ for random rectangular matrices. If $M$ is an $n \times d$ matrix with independent Gaussian entries, we give a new family of polynomial-time algorithms which can certify upper bounds on…

Data Structures and Algorithms · Computer Science 2024-12-31 Ilias Diakonikolas , Samuel B. Hopkins , Ankit Pensia , Stefan Tiegel

We present SemiOccam, an image recognition network that leverages semi-supervised learning in a highly efficient manner. Existing works often rely on complex training techniques and architectures, requiring hundreds of GPU hours for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Rui Yann , Tianshuo Zhang , Xianglei Xing

The textbook algorithm for real-weighted single-source shortest paths takes $O(mn)$ time on a graph with $m$ edges and $n$ vertices. A recent breakthrough algorithm by [Fin24] takes $\tilde{O}(mn^{8/9})$ randomized time. The running time…

Data Structures and Algorithms · Computer Science 2025-12-01 Kent Quanrud , Navid Tajkhorshid

Current AI/ML methods for data-driven engineering use models that are mostly trained offline. Such models can be expensive to build in terms of communication and computing cost, and they rely on data that is collected over extended periods…

Machine Learning · Computer Science 2021-12-16 Xiaoxuan Wang , Rolf Stadler

Crime has become a major concern in many cities, which calls for the rising demand for timely predicting citywide crime occurrence. Accurate crime prediction results are vital for the beforehand decision-making of government to alleviate…

Machine Learning · Computer Science 2022-08-19 Zhonghang Li , Chao Huang , Lianghao Xia , Yong Xu , Jian Pei

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

In the era of big data, methods for improving memory and computational efficiency have become crucial for successful deployment of technologies. Hashing is one of the most effective approaches to deal with computational limitations that…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Sobhan Hemati , Mohammad Hadi Mehdizavareh , Shojaeddin Chenouri , Hamid R Tizhoosh

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

Spectral hypergraph sparsification, an attempt to extend well-known spectral graph sparsification to hypergraphs, has been extensively studied over the past few years. For undirected hypergraphs, Kapralov, Krauthgamer, Tardos, and…

Data Structures and Algorithms · Computer Science 2023-05-12 Kazusato Oko , Shinsaku Sakaue , Shin-ichi Tanigawa

Graphs with heterophily, where adjacent nodes carry different labels, are prevalent in real-world applications, from social networks to molecular interactions. However, existing spectral Graph Neural Network (GNN) approaches tailored for…

Machine Learning · Computer Science 2026-05-13 Md Sazzad Hossen , Avimanyu Sahoo

In dictionary learning, also known as sparse coding, the algorithm is given samples of the form $y = Ax$ where $x\in \mathbb{R}^m$ is an unknown random sparse vector and $A$ is an unknown dictionary matrix in $\mathbb{R}^{n\times m}$…

Data Structures and Algorithms · Computer Science 2014-01-06 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

We present an efficient algorithm for simulating the time evolution due to a sparse Hamiltonian. In terms of the maximum degree d and dimension N of the space on which the Hamiltonian H acts for time t, this algorithm uses (d^2(d+log*…

Quantum Physics · Physics 2011-01-26 Andrew M. Childs , Robin Kothari

Image classification is a challenging problem for computer in reality. Large numbers of methods can achieve satisfying performances with sufficient labeled images. However, labeled images are still highly limited for certain image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Hongfeng Li

We propose two one-pass streaming algorithms for the $\mathcal{NP}$-hard hypergraph matching problem. The first algorithm stores a small subset of potential matching edges in a stack using dual variables to select edges. It has an…

Data Structures and Algorithms · Computer Science 2025-07-09 Henrik Reinstädtler , S M Ferdous , Alex Pothen , Bora Uçar , Christian Schulz

We consider the problem of data clustering with unidentified feature quality and when a small amount of labelled data is provided. An unsupervised sparse clustering method can be employed in order to detect the subgroup of features…

Machine Learning · Computer Science 2020-10-20 Avgoustinos Vouros , Eleni Vasilaki