Joe Neeman

Spectral redemption in clustering sparse networks

Significance Spectral algorithms are widely applied to data clustering problems, including finding communities or partitions in graphs and networks. We propose a way of encoding sparse data using a “nonbacktracking” matrix, and show that the corresponding spectral algorithm performs optimally for some popular generative models, including the stochastic block model. This is in contrast with classical spectral algorithms, based on the adjacency matrix, random walk matrix, and graph Laplacian, which perform poorly in the sparse case, failing significantly above a recently discovered phase transition for the detectability of communities. Further support for the method is provided by experiments on real networks as well as by theoretical arguments and analogies from probability theory, statistical physics, and the theory of random matrices. Spectral algorithms are classic approaches to clustering and community detection in networks. However, for sparse networks the standard versions of these algorithms are suboptimal, in some cases completely failing to detect communities even when other algorithms such as belief propagation can do so. Here, we present a class of spectral algorithms based on a nonbacktracking walk on the directed edges of the graph. The spectrum of this operator is much better-behaved than that of the adjacency matrix or other commonly used matrices, maintaining a strong separation between the bulk eigenvalues and the eigenvalues relevant to community structure even in the sparse case. We show that our algorithm is optimal for graphs generated by the stochastic block model, detecting communities all of the way down to the theoretical limit. We also show the spectrum of the nonbacktracking operator for some real-world networks, illustrating its advantages over traditional spectral clustering.

Regularization in kernel learning

Supported in part by Australian Research Council Discovery Grant DP0559465 and by Israel Science Foundation Grant 666/06.

Belief propagation, robust reconstruction and optimal recovery of block models.

We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities a=n and b=n for inter- and intra-block edge probabilities respectively. It was recently shown that one can do better than a random guess if and only if (a b) 2 > 2(a + b). Using a variant of Belief Propagation, we give a reconstruction algorithm that is optimal in the sense that if (a b) 2 > C(a + b) for some constant C then our algorithm maximizes the fraction of the nodes labelled correctly. Along the way we prove some results of independent interest regarding robust reconstruction for the Ising model on regular and Poisson trees.

Majority dynamics and aggregation of information in social networks

Consider

Standard Simplices and Pluralities are Not the Most Noise Stable

n

On Extracting Common Random Bits From Correlated Sources on Large Alphabets

n individuals who, by popular vote, choose among

Noise stability and correlation with half spaces

q \ge 2