Partial Recovery of Erdős-Rényi Graph Alignment via $k$-Core Alignment

A binary relation $\mu\subseteq\mathcal{U}_{a}\times\mathcal{U}_{b}$ is a matching if each $i\in\mathcal{U}_{a}$ and $j\in\mathcal{U}_{b}$ appears in at most one pair in $\mu$. Define the functions $\alpha:2^{\mathcal{U}_{a}\times\mathcal{U}_{b}}\to 2^{\mathcal{U}_{a}}$ and $\beta:2^{\mathcal{U}_{a}\times\mathcal{U}_{b}}\to 2^{\mathcal{U}_{b}}$ that find the left and right support of a binary relation:

A matching $\mu\subseteq\mathcal{U}_{a}\times\mathcal{U}_{b}$ is a bijection if $\alpha(\mu)=\mathcal{U}_{a}$ and $\beta(\mu)=\mathcal{U}_{b}$.

Let $\wedge$ be the minimum or “and” binary operator on $\{0,1\}$. Let $[n]$ denote the set $\{0,\cdots,n-1\}$. For a set $\mathcal{U}$, let $\binom{\mathcal{U}}{2}$ be the set of unordered pairs of elements of $\mathcal{U}$. Represent a labeled graph on a vertex set $\mathcal{U}$ by its edge indicator function $G:\binom{\mathcal{U}}{2}\to[2]$. For a graph $G$, let $V(G)$ and $E(G)$ be the vertex and edge sets respectively. Throughout, we use boldface letters for random objects and lightface letters for fixed objects.

The correlated Erdős-Rényi graph model has been used in much of the work on alignment recovery for random graphs, beginning with Pedarsani and Grossglauser [2]. The idea is simple: we have two graphs $G_{a}$ and $G_{b}$ whose marginal distributions are Erdős-Rényi . Under the true vertex matching, each edge random variable in $G_{a}$ is aligned with some edge random variable in $G_{b}$. These aligned pairs of edge random variables have some joint distribution and this is the only source of correlation between the graphs.

To formalize this, we need the following definition.

Because $l(\mu)$ is a matching, each $w_{a}\in\binom{\mathcal{U}_{a}}{2}$ appears in exactly one pair $(w_{a},w_{b})\in l(\mu)$. For a pair $(w_{a},w_{b})\not\in\ell(\mu)$, $G_{a}(w_{a})$ is independent of $G_{b}(w_{b})$.

If $p_{11}p_{00}>p_{10}p_{01}$, then these distributions have positive correlation. We will only consider positively correlated graphs in this paper.

We consider the following estimation problem. Let $|\mathcal{U}_{a}|=|\mathcal{U}_{b}|=n$ and let $\bm{\mu}$ be a uniformly random bijection between $\mathcal{U}_{a}$ and $\mathcal{U}_{b}$. Let $(\mathbf{G}_{a},\mathbf{G}_{b})\sim\operatorname{ER}(\bm{\mu},p)$.

The most stringent recovery requirement, $\hat{\bm{\mu}}=\bm{\mu}$ or exact recovery, was addressed by Cullina and Kiyavash [3]. Their precise results are discussed in Section 1.5. In that case, there is a clear definition of the optimal estimator: the maximum a posteriori (MAP) estimator: $\hat{\bm{\mu}}(G_{a},G_{b})=\argmax_{\hat{\mu}}\Pr[\bm{\mu}=\hat{\mu}|\mathbf{G}_{a}=G_{a},\mathbf{G}_{b}=G_{b}]$. Because $\bm{\mu}$ has a uniform distribution, by Bayes theorem $\hat{\bm{\mu}}(G_{a},G_{b})=\argmax_{\hat{\mu}}\Pr[\mathbf{G}_{a}=G_{a},\mathbf{G}_{b}=G_{b}|\bm{\mu}=\hat{\mu}]$.

This estimator is closely related to the aligned intersection of a pair of graphs. Let $G_{a}$ and $G_{b}$ be graphs and let $\mu$ be a matching between their vertex sets. Then $\mu$ provides an alignment of the subgraphs $G_{a}[\alpha(\mu)]$ and $G_{b}[\beta(\mu)]$. Using this alignment, we can compute the intersection of these two subgraphs. The natural vertex set for this intersection graph is $\mu$. We formalize this construction as follows.

Cullina and Kiyavash [4] observed that for a bijection $\mu$,

where the constant of proportionality depends on $G_{a}$ and $G_{b}$ but not on $\mu$. Thus, in the case of positive correlation, the MAP estimator is $\hat{\bm{\mu}}(G_{a},G_{b})=\argmax_{\hat{\mu}}|E(G_{a}\wedge_{\hat{\mu}}G_{b})|$.

Herein we consider partial recovery of $\bm{\mu}$ using $(\mathbf{G}_{a},\mathbf{G}_{b})$, which is interesting when exact recovery is impossible. In particular, we would like to match some of the vertices of $\mathbf{G}_{a}$ to the corresponding vertices in $\mathbf{G}_{b}$ without any errors. This means that we want an estimator $\hat{\bm{\mu}}$ such that $\hat{\bm{\mu}}\subseteq\bm{\mu}$ and $|\hat{\bm{\mu}}|$ is as large as possible. We are interested in estimators that satisfy these conditions with probability $1-o(1)$.

For a partial matching $\mu^{\prime}$,

There are two natural generalization of the MAP estimator for partial recovery. The first fixes $n^{\prime}$, the size of the estimated matching, and selects $\hat{\mu}$ that maximizes $\Pr[\bm{\mu}\supseteq\hat{\mu}|\mathbf{G}_{a}=G_{a},\mathbf{G}_{b}=G_{b}]$. The second fixes $\epsilon$, an error budget, and selects a $\hat{\mu}$ satisfying $\Pr[\bm{\mu}\supseteq\hat{\mu}|\mathbf{G}_{a}=G_{a},\mathbf{G}_{b}=G_{b}]\geq 1-\epsilon$ and maximizing $|\hat{\mu}|$. Neither of these are particularly straightforward to analyze, so we introduce the $k$-core alignment estimator.

Let $\delta(G)$ be the minimum degree of $G$ and for $S\subseteq V(G)$, let $G[S]$ be the subgraph of $G$ induced by $S$. We adopt the convention that for the null graph, i.e. $G$ such that $V(G)=\varnothing$, $\delta(G)=\infty$. Thus there is always some $S\subseteq V(G)$ such that $\delta(G[S])\geq k$. If $\delta(G[S])\geq k$ and $\delta(G[S^{\prime}])\geq k$, then $\delta(G[S\cup S^{\prime}])\geq k$. Thus there is a unique maximum among the sets that induce subgraphs with minimum degree at least $k$. The subgraph induced by this set is the $k$-core of $G$ [28]. ¹¹ 1 When every nonempty induced subgraph of a graph $G$ has a minimum degree less than $k$, some authors say that the $k$-core does not exist. In this case the $k$-core of $G$ is the null graph under our convention.

We introduce the following related notion.

Figure 1 illustrates the concepts of aligned intersection and $k$-core alignment.

We have the following results about the performance of the $k$-core alignment estimator.

Section 2 contains the proof. The main condition of Theorem 1, (1), requires $\mathbf{G}_{a}\wedge_{\bm{\mu}}\mathbf{G}_{b}$ to have an average degree that grows with $n$. Condition (2) is very mild sparsity constraint on $\mathbf{G}_{a}\wedge_{\bm{\mu}}\mathbf{G}_{b}$. Condition (3) requires $\mathbf{G}_{a}$ and $\mathbf{G}_{b}$ to have sufficient positive correlation and to be mildly sparse.

Section 3 contains the proof. Observe that the condition (4) matches (1). Condition (5) is weaker than than (3): the converse is valid for any amount of positive correlation.

For the exact recovery problem, Cullina and Kiyavash [3] showed that if $p$ satisfies the conditions

then the maximum a posteriori estimator for $\bm{\mu}$ given $(\mathbf{G}_{a},\mathbf{G}_{b})$ is correct with probability $1-o(1)$. Additionally, if $\mathbf{p}$ satisfies

then any estimator for for $\bm{\mu}$ given $(\mathbf{G}_{a},\mathbf{G}_{b})$ is correct with probability $o(1)$. In other words, exact recovery of $\bm{\mu}$ requires logarithmic average degree in the intersection graph while recovery of almost all of $\bm{\mu}$ requires only a growing average degree.

The aligned intersection of $G_{a}$ and $G_{b}$ has another interpretation. Let $G_{a}\times G_{b}$ be the tensor product of $G_{a}$ and $G_{b}$. This is the graph with $V(G_{a}\times G_{b})=V(G_{a})\times V(G_{b})$ and

In other words, the adjacency matrix of $G_{a}\times G_{b}$ is the tensor product of the adjacency matrices of $G_{a}$ and $G_{b}$. Then $G_{a}\wedge_{\mu}G_{b}=(G_{a}\times G_{b})[\mu]$.

From this point of view, exact recovery of $\bm{\mu}$ corresponds to finding a dense $n$-vertex subgraph inside the $n^{2}$-vertex graph $G_{a}\times G_{b}$. This looks superficially like recovering a single dense community is a stochastic block model, a problem which has been extensively studied. There are two important differences. First, we only need to search over subgraphs induced by matchings, not all $n$-vertex subgraphs. This does not significantly reduce the total number of candidate subgraphs, but it has a bigger effect on the number of subgraphs that are nearly equal to the true matching. Second, the edge random variables in $G_{a}\times G_{b}$ are not jointly independent. Because of this, bounding the probability of each error event requires some care.

The fact the we are searching for a subgraph of size $\sqrt{|V(G_{a}\times G_{b})|}$ has potential implications for the computational tractability of this problem due to the planted clique hypothesis [27] and associated conditional hardness results for planted dense subgraph problems. However, in this paper, we focus only on information-theoretic thresholds.

Note that the $k$-core alignment of $G_{a}$ and $G_{b}$ is not the $k$-core of $G_{a}\times G_{b}$, which in general will be much larger and not induced by a matching.

Our achievability proof has the following structure. First, we need to show that the true alignment of $\mathbf{G}_{a}$ and $\mathbf{G}_{b}$ yields a large $k$-core alignment. This follows easily from known results about the $k$-core of an Erdős-Rényi graph. The majority of our work is devoted to the second task: showing that this is the only $k$-core alignment. For each matching $\mu\not\subseteq\mu^{*}$, we need to bound the probability that it is a $k$-core alignment of $G_{a}$ and $G_{b}$. A large number of matchings can be immediately ruled by the maximality part of the definition of $k$-core alignment. We define an error event for each of the remaining matching and use a union bound over them. There are exponentially many of these error events, so it is crucial that our bound on error probability depends on the distance between the imposter matching and the true matching. This part of the argument is in Section 2.1 and is summarized in Lemma 1.

In order for $\mu$ to be a $k$-core alignment, each vertex in $\mathbf{G}_{a}\wedge_{\mu}\mathbf{G}_{b}$ must have degree at least $k$. This is much more difficult for vertices in $\mu$ that do not appear in the true matching $\mu^{*}$. To bound the probability that $\mu$ is a $k$-core alignment, we consider the sum of the degrees of the vertices in $\mu\setminus\mu^{*}$.

The main technical task is to obtain large deviations upper bounds for these sum-of-degrees random variables. Each of these random variables is the sum of many correlated indicator random variables. To obtain tight bounds, we take advantage of the structure of the correlation by analyzing the cycle-path decomposition of the imposter matching relative to the true matching. This decomposition is explained in Section 2.2. In Lemma 2, whose proof is in Appendix A, we bound the generating function for the sum-of-degrees random variable using combinatorial arguments. This allows us to find conditions under which the tails of their distributions behave like the tails of Poisson random variables.

Our converse proof is based on the concept of list estimation or list decoding. It has two main components. First, we find a relationship between the number of automorphisms of $\mathbf{G}_{a}\wedge_{\bm{\mu}}\mathbf{G}_{b}$ and the list length for any list estimator that succeeds with high probability. Second, we use the fact that sufficiently sparse Erdős-Rényi graphs have many isolated vertices to obtain a lower bound on the number of automorphisms of $\mathbf{G}_{a}\wedge_{\bm{\mu}}\mathbf{G}_{b}$.

The property discussed at the start of Section 1.4 that leads to the uniqueness of the $k$-core has the following analogue for $k$-core alignments. If $\delta(G_{a}\wedge_{\mu}G_{b})\geq k$, $\delta(G_{a}\wedge_{\mu^{\prime}}G_{b})\geq k$, and $\mu\cup\mu^{\prime}$ is a matching, then $\delta(G_{a}\wedge_{\mu\cup\mu^{\prime}}G_{b})\geq k$. The graphs $G_{\mu}$ and $G_{\mu^{\prime}}$ are induced subgraphs of $G_{(\mu\cup\mu^{\prime})}$. Thus each vertex in $G_{(\mu\cup\mu^{\prime})}$ has a degree that is at least as large as its degree in the subgraph.

Because $\mu\cup\mu^{\prime}$ is not guaranteed to be a matching, there may be more than one $k$-core alignment of $G_{a}$ and $G_{b}$. For example, if both $G_{a}$ and $G_{b}$ are complete graphs with $n$ vertices, every bijection between $V(G_{a})$ and $V(G_{b})$ is an $n$-core alignment.

The $k$-core alignment estimator can make an error when some matching other than $\bm{\mu}$ is a $k$-core alignment. To analyze this event, we introduce weak $k$-core alignments.

Observe that if $\mu$ is a $k$-core alignment of $G_{a}$ and $G_{b}$, then it is also a weak $k$-core alignment of $G_{a}$ and $G_{b}$ relative to any matching $\mu^{*}$. We have relaxed the property in two ways: first by only checking the vertices that are matched differently in $\mu$ than in $\mu^{*}$ and second by checking the average degree of these vertices rather than the minimum.

All $\mu\subseteq\mu^{*}$ are trivially weak $k$-core alignments relative to $\mu^{*}$ (the sum is empty). We will show that under certain conditions, every weak $k$-core alignment of $\mathbf{G}_{a}$ and $\mathbf{G}_{b}$ relative to $\bm{\mu}$ is a subset of $\bm{\mu}$.

This property allows us to show that a large number of matchings cannot be $k$-core alignments of $(\mathbf{G}_{a},\mathbf{G}_{b})$ because they are not $\bm{\mu}$-maximal. If it is possible to add any pairs from the true matching $\bm{\mu}$ to $\mu$, then $\hat{\bm{\mu}}_{k}\neq\mu$.

The following lemma allows us to bound the probability of error of the $k$-core alignment estimator.

Given two matchings $\mu,\mu^{\prime}\subseteq\mathcal{U}_{a}\times\mathcal{U}_{b}$, let $(\mu+\mu^{\prime}):\mathcal{U}_{a}\times\mathcal{U}_{b}\to\mathbb{N}$ be the multisubset of $\mathcal{U}_{a}\times\mathcal{U}_{b}$ in which the multiplicity of each element is the sum of its multiplicity in $\mu$ and its multiplicity in $\mu^{\prime}$. In the bipartite multigraph $(\mathcal{U}_{a},\mathcal{U}_{b},\mu+\mu^{\prime})$, all vertices have degree $0$, $1$, or $2$, so the multigraph is the union of paths and even-length cycles (including cycles of length two, which are pairs of parallel edges). More precisely, the degree of $u_{a}\in\mathcal{U}_{a}$ is $\mathbbm{1}(u_{a}\in\alpha(\mu))+\mathbbm{1}(u_{a}\in\alpha(\mu^{\prime}))$ and the degree of $u_{b}\in\mathcal{U}_{b}$ is $\mathbbm{1}(u_{b}\in\beta(\mu))+\mathbbm{1}(u_{b}\in\beta(\mu^{\prime}))$.

A vertex pair $w\in\binom{\mu}{2}$ contains $0$, $1$ or $2$ elements from $\mu\setminus\mu^{*}$. The others are from $\mu^{*}\cap\mu$.

This matters because

Because $\mu^{*}$ is a bijection and $\alpha(\mu^{*})=\mathcal{U}_{a}$, $\alpha(\mu\cap\mu^{*})$ and $\alpha(\mu^{*}\setminus\mu)$ partition the vertex set $\mathcal{U}_{a}$. Similarly $\beta(\mu\cap\mu^{*})$ and $\beta(\mu^{*}\setminus\mu)$ partition the vertex set $\mathcal{U}_{b}$. At the level of vertex pairs, we have partitions of $\binom{\mathcal{U}_{a}}{2}$ and $\binom{\mathcal{U}_{b}}{2}$ into three regions each:

for $i\in\{0,1,2\}$. The important fact for us is that both $\ell(\mu)$ and $\ell(\mu^{*})$ match elements of $\mathcal{V}_{a,i}$ with elements of $\mathcal{V}_{b,i}$.

The matchings $\ell(\mu)$ and $\ell(\mu^{*})$ also decompose into a union of paths and cycles. Because $\mu^{*}$ is a bijection, the length of each path is odd and the edges from $\mu$ are never the initial or final edges in a path. Each of these paths and cycles stays within one of the three regions.

We have $\ell(\mu)=\nu_{0}\cup\nu_{1}\cup\nu_{2}$ and $\ell(\mu^{*})=\nu_{0}^{*}\cup\nu_{1}^{*}\cup\nu_{2}^{*}$, so $t$ and $t^{\circ}$ capture the whole structure of $\ell(\mu)+\ell(\mu^{*})$.

An example of this decomposition is illustrated in Figure 2. The matchings $\ell(\mu)$ and $\ell(\mu^{*})$ always have the same structure between $\mathcal{V}_{a,0}$ and $\mathcal{V}_{b,0}$. Thus $t_{0,\ell}^{\circ}=0$ for $\ell\geq 2$ and $t_{0,\ell}=0$ for all $\ell$. The structure between $\mathcal{V}_{a,1}$ and $\mathcal{V}_{b,1}$ is $|\mu^{*}\cap\mu|$ copies of the structure between $\alpha(\mu^{*}\setminus\mu)$ and $\beta(\mu^{*}\setminus\mu)$ and consequently contains no cycles of length two, i.e. $t_{1,1}^{\circ}=0$. Observe that between $\mathcal{V}_{a,2}$ and $\mathcal{V}_{b,2}$, a cycle of length two can only be produced by a cycle of length four in the region between $\alpha(\mu^{*}\setminus\mu)$ and $\beta(\mu^{*}\setminus\mu)$. Thus $t_{2,1}^{\circ}\leq|\mu\setminus\mu^{*}|/2$.

Let $p_{1*}=p_{10}+p_{11}$ and $p_{*1}=p_{01}+p_{11}$.

The proof is given in Appendix A.

The proof is given in Appendix B.

The proof is given in Appendix C.