Abstract
We consider the task of detecting a hidden bipartite subgraph in a given random graph. This is formulated as a hypothesis testing problem, under the null hypothesis, the graph is a realization of an Erdos-Rényi random graph over n vertices with edge density q. Under the alternative, there exists a planted kR × kL bipartite subgraph with edge density p > q. We characterize the statistical and computational barriers for this problem. Specifically, we derive information-theoretic lower bounds, and design and analyze optimal algorithms matching those bounds, in both the dense regime, where p, q = ⊝ (1), and the sparse regime where p, q = ⊝ (n-α), α ⋯ (0, 2]. We also consider the problem of testing in polynomial-time. As is customary in similar structured high-dimensional problems, our model undergoes an "easy-hard-impossible"phase transition and computational constraints penalize the statistical performance. To provide an evidence for this statistical computational gap, we prove computational lower bounds based on the low-degree conjecture, and show that the class of low-degree polynomials algorithms fail in the conjecturally hard region.
Original language | American English |
---|---|
Pages (from-to) | 4319-4334 |
Number of pages | 16 |
Journal | IEEE Transactions on Information Theory |
Volume | 70 |
Issue number | 6 |
DOIs | |
State | Published - 1 Jun 2024 |
Keywords
- Detection
- hidden structures
- statistical and computational limits
- statistical inference
All Science Journal Classification (ASJC) codes
- Information Systems
- Computer Science Applications
- Library and Information Sciences