Network Representation Learning

logo

Lab of Media and Network

Department of Computer Science & Technology

Tsinghua University

Structural deep network embedding

D Wang, P Cui, W Zhu. SIGKDD 2016

Motivation

to find a method that is able to effectively capture the highly non-linear network structure and preserve the global and local structure, we propose a Structural Deep Network Embedding method, namely SDNE. More specifically, we first propose a semi-supervised deep model, which has multiple layers of non-linear functions, thereby being able to capture the highly non-linear network structure. Then we propose to exploit the first-order and second-order proximity jointly to preserve the network structure. The second-order proximity is used by the unsupervised component to capture the global network structure. While the first-order proximity is used as the supervised information in the supervised component to preserve the local network structure. By jointly optimizing them in the semi-supervised deep model, our method can preserve both the local and global network structure and is robust to sparse networks.

Empirically, we conduct the experiments on five real-world networks, including a language network, a citation network and three social networks. The results show that compared to the baselines, our method can reconstruct the original network significantly better and achieves substantial gains in three applications, i.e. multi-label classification, link prediction and visualization.

References

Daixin Wang, Peng Cui, Wenwu Zhu. Structural Deep Network Embedding//Proceeding KDD '16 Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Pages 1225-1234