Multiplex Network Representation Learning Based on Graph Neural Network

Authors

  • Lianwei Li Computer Science, The University of Texas at Arlington, Arlington, USA
  • Peiyuan Yang Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA
  • Han Lei Computer Science Engineering, Santa Clara University, Santa Clara, USA
  • Baoming Wang Electrical and Computer Engineering,University of Illinois at Urbana-Champaign,Urbana, IL, USA
  • Zhou Chen Software Engineering, Zhejiang University, Hangzhou, China

DOI:

https://doi.org/10.53469/jtpes.2024.04(05).03

Keywords:

Multiplex network, Network Representation Learning, Graph Neural Networks

Abstract

Network representation learning is receiving increasing attention from scholars. Among them, methods based on graph neural networks have become particularly popular. However, most existing methods currently only focus on networks with a single type of relations. In the real world, networks contain a wealth of diverse information, with multiple types of relationships between nodes. In this paper, we propose a graph neural network-based multiplex network representation learning model (GNMRL). We model nodes within each layer of the multiplex network by aggregating neighbor information. Additionally, since nodes are influenced by different network layers, we integrate node interaction information across network layers. We conducted systematic experiments on four datasets, and the results show that GNMRL outperforms other comparison methods in both link prediction and node classification tasks.

References

Zhang D, Yin J, Zhu X, et al. Network representation learning: A survey[J]. IEEE transactions on Big Data, 2018, 6(1): 3-28.

Taskar B, Wong M F, Abbeel P, et al. Link prediction in relational data[J]. Advances in neural information processing systems, 2003, 16.

Butts C T. Revisiting the foundations of network analysis[J]. science, 2009, 325(5939): 414-416.

Bhagat S, Cormode G, Muthukrishnan S. Node classification in social networks[J]. Social network data analytics, 2011: 115-148.

Zhang Y, Wu J, Zhou C, et al. Multi-view fusion with extreme learning machine for clustering[J]. ACM Transactions on Intelligent Systems and Technology (TIST), 2019, 10(5): 1-23.

Perozzi B, Al-Rfou R, Skiena S. Deepwalk: Online learning of social representations[C]//Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 2014: 701-710.

Tang J, Qu M, Wang M, et al. Line: Large-scale information network embedding[C]//Proceedings of the 24th international conference on world wide web. 2015: 1067-1077.

Grover A, Leskovec J. node2vec: Scalable feature learning for networks[C]//Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 2016: 855-864.

Cen Y, Zou X, Zhang J, et al. Representation learning for attributed multiplex heterogeneous network[C]//Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 2019: 1358-1368.

Park C, Kim D, Han J, et al. Unsupervised attributed multiplex network embedding[C]//Proceedings of the AAAI conference on artificial intelligence. 2020, 34(04): 5371-5378.

Cui P, Wang X, Pei J, et al. A survey on network embedding[J]. IEEE transactions on knowledge and data engineering, 2018, 31(5): 833-852

Niu Z, Zhong G, Yu H. A review on the attention mechanism of deep learning[J]. Neurocomputing, 2021, 452: 48-62.

Dong Y, Chawla N V, Swami A. metapath2vec: Scalable representation learning for heterogeneous networks[C]//Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. 2017: 135-144. Ma X, Z140.

Wang D, Cui P, Zhu W. Structural deep network embedding[C]//Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 2016: 1225-1234.

Gao H, Huang H. Deep attributed network embedding[C]//Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI)). 2018. Ma J, Z9.

Goodfellow I, Pouget-Abadie J, Mirza M, et al. Generative adversarial networks[J]. Communications of the ACM, 2020, 63(11): 139-144.

Wang H, Wang J, Wang J, et al. Graphgan: Graph representation learning with generative adversarial nets[C]//Proceedings of the AAAI conference on artificial intelligence. 2018, 32(1).

Zhou J, Cui G, Hu S, et al. Graph neural networks: A review of methods and applications[J]. AI open, 2020, 1: 57-81.

Wu Z, Pan S, Chen F, et al. A comprehensive survey on graph neural networks[J]. IEEE transactions on neural networks and learning systems, 2020, 32(1): 4-24.

Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks[J]. arXiv preprint arXiv:1609.02907, 2016.

Casanova P, Lio A R P, Bengio Y. Graph attention networks[J]. ICLR. Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Liò and Yoshua Bengio, 2018.

Hamilton W, Ying Z, Leskovec J. Inductive representation learning on large graphs[J]. Advances in neural information processing systems, 2017, 30.

Velickovic P, Fedus W, Hamilton W L, et al. Deep graph infomax[J]. ICLR (Poster), 2019, 2(3): 4.

Liu W, Chen P Y, Yeung S, et al. Principled multilayer network embedding[C]//2017 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 2017: 134-141.

Zhang H, Qiu L, Yi L, et al. Scalable multiplex network embedding[C]//IJCAI. 2018, 18: 3082-3088.

Matsuno R, Murata T. Mell: effective embedding method for multiplex networks[C]//Companion Proceedings of the The Web Conference 2018. 2018: 1261-1268.

Sadikaj Y, Rass J, Velaj Y, et al. Semi-Supervised Embedding of Attributed Multiplex Networks[C]//Proceedings of the ACM Web Conference 2023. 2023: 578-587.

Gu J, Wang Z, Kuen J, et al. Recent advances in convolutional neural networks[J]. Pattern recognition, 2018, 77: 354-377.

Kipf T N, Welling M. Variational graph auto-encoders[J]. arXiv preprint arXiv:1611.07308, 2016.

Downloads

Published

2024-05-14

How to Cite

Li, L., Yang, P., Lei, H., Wang, B., & Chen, Z. (2024). Multiplex Network Representation Learning Based on Graph Neural Network. Journal of Theory and Practice of Engineering Science, 4(05), 17–24. https://doi.org/10.53469/jtpes.2024.04(05).03