Cloud Computing for Large-Scale Resource Computation and Storage in Machine Learning

Authors

  • Yufu Wang Computer Science & Engineering,Santa Clara University,Santa Clara, CA, USA
  • Qiaozhi Bao Statistics, North Carolina State University, NC, USA
  • Jiufan Wang Independent Researcher, William & Mary ,Williamsburge,VA, USA
  • Guangze Su Infomation Science, Trine University,Phoenix, AZ, USA
  • Xiaonan Xu Independent Researcher, Northern Arizona University, Flagstaff, USA

DOI:

https://doi.org/10.53469/jtpes.2024.04(03).14

Keywords:

Cloud Computing, Machine Learning, Resource Computation, Storage

Abstract

With the rapid development of Internet technology, cloud computing technology has gradually entered people's lives. Cloud computing provides users with various IT resources (computing, storage, etc.) in data centers all over the world through the Internet. Currently, there are hundreds of thousands of servers in large-scale data centers, and effective management of resources in such large-scale data centers is a major problem in academia and industry. This article explores the importance and pervasive use of cloud computing and machine learning in today's technology landscape. As the global cloud computing market size and the application of machine learning technologies continue to grow, the demand for computing and storage resources is also increasing. This paper aims to solve the challenges of large-scale resource computing and storage requirements in machine learning, and puts forward a solution how to give full play to the advantages of cloud computing platform and combine machine learning algorithms and technologies. Through practical data and case studies, we highlight the application scenarios, advantages and challenges of cloud computing in machine learning, and look forward to the future development trend.

References

Wan, Weixiang, et al. ""Progress in artificial intelligence applications based on the combination of self-driven sensors and deep learning."" arXiv preprint arXiv:2402.09442 (2024).

Wang, Yong, et al. ""Construction and application of artificial intelligence crowdsourcing map based on multi-track GPS data."" arXiv preprint arXiv:2402.15796 (2024).

Zheng, Jiajian, et al. ""The Random Forest Model for Analyzing and Forecasting the US Stock Market in the Context of Smart Finance."" arXiv preprint arXiv:2402.17194 (2024).

Yang, Le, et al. ""AI-Driven Anonymization: Protecting Personal Data Privacy While Leveraging Machine Learning."" arXiv preprint arXiv:2402.17191 (2024).

Cheng, Qishuo, et al. ""Optimizing Portfolio Management and Risk Assessment in Digital Assets Using Deep Learning for Predictive Analysis."" arXiv preprint arXiv:2402.15994 (2024).

Zhu, Mengran, et al. ""Utilizing GANs for Fraud Detection: Model Training with Synthetic Transaction Data."" arXiv preprint arXiv:2402.09830 (2024).

Wu, Jiang, et al. ""Data Pipeline Training: Integrating AutoML to Optimize the Data Flow of Machine Learning Models."" arXiv preprint arXiv:2402.12916 (2024).

Yu, Hanyi, et al. ""Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving."" arXiv preprint arXiv:2402.16036 (2024).

Huo, Shuning, et al. ""Deep Learning Approaches for Improving Question Answering Systems in Hepatocellular Carcinoma Research."" arXiv preprint arXiv:2402.16038 (2024).

Chen, Jianhang, et al. ""One-stage object referring with gaze estimation."" Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022.

Duan, Shiheng, et al. “Prediction of Atmospheric Carbon Dioxide Radiative Transfer Model Based on Machine Learning”. Frontiers in Computing and Intelligent Systems, vol. 6, no. 3, Jan. 2024, pp. 132-6, https://doi.org/10.54097/ObMPjw5n.

Chen , Jianfeng, et al. “Implementation of an AI-Based MRD Evaluation and Prediction Model for Multiple Myeloma”. Frontiers in Computing and Intelligent Systems, vol. 6, no. 3, Jan. 2024, pp. 127-31, https://doi.org/10.54097/zJ4MnbWW.

“Machine Learning Model Training and Practice: A Study on Constructing a Novel Drug Detection System”. International Journal of Computer Science and Information Technology, vol. 1, no. 1, Dec. 2023, pp. 139-46, https://doi.org/10.62051/ijcsit.v1n1.19.

Duan, Shiheng, et al. ""THE INNOVATIVE MODEL OF ARTIFICIAL INTELLIGENCE COMPUTER EDUCATION UNDER THE BACKGROUND OF EDUCATIONAL INNOVATION."" The 2nd International scientific and practical conference “Innovations in education: prospects and challenges of today”(January 16-19, 2024) Sofia, Bulgaria. International Science Group. 2024. 389 p.. 2024.

Shen, Zepeng, et al. ""EDUCATIONAL INNOVATION IN THE DIGITAL AGE: THE ROLE AND IMPACT OF NLP TECHNOLOGY."" OLD AND NEW TECHNOLOGIES OF LEARNING DEVELOPMENT IN MODERN CONDITIONS (2024): 281.

Gong, Yulu, et al. ""RESEARCH ON A MULTILEVEL PRACTICAL TEACHING SYSTEM FOR THE COURSE'DIGITAL IMAGE PROCESSING."" OLD AND NEW TECHNOLOGIES OF LEARNING DEVELOPMENT IN MODERN CONDITIONS (2024): 272.

Qian, Wenpin, et al. ""NEXT-GENERATION ARTIFICIAL INTELLIGENCE INNOVATIVE APPLICATIONS OF LARGE LANGUAGE MODELS AND NEW METHODS."" OLD AND NEW TECHNOLOGIES OF LEARNING DEVELOPMENT IN MODERN CONDITIONS (2024): 262.

W. Sun, W. Wan, L. Pan, J. Xu, and Q. Zeng, “The Integration of Large-Scale Language Models Into Intelligent Adjudication: Justification Rules and Implementation Pathways”, Journal of Industrial Engineering & Applied Science, vol. 2, no. 1, pp. 13–20, Feb. 2024.

Zhou, Yanlin, et al. ""Utilizing AI-Enhanced Multi-Omics Integration for Predictive Modeling of Disease Susceptibility in Functional Phenotypes."" Journal of Theory and Practice of Engineering Science 4.02 (2024): 45-51.

Liang, Penghao, et al. ""Enhancing Security in DevOps by Integrating Artificial Intelligence and Machine Learning."" Journal of Theory and Practice of Engineering Science 4.02 (2024): 31-37.

Zhang, Chenwei, et al. ""SegNet Network Architecture for Deep Learning Image Segmentation and Its Integrated Applications and Prospects."" Academic Journal of Science and Technology 9.2 (2024): 224-229.

Wang, Yong, et al. ""Autonomous Driving System Driven by Artificial Intelligence Perception Fusion."" Academic Journal of Science and Technology 9.2 (2024): 193-198.

Zhang, Quan, et al. ""Application of the AlphaFold2 Protein Prediction Algorithm Based on Artificial Intelligence."" Journal of Theory and Practice of Engineering Science 4.02 (2024): 58-65.

Wei, Kuo, et al. “Strategic Application of AI Intelligent Algorithm in Network Threat Detection and Defense”. Journal of Theory and Practice of Engineering Science, vol. 4, no. 01, Jan. 2024, pp. 49-57, doi:10.53469/jtpes.2024.04(01).07.

Su, Jing, et al. ""Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Review."" arXiv preprint arXiv:2402.10350 (2024).

Wang, Yong, et al. ""Construction and application of artificial intelligence crowdsourcing map based on multi-track GPS data."" arXiv preprint arXiv:2402.15796 (2024).

K. Tan and W. Li, ""Imaging and Parameter Estimating for Fast Moving Targets in Airborne SAR,"" in IEEE Transactions on Computational Imaging, vol. 3, no. 1, pp. 126-140, March 2017, doi: 10.1109/TCI.2016.2634421.

K. Tan and W. Li, ""A novel moving parameter estimation approach offast moving targets based on phase extraction,"" 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada, 2015, pp. 2075-2079, doi: 10.1109/ICIP.2015.7351166.

Tan, Kai, et al. “Integrating Advanced Computer Vision and AI Algorithms for Autonomous Driving Systems”. Journal of Theory and Practice of Engineering Science, vol. 4, no. 01, Jan. 2024, pp. 41-48, doi:10.53469/jtpes.2024.04(01).06.

H. Zhu and B. Wang, ""Negative Siamese Network for Classifying Semantically Similar Sentences,"" 2021 International Conference on Asian Language Processing (IALP), Singapore, Singapore, 2021, pp. 170-173, doi: 10.1109/IALP54817.2021.9675278.

Downloads

Published

2024-03-19

How to Cite

Wang, Y., Bao, Q., Wang, J., Su, G., & Xu, X. (2024). Cloud Computing for Large-Scale Resource Computation and Storage in Machine Learning. Journal of Theory and Practice of Engineering Science, 4(03), 163–171. https://doi.org/10.53469/jtpes.2024.04(03).14