OPTIMIZING INTELLIGENT EDGE COMPUTING RESOURCE SCHEDULING BASED ON FEDERATED LEARNING

Authors

  • Hanzhe Li Computer Engineering, New York University, New York, USA Author
  • Shiji Zhou Computer Science, University of Southern California, CA, USA Author
  • Bo Yuan VMware, Beijing, China Author
  • VMware, Beijing, China Computer Science, University of California San Diego, CA, USA Author

DOI:

https://doi.org/10.60087/jklst.vol3.n3.p.235-260

Keywords:

Federated Learning, Edge Computing, Resource Scheduling, Non-IID Data

Abstract

This study proposes a novel federated learning framework for optimizing intelligent edge computing resource scheduling. The framework addresses the challenges of device heterogeneity, non-IID data distribution, and communication overhead in edge environments. We introduce an adaptive client selection mechanism considering computational capabilities, energy status, and data quality. A personalized model training approach is implemented to handle non-IID data effectively using multi-task learning and local batch normalization layers. The framework incorporates efficient model aggregation techniques and communication-efficient updates to reduce bandwidth consumption. The privacy policy, including the difference between privacy and collective security, has been integrated to improve data protection. We develop scheduling problems based on multi-objective optimization, combining the best in computing and communication while updating local and global guidelines. Extensive testing on a wide range of data shows that the framework is superior regarding connection speed, resource utilization, and model performance. The proposed method achieves a 15% improvement in model accuracy and a 40% reduction in communication overhead compared to learning state-of-the-art algorithms. Case studies in intelligent city traffic prediction and healthcare IoT validate the framework's effectiveness in real-world scenarios, showcasing its scalability and adaptability to varying network conditions and client availability.
-------------------------------------

本研究提出了一种新的联邦学习框架,用于优化智能边缘计算资源调度。该框架解决了边缘环境中的设备异构性、非 IID 数据分发和通信开销等挑战。我们引入了一种考虑计算能力、能源状态和数据质量的自适应客户端选择机制。实施个性化模型训练方法,以使用多任务学习和本地批量归一化层有效地处理非 IID 数据。该框架结合了高效的模型聚合技术和通信高效的更新,以减少带宽消耗。已整合隐私政策,包括隐私和集体安全之间的区别,以改进数据保护。我们基于多目标优化开发调度问题,结合计算和通信的优点,同时更新本地和全局指南。对大量数据的广泛测试表明,该框架在连接速度、资源利用率和模型性能方面具有优势。与学习最先进的算法相比,所提出的方法使模型准确性提高了 15%,通信开销减少了 40%。智能城市交通预测和医疗保健 IoT 的案例研究验证了该框架在实际场景中的有效性,展示了其对不同网络条件和客户端可用性的可扩展性和适应性。

Downloads

Download data is not yet available.

References

Tariq, A., Lakas, A., Sallabi, F. M., Qayyum, T., Serhani, M. A., & Baraka, E. (2023). Empowering Trustworthy Client Selection in Edge Federated Learning Leveraging Reinforcement Learning. In Proceedings of the Eighth ACM/IEEE Symposium on Edge Computing (SEC '23) (pp. 372-377).

Agbaje, P., Anjum, A., Talukder, Z., Islam, M., Nwafor, E., & Olufowobi, H. (2023). FedCime: An Efficient Federated Learning Approach For Clients in Mobile Edge Computing. In 2023 IEEE International Conference on Edge Computing and Communications (EDGE) (pp. 215-220).

Ahmed, K. M., Imteaj, A., & Amini, M. H. (2021). Federated Deep Learning for Heterogeneous Edge Computing. In 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA) (pp. 1146-1152).

Niyas, S. K., & Sathya, P. (2023). Federated Learning Based Elderly Fall Detection Using Edge Computing. In 2023 IEEE International Conference on Next Generation Electronics (NEleX) (pp. 1-6).

Mills, J., Hu, J., & Min, G. (2022). Multi-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing. IEEE Transactions on Parallel and Distributed Systems, 33(3), 630-641.

Li, S., Xu, H., Lu, T., Cao, G., & Zhang, X. (2024). Emerging Technologies in Finance: Revolutionizing Investment Strategies and Tax Management in the Digital Era. Management Journal for Advanced Research, 4(4), 35-49.

Shi J, Shang F, Zhou S, et al. Applications of Quantum Machine Learning in Large-Scale E-commerce Recommendation Systems: Enhancing Efficiency and Accuracy[J]. Journal of Industrial Engineering and Applied Science, 2024, 2(4): 90-103.

Wang, S., Zheng, H., Wen, X., & Fu, S. (2024). DISTRIBUTED HIGH-PERFORMANCE COMPUTING METHODS FOR ACCELERATING DEEP LEARNING TRAINING. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 108-126.

Zhang, M., Yuan, B., Li, H., & Xu, K. (2024). LLM-Cloud Complete: Leveraging Cloud Computing for Efficient Large Language Model-based Code Completion. Journal of Artificial Intelligence General science (JAIGS) ISSN: 3006-4023, 5(1), 295-326.

Lei, H., Wang, B., Shui, Z., Yang, P., & Liang, P. (2024). Automated Lane Change Behavior Prediction and Environmental Perception Based on SLAM Technology. arXiv preprint arXiv:2404.04492.

Wang, B., He, Y., Shui, Z., Xin, Q., & Lei, H. (2024). Predictive Optimization of DDoS Attack Mitigation in Distributed Systems using Machine Learning. Applied and Computational Engineering, 64, 95-100.

Wang, B., Zheng, H., Qian, K., Zhan, X., & Wang, J. (2024). Edge computing and AI-driven intelligent traffic monitoring and optimization. Applied and Computational Engineering, 77, 225-230.

Xu, Y., Liu, Y., Xu, H., & Tan, H. (2024). AI-Driven UX/UI Design: Empirical Research and Applications in FinTech. International Journal of Innovative Research in Computer Science & Technology, 12(4), 99-109.

Liu, Y., Xu, Y., & Song, R. (2024). Transforming User Experience (UX) through Artificial Intelligence (AI) in interactive media design. Engineering Science & Technology Journal, 5(7), 2273-2283.

Zhang, P. (2024). A STUDY ON THE LOCATION SELECTION OF LOGISTICS DISTRIBUTION CENTERS BASED ON E-COMMERCE. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 103-107.

Zhang, P., & Gan, L. I. U. (2024). Optimization of Vehicle Scheduling for Joint Distribution in Logistics Park based on Priority. Journal of Industrial Engineering and Applied Science, 2(4), 116-121.

Li, H., Wang, S. X., Shang, F., Niu, K., & Song, R. (2024). Applications of Large Language Models in Cloud Computing: An Empirical Study Using Real-world Data. International Journal of Innovative Research in Computer Science & Technology, 12(4), 59-69.

Ping, G., Wang, S. X., Zhao, F., Wang, Z., & Zhang, X. (2024). Blockchain Based Reverse Logistics Data Tracking: An Innovative Approach to Enhance E-Waste Recycling Efficiency.

Xu, H., Niu, K., Lu, T., & Li, S. (2024). Leveraging artificial intelligence for enhanced risk management in financial services: Current applications and future prospects. Engineering Science & Technology Journal, 5(8), 2402-2426.

Shi, Y., Shang, F., Xu, Z., & Zhou, S. (2024). Emotion-Driven Deep Learning Recommendation Systems: Mining Preferences from User Reviews and Predicting Scores. Journal of Artificial Intelligence and Development, 3(1), 40-46.

Wang, Shikai, Kangming Xu, and Zhipeng Ling. "Deep Learning-Based Chip Power Prediction and Optimization: An Intelligent EDA Approach." International Journal of Innovative Research in Computer Science & Technology 12.4 (2024): 77-87.

Liu, B., Cai, G., Ling, Z., Qian, J., & Zhang, Q. (2024). Precise Positioning and Prediction System for Autonomous Driving Based on Generative Artificial Intelligence. Applied and Computational Engineering, 64, 42-49.

Wang, S., Xu, K., & Ling, Z. (2024). Deep Learning-Based Chip Power Prediction and Optimization: An Intelligent EDA Approach. International Journal of Innovative Research in Computer Science & Technology, 12(4), 77-87.

Shi, Y., Shang, F., Xu, Z., & Zhou, S. (2024). Emotion-Driven Deep Learning Recommendation Systems: Mining Preferences from User Reviews and Predicting Scores. Journal of Artificial Intelligence and Development, 3(1), 40-46.

Ping, G., Zhu, M., Ling, Z., & Niu, K. (2024). Research on Optimizing Logistics Transportation Routes Using AI Large Models. Applied Science and Engineering Journal for Advanced Research, 3(4), 14-27.

Liu, Y., Xu, Y., & Song, R. (2024). Transforming User Experience (UX) through Artificial Intelligence (AI) in interactive media design. Engineering Science & Technology Journal, 5(7), 2273-2283.

Shang, F., Shi, J., Shi, Y., & Zhou, S. (2024). Enhancing E-Commerce Recommendation Systems with Deep Learning-based Sentiment Analysis of User Reviews. International Journal of Engineering and Management Research, 14(4), 19-34.

Yang, T., Li, A., Xu, J., Su, G. and Wang, J., 2024. Deep learning model-driven financial risk prediction and analysis. Applied and Computational Engineering, 77, pp.196-202.

Cui, Z., Lin, L., Zong, Y., Chen, Y., & Wang, S. (2024). Precision Gene Editing Using Deep Learning: A Case Study of the CRISPR-Cas9 Editor. Applied and Computational Engineering, 64, 134-141.

Cui, Z., Lin, L., Zong, Y., Chen, Y., & Wang, S. (2024). Precision Gene Editing Using Deep Learning: A Case Study of the CRISPR-Cas9 Editor. Applied and Computational Engineering, 64, 134-141.

Zhou, Y., Zhan, T., Wu, Y., Song, B., & Shi, C. (2024). RNA Secondary Structure Prediction Using Transformer-Based Deep Learning Models. arXiv preprint arXiv:2405.06655.

Xin, Q., Xu, Z., Guo, L., Zhao, F., & Wu, B. (2024). IoT traffic classification and anomaly detection method based on deep autoencoders. Applied and Computational Engineering, 69, 64-70.

Zhao, F., Zhang, M., Zhou, S., & Lou, Q. (2024). Detection of Network Security Traffic Anomalies Based on Machine Learning KNN Method. Journal of Artificial Intelligence General science (JAIGS) ISSN: 3006-4023, 1(1), 209-218.

Yang, M., Huang, D., Zhang, H., & Zheng, W. (2024). AI-Enabled Precision Medicine: Optimizing Treatment Strategies Through Genomic Data Analysis. Journal of Computer Technology and Applied Mathematics, 1(3), 73-84.

Wen, X., Shen, Q., Zheng, W., & Zhang, H. (2024). AI-Driven Solar Energy Generation and Smart Grid Integration A Holistic Approach to Enhancing Renewable Energy Efficiency. International Journal of Innovative Research in Engineering and Management, 11(4), 55-55.

Lou, Q. (2024). New Development of Administrative Prosecutorial Supervision with Chinese Characteristics in the New Era. Journal of Economic Theory and Business Management, 1(4), 79-88.

Zhou, S., Yuan, B., Xu, K., Zhang, M., & Zheng, W. (2024). THE IMPACT OF PRICING SCHEMES ON CLOUD COMPUTING AND DISTRIBUTED SYSTEMS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 193-205.

Sun, J., Wen, X., Ping, G., & Zhang, M. (2024). Application of News Analysis Based on Large Language Models in Supply Chain Risk Prediction. Journal of Computer Technology and Applied Mathematics, 1(3), 55-65.

Huang, D., Yang, M., Wen, X., Xia, S., & Yuan, B. (2024). AI-Driven Drug Discovery: Accelerating the Development of Novel Therapeutics in Biopharmaceuticals. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 206-224.

Liu, Y., Tan, H., Cao, G., & Xu, Y. (2024). Enhancing User Engagement through Adaptive UI/UX Design: A Study on Personalized Mobile App Interfaces.

Xu, H., Li, S., Niu, K., & Ping, G. (2024). Utilizing Deep Learning to Detect Fraud in Financial Transactions and Tax Reporting. Journal of Economic Theory and Business Management, 1(4), 61-71.

Li, P., Hua, Y., Cao, Q., & Zhang, M. (2020, December). Improving the Restore Performance via Physical-Locality Middleware for Backup Systems. In Proceedings of the 21st International Middleware Conference (pp. 341-355).

Zhou, S., Yuan, B., Xu, K., Zhang, M., & Zheng, W. (2024). THE IMPACT OF PRICING SCHEMES ON CLOUD COMPUTING AND DISTRIBUTED SYSTEMS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 193-205.

Shang, F., Zhao, F., Zhang, M., Sun, J., & Shi, J. (2024). Personalized Recommendation Systems Powered By Large Language Models: Integrating Semantic Understanding and User Preferences. International Journal of Innovative Research in Engineering and Management, 11(4), 39-49.

Yang, T. ., Xin, Q. ., Zhan, X. ., Zhuang, S. ., & Li, H. . (2024). ENHANCING FINANCIAL SERVICES THROUGH BIG DATA AND AI-DRIVEN CUSTOMER INSIGHTS AND RISK ANALYSIS. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 53-62.

Xu, K., Zheng, H., Zhan, X., Zhou, S., & Niu, K. (2024). Evaluation and Optimization of Intelligent Recommendation System Performance with Cloud Resource Automation Compatibility.

Xu, J., Zhu, B., Jiang, W., Cheng, Q., & Zheng, H. (2024, April). AI-BASED RISK PREDICTION AND MONITORING IN FINANCIAL FUTURES AND SECURITIES MARKETS. In The 13th International scientific and practical conference “Information and innovative technologies in the development of society”(April 02–05, 2024) Athens, Greece. International Science Group. 2024. 321 p. (p. 222).

Downloads

Published

25-09-2024

How to Cite

Li, H., Zhou, S., Yuan, B., & Zhang, M. (2024). OPTIMIZING INTELLIGENT EDGE COMPUTING RESOURCE SCHEDULING BASED ON FEDERATED LEARNING. Journal of Knowledge Learning and Science Technology ISSN: 2959-6386 (online), 3(3), 235-260. https://doi.org/10.60087/jklst.vol3.n3.p.235-260