Provisioning of Live Container Migration in Edge/Cloud Environments: Techniques and Challenges
DOI:
https://doi.org/10.37385/jaets.v6i2.6675Keywords:
Container, Live Container Migration, CRIUAbstract
Containers have become increasingly popular in the virtualization landscape. Their lightweight nature and fast deployment behavior make them an efficient alternative to traditional hypervisor-based virtual machines. In IoT applications and edge/cloud deployment, the live container migration can substantially reduce computing system overheads by minimizing the migration time and transmitting minimum memory pages from the source host without interrupting the service process. Until today, there has been a lack of comprehensive research discussing live container migration in the IoT domain and investigating the challenges of representing them in the edge/cloud environment. This survey presents cutting-edge articles that involve a live container migration approach. This survey aims to boost current knowledge, identify best practices, and highlight the challenges of live container migration in the IoT and edge/cloud environments, which will contribute to the advancement of container technology, as well as the optimization of deployment practices. The survey results indicate that selecting a suitable container engine relies heavily on the workload characteristics in the edge/cloud environment, particularly given the constraintions of live container migration. The survey highlights the direct and indirect challenges that influence container migration and proposes machine learning and blockchain as potential solutions.
Downloads
References
Abdullah, D. B., & Hasan, B. T. (2023). HRRMLQ: Container scheduling algorithm on edge nodes cluster. AIP Conference Proceedings, 2834(1). https://doi.org/10.1063/5.0171070
Abdullah, D. B., & Mohammed, H. H. (2022). DHFogSim: Smart Real-Time Traffic Management Framework for Fog Computing Systems. ICOASE 2022 - 4th International Conference on Advanced Science and Engineering, 60–65. https://doi.org/10.1109/ICOASE56293.2022.10075605
Adrian Reber. (n.d.). Container migration with Podman on RHEL. Retrieved June 22, 2024, from https://www.redhat.com/en/blog/container-migration-podman-rhel
Andrijauskas, F., Sfiligoi, I., Davila, D., Arora, A., Guiang, J., Bockelman, B., Thain, G., & Wurthwein, F. (2024). CRIU -- Checkpoint Restore in Userspace for computational simulations and scientific applications. http://arxiv.org/abs/2402.05244
Antonio Marques, M., Christian Miers, C., Rodrigues Obelheiro, R., Antonio SImplico Jr, M., Marques, M. A., Miers, C. C., Obelheiro, R. R., & Simplício Jr, M. A. (2023). Clustered event2ledger: Docker event traceability using consortium Hyperledger blockchains. https://doi.org/10.21203/rs.3.rs-2761768/v1
Azab, M., Mokhtar, B., Abed, A. S., & Eltoweissy, M. (2016, November 9). Toward Smart Moving Target Defense for Linux Container Resiliency. IEEE 41st Conference on Local Computer Networks (LCN), Pp. 619-622. IEEE. https://doi.org/10.1109/LCN.2016.106
Bellavista, P., Dahdal, S., Foschini, L., Tazzioli, D., Tortonesi, M., & Venanzi, R. (2024). Kubernetes Enhanced Stateful Service Migration for ML-Driven Applications in Industry 4.0 Scenarios. 2024 IEEE Annual Congress on Artificial Intelligence of Things (AIoT), 25–31. https://doi.org/10.1109/AIoT63253.2024.00015
Benjaponpitak, T., Karakate, M., & Sripanidkulchai, K. (2020). Enabling Live Migration of Containerized Applications Across Clouds. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications, Pp. 2529-2538. IEEE.
Bhardwaj, A., & Rama Krishna, C. (2022). A Container-Based Technique to Improve Virtual Machine Migration in Cloud Computing. IETE Journal of Research, 68(1), 401–416. https://doi.org/10.1080/03772063.2019.1605848
Bonomi, Flavio, Rodolfo Milito, Jiang Zhu, & Sateesh Addepalli. (2012). Fog Computing and Its Role in the Internet of Things. In Proceedings of the First Edition of the MCC Workshop on Mobile Cloud Computing, Pp. 13-16, 66.
Cgroup-freezer. (n.d.). Retrieved May 3, 2024, from https://www.kernel.org/doc/Documentation/cgroup-v1/freezer-subsystem.txt
checkpoint-restore_p.haul_ Live migration using CRIU. (n.d.). Retrieved May 3, 2024, from https://github.com/checkpoint-restore/p.haul
Clark, C., Fraser, K., Hand, S., Hansen, J. G., Jul, E., Limpach, C., Pratt, I., & Warfield, A. (2005). Live Migration of Virtual Machines. In Proceedings of the 2nd Conference on Symposium on Networked Systems Design & Implementation-Volume 2, Pp. 273-286.
Doan, Tung V., Giang T. Nguyen, Hani Salah, Sreekrishna Pandi, Michael Jarschel, Rastin Pries, & and Frank HP Fitzek. (2019). Containers vs Virtual Machines: Choosing the Right Virtualization Technology for Mobile Edge Cloud. In 2019 IEEE 2nd 5G World Forum (5GWF), pp. 46-52. IEEE,.
Dua, R., Raja, A. R., & Kakadia, D. (2014). Virtualization vs containerization to support PaaS. Proceedings - 2014 IEEE International Conference on Cloud Engineering, IC2E 2014, 610–614. https://doi.org/10.1109/IC2E.2014.41
Farahmandian, M., Foumani, M. F., & Bayat, P. (2024). Improving fault tolerance in LinuX container-based distributed systems using blockchain. Cluster Computing. https://doi.org/10.1007/s10586-024-04279-9
Feitosa, L., Barbosa, V., Sabino, A., Lima, L. N., Fé, I., Silva, L. G., Callou, G., Carvalho, J., Leão, E., Nguyen, T. A., Rego, P., & Silva, F. A. (2025). A comprehensive performance evaluation of container migration strategies. Computing, 107(2). https://doi.org/10.1007/s00607-025-01423-0
Felter, W., Ferreira, A., Rajamony, R., & Rubio, J. (2014). An Updated Performance Comparison of Virtual Machines and Linux Containers. In Computer Science. http://domino.watson.ibm.com/library/CyberDig.nsf/home.
Hadeed, W., & Abdullah, D. B. (2022). Load Balancing Mechanism for Edge-CloudBased Priorities Containers. International Journal of Wireless and Microwave Technologies, 12(5), 1–9. https://doi.org/10.5815/ijwmt.2022.05.01
He, T., & Buyya, R. (2021). A Taxonomy of Live Migration Management in Cloud Computing. http://arxiv.org/abs/2112.02593
Hines, M. R., Deshpande, U., & Gopalan, K. (2009). Post-Copy Live Migration of Virtual Machines. Hines, Michael R., Umesh Deshpande, and Kartik Gopalan. “Post-Copy Live Migration of Virtual Machines.” ACM SIGOPS Operating Systems Review 43, No. 3: 14-26.
Hosseinzadeh, S., Laurén, S., & Leppänen, V. (2016). Security in container-based virtualization through vTPM. Proceedings - 9th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2016, 214–219. https://doi.org/10.1145/2996890.3009903
How to move existing LXD instances between servers. (n.d.). Retrieved April 15, 2025, from https://documentation.ubuntu.com/lxd/en/stable-5.21/howto/move_instances/
Jin, H., Li, Z., Zou, D., & Yuan, B. (2021). DSEOM: A Framework for Dynamic Security Evaluation and Optimization of MTD in Container-Based Cloud. IEEE Transactions on Dependable and Secure Computing, 18(3), 1125–1136. https://doi.org/10.1109/TDSC.2019.2916666
Jin, X., He, S., & Chen, Y. (2024). Container migration for edge computing in industrial Internet with joint latency reduction and reliability enhancement. Scientific Reports, 14(1). https://doi.org/10.1038/s41598-024-77086-2
Junior, P. S., Miorandi, D., & Pierre, G. (2020). Stateful Container Migration in Geo-Distributed Environments. Proceedings of the International Conference on Cloud Computing Technology and Science, CloudCom, 2020-December, 49–56. https://doi.org/10.1109/CloudCom49646.2020.00005
Kamp, P.-H. (n.d.). Jails: Confining the omnipotent root.
Kaur, K., Guillemin, F., & Sailhan, F. (2022). Container placement and migration strategies for Cloud, Fog and Edge data centers: A survey. International Journal of Network Management 32, No. 6.
Lee, J., Kang, H., Yu, H. J., Na, J. H., Kim, J., Shin, J. H., & Noh, S. Y. (2024). MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes. Journal of Cloud Computing, 13(1). https://doi.org/10.1186/s13677-024-00687-9
Linux Checkpoint/Restore In Userspace. (n.d.). Retrieved June 4, 2024, from https://criu.org/Main_Page
Linux Containers (LXC) is an operating-system-level virtualization. (n.d.). Retrieved May 25, 2024, from https://en.wikipedia.org/wiki/LXC
Linux namespaces. (n.d.). Retrieved June 8, 2024, from https://en.wikipedia.org/wiki/Linux_namespaces
Lu, Y., & Jiang, Y. (2023). A Container Pre-copy Migration Method Based on Dirty Page Prediction and Compression. Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS, 2023-January, 704–711. https://doi.org/10.1109/ICPADS56603.2022.00097
Ma, L., Yi, S., Carter, N., & Li, Q. (2019). Efficient Live Migration of Edge Services Leveraging Container Layered Storage.
Machen, A., Wang, S., Leung, K. K., Ko, B. J., & Salonidis, T. (2017). Live Service Migration in Mobile Edge Clouds. IEEE Wireless Communications 25, No. 1 (2017): 140-147. https://doi.org/10.1109/MWC.2017.1700011
Meliani, A. E., Mekki, M., & Ksentini, A. (2025). Resiliency focused proactive lifecycle management for stateful microservices in multi-cluster containerized environments. Computer Communications, 236. https://doi.org/10.1016/j.comcom.2025.108111
Mell, P. M., & Grance, T. (2011). The NIST definition of cloud computing. https://doi.org/10.6028/NIST.SP.800-145
Mirkin OpenVZ, A., Kuznetsov OpenVZ, A., & Kolyshkin OpenVZ, K. (2008). Containers checkpointing and live migration. In Proceedings of the Linux Symposium, Vol. 2, Pp. 85-90.
Muhammad Waseem, & Aakash Ahmad. (2024). Containerization In Multi-Cloud Environment: Roles, Strategies, Challenges, and Solutions for Effective Implementation. IEEE International Conference on Program Comprehension, 2022-March, 36–47.
Nawar A. Sultan, & Rawaa Putros Qasha. (2023). Blockchain-Based Framework for Secure Monitoring of Vehicles Traffic Flow System.
Nie, H., Li, P., Xu, H., Dong, L., Song, J., & Wang, R. (2017). Research on optimized pre-copy algorithm of live container migration in cloud environment. Communications in Computer and Information Science, 729, 554–565. https://doi.org/10.1007/978-981-10-6442-5_53
Open source container-based virtualization for Linux. (n.d.). Retrieved May 25, 2024, from https://openvz.org/
Pahl, C., Brogi, A., Soldani, J., & Jamshidi, P. (2017). Cloud Container Technologies: a State-of-the-Art Review. IEEE Transactions on Cloud Computing 7, No. 3 (2017): 677-692.
Pahl, C., & Lee, B. (2015). Containers and clusters for edge cloud architectures-A technology review. Proceedings - International Conference on Future Internet of Things and Cloud, FiCloud, 379–386. https://doi.org/10.1109/FiCloud.2015.35
Pallewatta, S., Kostakos, V., & Buyya, R. (2023). Placement of Microservices-based IoT Applications in Fog Computing: A Taxonomy and Future Directions. ACM Computing Surveys 55, No. 14s (2023): 1-43.
Puliafito, C., Virdis, A., & Mingozzi, E. (2020a). Migration of Multi-container Services in the Fog to Support Things Mobility. Proceedings - 2020 IEEE International Conference on Smart Computing, SMARTCOMP 2020, 259–261. https://doi.org/10.1109/SMARTCOMP50058.2020.00058
Puliafito, C., Virdis, A., & Mingozzi, E. (2020b). The Impact of Container Migration on Fog Services as Perceived by Mobile Things. Proceedings - 2020 IEEE International Conference on Smart Computing, SMARTCOMP 2020, 9–16. https://doi.org/10.1109/SMARTCOMP50058.2020.00022
Qasha, H. E. (2023). On the use of container-based virtualisation for IoT provisioning and orchestration: a survey. In Int. J. Computing Science and Mathematics (Vol. 18, Issue 4).
Red Hat Ansible Automation Platform. (n.d.). Retrieved September 28, 2024, from https://www.redhat.com/en/technologies/management/ansible
Run system containers with LXD. (n.d.). Retrieved June 11, 2024, from https://canonical.com/lxd
Sahni, Shashank, & Vasudeva Varma. (2012). A Hybrid Approach To Live Migration Of Virtual Machines. International Conference on Cloud Computing in Emerging Markets (CCEM), Pp. 1-5. IEEE.
Senel, B. C., Mouchet, M., Cappos, J., Friedman, T., Fourmaux, O., & Mcgeer, R. (2023). Multitenant Containers as a Service (CaaS) for Clouds and Edge Clouds. IEEE Access, 11, 144574–144601. https://doi.org/10.1109/ACCESS.2023.3344486
Singh, G., & Singh, P. (2022). A Container Migration Technique to Minimize the Network Overhead with Reusable Memory State. International Journal of Computer Networks and Applications, 9(3), 350–360. https://doi.org/10.22247/ijcna/2022/212560
Solayman H.E., & Qasha R. P. (2023). On the use of container-based virtualisation for IoT provisioning and orchestration: a survey. 18(Int. J. Computing Science and Mathematics), 299–311.
Stephen S, Herbert P, & Marc E. (2007). Container-based Operating System Virtualization: AScalable, High-performance Alternative to Hypervisors. EuroSys ’07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, 412.
Sun, J., Wu, C., & Ye, J. (2020). Blockchain-based Automated Container Cloud Security Enhancement System. Proceedings - 2020 IEEE International Conference on Smart Cloud, SmartCloud 2020, 1–6. https://doi.org/10.1109/SmartCloud49737.2020.00010
Swetha, R., Thriveni, J., & Venugopal, K. R. (2025). Resource Utilization-Based Container Orchestration: Closing the Gap for Enhanced Cloud Application Performance. SN Computer Science, 6(3). https://doi.org/10.1007/s42979-024-03624-4
What is Podman. (n.d.). Retrieved June 22, 2024, from https://docs.podman.io/en/latest/
Wu, T. Y., Guizani, N., & Huang, J. S. (2017). Related Dirty Memory Prediction Mechanism for Live Migration Enhancement in Cloud Computing Environments. Journal of Network and Computer Applications, 90, 83–89. https://doi.org/10.1016/j.jnca.2017.03.011
Yang, Y., Du, D., Song, H., & Xia, Y. (2024). On-demand and Parallel Checkpoint/Restore for GPU Applications. SoCC 2024 - Proceedings of the 2024 ACM Symposium on Cloud Computing, 415–433. https://doi.org/10.1145/3698038.3698510
Yang, Y., Hu, A., Zheng, Y., Zhao, B., Zhang, X., & Quinn, A. (2024). Transparent and Efficient Live Migration across Heterogeneous Hosts with Wharf. http://arxiv.org/abs/2410.15894
Yi, S., Hao, Z., Qin, Z., & Li, Q. (2016). Fog computing: Platform and applications. Proceedings - 3rd Workshop on Hot Topics in Web Systems and Technologies, HotWeb 2015, 73–78. https://doi.org/10.1109/HotWeb.2015.22
CITEDNESS IN SCOPUS
CITEDNESS IN WOS
