Preprint: AGMARL-DKS: An Adaptive Graph-Enhanced Multi-Agent Reinforcement Learning for Dynamic Kubernetes Scheduling

Hamed Hamzeh 2026. Preprint: AGMARL-DKS: An Adaptive Graph-Enhanced Multi-Agent Reinforcement Learning for Dynamic Kubernetes Scheduling. arXiv. https://doi.org/10.48550/arxiv.2603.12031

TitlePreprint: AGMARL-DKS: An Adaptive Graph-Enhanced Multi-Agent Reinforcement Learning for Dynamic Kubernetes Scheduling
AuthorsHamed Hamzeh
Description

State-of-the-art cloud-native applications require intelligent schedulers that can effectively balance system stability, resource utilisation, and associated costs. While Kubernetes provides feasibility-based placement by default, recent research efforts have explored the use of reinforcement learning (RL) for more intelligent scheduling decisions. However, current RL-based schedulers have three major limitations. First, most of these schedulers use monolithic centralised agents, which are non-scalable for large heterogeneous clusters. Second, the ones that use multi-objective reward functions assume simple, static, linear combinations of the objectives. Third, no previous work has produced a stress-aware scheduler that can react adaptively to dynamic conditions. To address these gaps in current research, we propose the Adaptive Graph-enhanced Multi-Agent Reinforcement Learning Dynamic Kubernetes Scheduler (AGMARL-DKS). AGMARL-DKS addresses these gaps by introducing three major innovations. First, we construct a scalable solution by treating the scheduling challenge as a cooperative multi-agent problem, where every cluster node operates as an agent, employing centralised training methods before decentralised execution. Second, to be context-aware and yet decentralised, we use a Graph Neural Network (GNN) to build a state representation of the global cluster context at each agent. This represents an improvement over methods that rely solely on local observations. Finally, to make trade-offs between these objectives, we use a stress-aware lexicographical ordering policy instead of a simple, static linear weighting of these objectives. The evaluations in Google Kubernetes Engine (GKE) reveal that AGMARL-DKS significantly outperforms the default scheduler in terms of fault tolerance, utilisation, and cost, especially in scheduling batch and mission-critical workloads.

Year2026
Output mediaarXiv
PublisherarXiv
Publication dates
Published12 Mar 2026
Digital Object Identifier (DOI)https://doi.org/10.48550/arxiv.2603.12031
Web address (URL)https://arxiv.org/abs/2603.12031

Related outputs

Preprint: MAS-H2: A Hierarchical Multi-Agent System for Holistic Cloud-Native Autoscaling
Hamed Hamzeh and Parisa Vahdatian 2026. Preprint: MAS-H2: A Hierarchical Multi-Agent System for Holistic Cloud-Native Autoscaling. arXiv. https://doi.org/10.48550/arxiv.2603.07607

Orchestration in the Cloud-to-Things Compute Continuum: Taxonomy, Survey and Future Directions
Ullah, A., Kiss, T., Kovacs, J., Tusa, F., Deslauriers, J., Dagdeviren, H., Arjun, R. and Hamzeh, H. 2023. Orchestration in the Cloud-to-Things Compute Continuum: Taxonomy, Survey and Future Directions. Journal of Cloud Computing: Advances, Systems and Applications. 12 (135). https://doi.org/10.1186/s13677-023-00516-5

Interoperable Data Analytics Reference Architectures Empowering Digital-Twin-Aided Manufacturing
Marosi, A.C., Márk Emodi, Hajnal, A., Lovas, R., Kiss, T., Valerie Poser, Antony, J., Bergweiler, S., Hamzeh, H., Deslauriers, J. and Kovacs, J. 2022. Interoperable Data Analytics Reference Architectures Empowering Digital-Twin-Aided Manufacturing. Future Internet. 14 (4) e114. https://doi.org/10.3390/fi14040114

H-FFMRA: A Multi Resource Fully Fair Resources Allocation Algorithm in Heterogeneous Cloud Computing
Hamzeh, H., Meacham, S., Khan, K., Stefanidis, A. and Phalp, K. 2021. H-FFMRA: A Multi Resource Fully Fair Resources Allocation Algorithm in Heterogeneous Cloud Computing. 2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC). Madrid, Spain 12 - 16 Jul 2021 IEEE . https://doi.org/10.1109/compsac51774.2021.00172

MRFS: A Multi-resource Fair Scheduling Algorithm in Heterogeneous Cloud Computing
Hamzeh, H., Meacham, S., Khan, K., Phalp, K. and Stefanidis, A. 2020. MRFS: A Multi-resource Fair Scheduling Algorithm in Heterogeneous Cloud Computing. 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC). Madrid, Spain 13 - 20 Jul 2020 IEEE . https://doi.org/10.1109/compsac48688.2020.00-18

FFMRA: A Fully Fair Multi-Resource Allocation Algorithm in Cloud Environments
Hamzeh, H., Meacham, S., Khan, K., Phalp, K. and Stefanidis, A. 2019. FFMRA: A Fully Fair Multi-Resource Allocation Algorithm in Cloud Environments. 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI). Leicester, United Kingdom 19 - 23 Aug 2019 IEEE . https://doi.org/10.1109/smartworld-uic-atc-scalcom-iop-sci.2019.00091

A New Approach to Calculate Resource Limits with Fairness in Kubernetes
Hamzeh, H., Meacham, S. and Khan, K. 2019. A New Approach to Calculate Resource Limits with Fairness in Kubernetes. 2019 First International Conference on Digital Data Processing (DDP). London, United Kingdom 15 - 17 Nov 2019 IEEE . https://doi.org/10.1109/ddp.2019.00020

MLF-DRS: A Multi-level Fair Resource Allocation Algorithm in Heterogeneous Cloud Computing Systems
Hamzeh, H., Meacham, S., Virginas, B., Khan, K. and Phalp, K. 2019. MLF-DRS: A Multi-level Fair Resource Allocation Algorithm in Heterogeneous Cloud Computing Systems. 4th International Conference on Computer and Communication Systems (ICCCS). Singapore 23 - 25 Feb 2019 IEEE . https://doi.org/10.1109/ccoms.2019.8821774

An adaptive E-commerce application using web framework technology and machine learning
Hamzeh, H. 2018. An adaptive E-commerce application using web framework technology and machine learning. BCS SQM/Inspire 2018. London, United Kingdom 26 Mar 2018

Taxonomy of Autonomic Cloud Computing
Hamzeh, H., Meacham, S., Virginas, B. and Phalp, K. 2018. Taxonomy of Autonomic Cloud Computing. International Journal of Computer and Communication Engineering. 7 (3), pp. 68-84. https://doi.org/10.17706/ijcce.2018.7.3.68-84

Bandwidth Allocation with Fairness in Multipath Networks
Hamzeh, H., Hemmati, M. and Shirmohammadi, S. 2017. Bandwidth Allocation with Fairness in Multipath Networks. International Journal of Computer and Communication Engineering. 6 (3), pp. 151-160. https://doi.org/10.17706/IJCCE.2017.6.3.151-160

Priced-Based Fair Bandwidth Allocation for Networked Multimedia
Hamzeh, H., Hemmati, M. and Shirmohammadi, S. 2017. Priced-Based Fair Bandwidth Allocation for Networked Multimedia. 2017 IEEE International Symposium on Multimedia (ISM). Taichung, Taiwan 11 - 13 Dec 2017 IEEE . https://doi.org/10.1109/ism.2017.14

Permalink - https://westminsterresearch.westminster.ac.uk/item/x66z3/preprint-agmarl-dks-an-adaptive-graph-enhanced-multi-agent-reinforcement-learning-for-dynamic-kubernetes-scheduling


Share this

Usage statistics

1 total views
0 total downloads
These values cover views and downloads from WestminsterResearch and are for the period from September 2nd 2018, when this repository was created.