Reinforced Workload Distribution Fairness - École polytechnique Access content directly
Conference Papers Year :

Reinforced Workload Distribution Fairness

Zhiyuan Yao
Zihan Ding
  • Function : Author
  • PersonId : 1114902
Thomas Heide Clausen

Abstract

Network load balancers are central components in data centers, that distributes workloads across multiple servers and thereby contribute to offering scalable services. However, when load balancers operate in dynamic environments with limited monitoring of application server loads, they rely on heuristic algorithms that require manual configurations for fairness and performance. To alleviate that, this paper proposes a distributed asynchronous reinforcement learning mechanism to-with no active load balancer state monitoring and limited network observations-improve the fairness of the workload distribution achieved by a load balancer. The performance of proposed mechanism is evaluated and compared with stateof-the-art load balancing algorithms in a simulator, under configurations with progressively increasing complexities. Preliminary results show promise in RLbased load balancing algorithms, and identify additional challenges and future research directions, including reward function design and model scalability.
Fichier principal
Vignette du fichier
rlb-ml4s-neurips-2021.pdf (1.17 Mo) Télécharger le fichier
rlb-ml4s-neurips-2021.synctex.gz (91.7 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03405824 , version 1 (28-10-2021)

Identifiers

  • HAL Id : hal-03405824 , version 1

Cite

Zhiyuan Yao, Zihan Ding, Thomas Heide Clausen. Reinforced Workload Distribution Fairness. 5th Workshop on Machine Learning for Systems at 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Dec 2021, Sydney, Australia. ⟨hal-03405824⟩

Collections

X IP_PARIS
22 View
13 Download

Share

Gmail Facebook Twitter LinkedIn More