Master’s Thesis Presentation • Systems and Networking • 5G RAN/MEC Slicing and Admission Control using Deep Reinforcement Learning

Please note: This master’s thesis presentation will take place online.

Arash Moayyedi, Master’s candidate
David R. Cheriton School of Computer Science

Supervisor: Professor Raouf Boutaba

The 5G RAN functions can be virtualized and distributed across the radio unit (RU), distributed unit (DU), and centralized unit (CU) to facilitate flexible resource management. Complemented by multi-access edge computing (MEC), these components create network slices tailored for applications with diverse quality of service (QoS) requirements. However, as the requests for various slices arrive dynamically over time and the network resources are limited, it is non-trivial for an infrastructure provider (InP) to optimize its long-term revenue from real-time admission and embedding of slice requests. Prior works have leveraged Deep Reinforcement Learning (DRL) to address this problem, however, these solutions either do not scale to realistic topologies, require re-training when facing topology changes, or do not consider the slice admission and embedding problems jointly.

In this thesis, we use multi-agent DRL and Graph Attention Networks (GATs) to address these limitations. Specifically, we propose novel topology-independent admission and slicing agents that are scalable and generalizable to large and different metropolitan networks. Results show that the proposed approach converges faster and achieves up to 35.2% and 20% gain in revenue compared to heuristics and other DRL-based approaches, respectively. Additionally, we demonstrate that our approach is generalizable to scenarios and substrate networks previously unseen during training, as it maintains superior performance without re-training or re-tuning. Finally, we extract the attention maps of the GAT, and analyze it to detect potential bottlenecks and efficiently improve network performance through eliminating them.

To join this master’s thesis presentation on Zoom, please go to https://uwaterloo.zoom.us/j/2315498991.