Deep Learning-Assisted Multicast Subgrouping in Massive MIMO

Abstract

Efficient content delivery in massive multiple-input multiple-output (mMIMO) multicasting is fundamentally limited by pilot overhead and the need to serve heterogeneous users with a common transmission rate. Conventional approaches either suffer from pilot contamination or are constrained by the worst-user effect, motivating the need for adaptive subgrouping strategies. In this paper, we propose a deep learning-assisted multicast subgrouping framework that infers the number of multicast subgroups directly from users' spatial channel statistics. A snapshot-specific principal component analysis (PCA) is applied to user covariance matrices to obtain a compact representation, which is processed by a sequential long short-term memory (LSTM) encoder capable of handling variable-size user sets. The model predicts the number of subgroups and groups of users based on their statistical similarity. To further improve system performance, we introduce a transfer learning (TL) extension where a pretrained LSTM encoder is reused, and a lightweight dense head is fine-tuned to estimate the sum spectral efficiency (SE) as a function of the subgroup configuration. This enables selecting near-optimal subgrouping solutions without exhaustive search. Simulation results demonstrate that the proposed approach consistently outperforms benchmark methods, including unicast transmission, conventional multicast, random subgrouping, and density-based clustering. The TL-enhanced model achieves up to 85% of the maximum achievable spectral efficiency while maintaining robust performance across diverse spatial user distributions and under imperfect covariance information.