Parameter Estimation of Mutual Information Maximized Channels

Abstract

We study the problem of estimating a parametric discrete memoryless channel \( p(y \mid x; \boldsymbolθ) \) when the transmitter selects its input distribution \( π\) to maximize mutual information under the true parameter \( \boldsymbolθ^* \). Using only i.i.d.\ observations of the channel output, we aim to jointly estimate the capacity-achieving input distribution \( \boldsymbolπ^* \) and the true channel parameter \( \boldsymbolθ^* \). In general, recovery of \( \boldsymbolπ^* \) and \( \boldsymbolθ^* \) can be challenging. To that end, we propose two efficient algorithms based on the Blahut--Arimoto (BA) optimality conditions: (i) a bilevel fixed-point method and (ii) an augmented Lagrangian method. Empirical results demonstrate that both proposed algorithms successfully recover the true \( \boldsymbolθ^* \) and \( \boldsymbolπ^* \), whereas a naive maximum-likelihood approach that ignores the mutual-information maximization constraint fails to do so.