When are discrete channel inputs optimal? — Optimization techniques and some new results

Discrete channel inputs have been shown to maximize mutual information under various settings. This paper offers a brief review of corresponding optimization methods. Specifically, two techniques are considered; the first is rooted in the theory of linear optimization whereas the second is based on ideas from convex optimization.