61
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Greedy Algorithms for Optimal Distribution Approximation

      Preprint

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The approximation of a discrete probability distribution \(\mathbf{t}\) by an \(M\)-type distribution \(\mathbf{p}\) is considered. The approximation error is measured by the informational divergence \(\mathbb{D}(\mathbf{t}\Vert\mathbf{p})\), which is an appropriate measure, e.g., in the context of data compression. Properties of the optimal approximation are derived and bounds on the approximation error are presented, which are asymptotically tight. It is shown that \(M\)-type approximations that minimize either \(\mathbb{D}(\mathbf{t}\Vert\mathbf{p})\), or \(\mathbb{D}(\mathbf{p}\Vert\mathbf{t})\), or the variational distance \(\Vert\mathbf{p}-\mathbf{t}\Vert_1\) can all be found by using specific instances of the same general greedy algorithm.

          Related collections

          Author and article information

          Journal
          1601.06039

          Numerical methods,Information systems & theory
          Numerical methods, Information systems & theory

          Comments

          Comment on this article