Header menu link for other important links
X
Relative $\alpha$-entropy minimizers subject to linear statistical constraints
, Rajesh Sundaresan
Published in Institute of Electrical and Electronics Engineers Inc.
2015
Pages: 1 - 6
Abstract
We study minimization of a parametric family of relative entropies, termed relative $\alpha$-entropies (denoted I$\alpha$(P,Q)). These arise as redundancies under mismatched compression when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the usual relative entropy (Kullback-Leibler divergence). Just like relative entropy, these relative $\alpha$-entropies behave like squared Euclidean distance and satisfy the Pythagorean property. Minimization of I$\alpha$(P,Q) over the first argument on a set of probability distributions that constitutes a linear family is studied. Such a minimization generalizes the maximum R{\'{e}}nyi or Tsallis entropy principle. The minimizing probability distribution (termed I$\alpha$-projection) for a linear family is shown to have a power-law.
About the journal
JournalData powered by Typeset2015 21st National Conference on Communications, NCC 2015
PublisherData powered by TypesetInstitute of Electrical and Electronics Engineers Inc.
Open AccessNo