Categories
Artificial Intelligence (AI) Development

Why does KL divergence not satisfy the triangle inequality?

$D_{KL}=\sum_i p(x_i)log(p(x_i)/q(x_i)$

Also can’t you make it satisfy the triangle inequality by taking absolute value of information at every point?

Leave a Reply

Your email address will not be published. Required fields are marked *