p(x|y) as a nonlinear correlation metric?
Published:
Correlation captures a narrow kind of dependence: linear association between variables. Could comparing conditional distributions, \(p(x \mid y)\), provide a more general way to characterize how much knowing \(Y\) changes what we expect about \(X\)?
This is almost certainly an idea many people have explored before, under various names and in different mathematical forms. Iām curious what the closest existing concepts are, and how they relate to mutual information and other measures of statistical dependence.