Calibration/Refinement Decomposition of LOO Scores

[ParadaCarleton]

I think a breakdown of LOO scores into calibration/refinement would be interesting and useful to users. Mentioning @avehtari because Jonah mentioned you'd proposed adding this decomposition and said you might have some related work.

[avehtari]

@ParadaCarleton can you add here a reference to "calibration/refinement"

[ParadaCarleton]

It has now been 2 years and I have no idea what I was talking about then 😄

But I think this was the relevant paper that inspired this suggestion, though I'm not 100% sure.