Sometimes it happens 2 seconds after a rest, sometimes not for hours, sometimes it happens when I have spells on me, sometimes it happens when I'm just sitting around a campfire without any spells on me, there doesn't appear to be anything that is happening to trigger it.