Bug - Sleep Debuff (Nightmare?)

When I use the Nightmare spell gem, after creatures go to sleep, 80% of the time when they next act they immediately ‘wake up’ while keeping the debuff and acting normally. When damaged the debuff clears and it says they wake up again.