Agnosticism not always canceling cast at start spell properties

I have the agnosticism punishment on and spells occasionally cast at the start of battle still.

Example, tsunami cast when it wasn’t my turn.

I do have about 10 cast at start of battle spell gems.
I don’t know if having the instablity punishment active could be causing it or not.

2.3.2
Win 10