Well now I'm even more confused.
Upon reopening the thread, the issue seems to have resolved itself.
I'm just going to see if it happens again.
Yes it does.
It would seem it only does it when you return to the thread having cancelled an edit, but if you reload the thread then the issue is gone, so I presume only the author of a post will ever see this behaviour.