It's so frequent now that some contacts get dropped between clients that you can't really judge anymore if an unfollow is intentional or not.

I should just turn off my notifications for that.