Yes, this is an actual cognitive distortion, called all-or-nothing thinking. It's not easy at all, an extreme form of overgeneralization. It's extremely tough to break.