Definitely. And it can be super subtle. Sometimes it's fun to go back and try to unpack what it was that broke the immersion and made me start caring/nitpicking about realism all of a sudden.
I also think it is true that some people come into a film not wanting to give it much benefit of the doubt and will immediately seize on an excuse not to like it. With the right mindset, you could sort of rip any film to shreds.