This is true, but i feel it's more the nature of the decision making than the actual decisions which irritates most people.
In no other sport or game would you expect anything less than the rules being followed to the letter, yet in Football, if someone is proven to be offside its disgusting because it was only a few millimetres (aka, against the rules).
Var reaches the correct decision eventually more often than the current standard of officiating without it.
Basically, you either want the rules to be applied, or you want to be able to bend them. I would rather have the rules applied, even if it is irritating much of the time.