Rub up the wrong way
Means to irritate or annoy someone and dates from the late 19th century. The expression derives from rubbing a cat or dog’s fur in the opposite direction to which it grows.