Rock the boat
To do or say something that causes a problem or stirs up trouble dates from the early 20th century and derives from the obvious allusion to upsetting the equilibrium of a boat by careless movement.