Back down

Withdraw from a position or a commitment, an American expression that dates from the mid-19th century.