Throw the baby out with the bath water

This expression meaning do not discard essentials along with non-essentials has always been used metaphorically and was originally a German proverb from the 16th century. Contrary to folk etymology, the expression has never had a literal meaning or origin. The expression first appeared in English from the mid-19th century and is attributed to Thomas Carlyle.