Not that there is much wrong with holy Moses but this appears to be a rhyming euphemism for the latter, which dates in America from the late 19th/early 20th century.