This expression dates from the late 19th/early 20th century and is a metaphor for the hoarse croaking sound one makes when one has to clear phlegm or saliva in one’s throat.