Down on one's luck

To be down on one's luck is to experience a time of ill-fortune, dates from the early 19th century.