Hell for leather

Flat out, at break-neck speed, dates from the late 19th century and is a hyperbole derived from riding a horse so hard that it is hell or extreme duress for the leather of the saddle, reins etc.