Parting shot

A final word or act delivered just before leaving, dates from the early 19th century and derives from the earlier, literal use of firearms while retreating or escaping.