Black mark

A black mark against one’s name is a mark of censure, more often figuratively than literally, and dates from the early 19th century. See also Black.