Go by the board

To let something go by the board is to finish with it or let it pass or go, as in to throw overboard. It was originally a nautical expression dating from the 1600s but started to be used in its current figurative sense from the early 19th century.