Better safe than sorry
Means exactly what it recommends, an English expression that has been around since the early 19th century and is first cited in Samuel Lover’s novel Rory O’More (1837).