A bad custom is like a good cake, better broken than kept.

Meaning: Harmful habits deteriorate further if preserved, but improve immediately when deliberately destroyed.

Origin: From 'A Dictionary of English Proverbs and Proverbial Phrases' (1870). Public domain.