A little mischief is too much.

Meaning: Even small wrongdoings corrupt character and inevitably lead to greater transgressions if left unchecked.

Origin: From 'A Dictionary of English Proverbs and Proverbial Phrases' (1870). Public domain.