Hardly ever" saves many a lie.

Meaning: Silence prevents false claims by avoiding the need to explain or justify hasty words.

Origin: From 'A Dictionary of English Proverbs and Proverbial Phrases' (1870). Public domain.