What is the meaning of [every dog is allowed one bite]

Somebody may be forgiven for a single misdemeanor, provided that it does not happen again