Intolerance for the intolerant

Why is it considered acceptable, even admirable, to harbor intolerance for those who are intolerant? Does it make us just as bad as them, or is it somehow justified?