Tonsil stones form in cracks in the tonsils like this one. They cause a bad tasteb and bad breath.

Not only that but because they are organic material - salivary debris, food etc, they slowly rot due to saprophytic bacteria growing in them. This can trigger recurrent attacks of tonsillitis.