Why delete poorly performing keywords in PPC?

In Good Adwords, why is it recommended that you delete poorly performing keywords?
In my view they could be considered niche words which though are searched for very little, may bring good conversions. Is that not the case? Is there any harm in keeping them there?

Original post by IndianGuy