To destroy spore armor more effectively, use special anti-spore weapons. Normal weapons can also penetrate such armor, but that requires more time and ammo.