IIS error - value does not fall within the expected range

A site was stopped in ISS and when I attempted to start it the error "Value does not fall within the expected range" would occur. This error occurred because one of the bindings somehow contained an invalid character (in this case a space). Fixing up the binding then allowed the site to be started.