This reverts commit 57565f36.

Reason:

As far as we can tell, this should not be the case. Both localhost, 127.0.0.1
and ::1 is "supposed to work", so this is probably a bug somewhere.

Reopening #19815 instead.