Because it does not swallow errors if it fails to remove the given
folders, making issues easier to debug.

https://github.com/rubygems/rubygems/commit/0db12d7afc