On a new machine, there's nothing to remove and so rm will return
an error. I'd like our prepare scripts not to return errors
unnecessarily!