Not only is their attitude disgustingly unfair towards the men involved, it also makes life infinitely more difficult for people who are legitimately raped. The default reaction is going to be "she's making it up", which isn't okay either.