It is as likely as any other explaination.
My actual explaination as to why women are called sluts has more to do with religious control. The best way to make people avoid premarital sex is to convince women that they are worthless sluts if they engage in it.
The video makes some pretty valid points, though. I mean, it is standup comedy, but I think what he says has at least some merit.