The only one that ever got the true drop on him was his father, if I remember correctly. Everyone got close but he defeated them. If his father chose to kill him he easily could have done so.