Despite (oneself) phrase
Said to show that your previously mentioned action is unintentional or you don't want to do something.
They insulted me, despite themselves, as they thought I was their opponent.
Despite myself, I was attracted to him.
He let some strangers stay over , despite himself.
This phrase was formed based on the meaning of the conjunction "despite".