"You'll forgive me for saying ..."

"... that there have been times when I thought you ought to be hanged — but I’ve always been fond of you, and now I like you; and just for a last-word: there may be somebody else in this town who’s always felt about you like that — fond of you, I mean, no matter how much it seemed you ought to be hanged."