Mr. Abbott was pretty resilient
He always kept cool despite the Holt slept with all three of his daughters (knowing at least for two of them). Despite that, he wasn't agressive, always kept calm ... not even raising his voice a single time !
On the waterfront, I was 100% sure he, and probably some paid men, would give Holt a lesson he would not forget.