Father's speech about infidelity

Did I correctly see that he explained his reason for being unfaithful right in front of his wife? What makes it even more shocking is that he was right in a middle of a scandalous affair!

Is this how the scene played out? In front of his wife?