The husband was full of BS

He definitely had affairs. He just didn't sleep with the prostitute his wife hired because this prostitute in particular was in love with his wife and wanted their marriage to be destroyed.

He definitely was not an honest man. And there was an unspoken dislike of his wife from both him and his son that we as the viewer will never understand.