As I see it... - SPOILER ALERT
I've read a few comments about this movie and, for the most part, I agree. This isn't the greatest but it could have been better. if it wasn't for the cliched sexist (against the man) approach to the story.
Most people seem to take issue with Tony; painting him as the 'bad' guy in the situation. In that regard, I disagree! My problem is with the wife, Lydia. She's has the wrong attitude. She's upset that her husband takes such an interest in his work he doesn't have much time to spend with her. I see that attitude often and I don't like it. If you're thinking it's because this is an old dated movie that's just showing its age, you're wrong. Similar themes appear in modern movies too. It's either the long-suffering, neglected wife saying her husband ignores her; or it's the whiny and selfish husband complaining the wife spends too much time with the kids. Either way, the husband usually is made to look bad. Even though I'm a woman, it drives me crazy.
In Skylark, Lydia didn't seem to have a problem with the perks that came from her husband's demanding career. They had the huge home, cars, an island home, a cook, housekeepers, nice clothes, vacations, jewelry, etc. And, when he says he said he quit his job, money would have been an issue. That means they hadn't been stockpiling it away. as it came in it was being spent.
I think it's totally selfish behavior on her part. On top of all the stress the guy had in his work life, he got little support from her; she just nagged. Granted, Tony suggesting she 'give' her cook to the Vantines is odd but Lydia handled it badly. She tried to make the 'people are not slaves' argument when the truth is she just didn't want to give up one of her perks. Perhaps she should have seen it as an opportunity to downsize so Tony could cut back too.
Lydia's real problem is her husband's hard work lets her live a life of leisure. She spends her days shopping, making scrap books, and chasing after the boyfriend of her husband's client. Perhaps if she did her own cooking, got a job, or volunteered, she wouldn't need Tony's constant attention.
It's very telling how Lydia calls out for Tony when she's on Jim's boat. For the first time she realizes how different life with Jim would be. Even Jim gets it. They're already divorced but she goes running back to Tony. Suddenly all is well even though he hasn't changed. He's on his way to a job when she chases the luxury liner to its first port of call. The no-frills, bare-bones, down-to-basics vessel Jim has just won't do. It's clear what matters to our dear Lydia.