Hayden Was Not Happy with This Film
I just picked up the Criterion Edition of Kubrick's "The Killing," and there is a fantastic interview with Sterling Hayden from 1984. He talks quite a bit about this movie, as well as other topics (including The Killing, of course, as well as HUAC).
Hayden says that Crawford was extremely "difficult", and chides her for being so harsh on her son - whom she corrected/criticized for everything he did - when he visited the set. He pulls back a little because he says, "well, she's dead now" and didn't think it was respectful (funny, since being dead in Hollywood usually opens the floodgates for the dirt!). He does add that he disliked her so much that he couldn't even bring himself to peek when she changed her pants on set, an opportunity he didn't often like to miss, as he puts it. The crew felt the same way, evidently, because they too looked away lest they catch of glimpse of Crawford scantily clad (boy, she must've REALLY been tough to be around to have this effect on men!).
Other than Crawford, Hayden mentions that he was also having a difficult time with his first wife at home, couldn't play guitar, nor was he comfortable around horses.