Both could have tried harder in their marriage
When I first saw this film I truly hatted the duke and blamed him Completely for their loveless marriage but now I think Georgina could have done more too.
Sure he didn't help at all at the beginning with his attitude but maybe she could have tried more to seduce her Husband and ask him to be kinder when they were together or when she met bess she could have asked her to help her to make the duke care more for G
Bess just wanted her kids back so the duke gets bored of her, she gets her kids back and help a marriage to work without a scandal, if I'm right at the beginning Georgina found the duke attractive and he said she was beautiful.
So with some help their marriage could have worked