Olivia seemed pretty cold toward her father in the movie.
True, but you have to remember what went on between them throughout Olivia's life, and how it affected her when her dad wasn't really in her life growing up.
Wouldn't that be because he banned him after the divorce?