The flashback younger kids were way more interesting

I agree. On the bright side, the younger characters appear way more in the film than in the novel, where their entire backstory was crammed into the first two chapters. Very glad Liana Liberato got so much extra screen time. :)