Loose thread (spoiler)

I just watched this movie on Netflix and found it enjoyable. I initially watched with English dubbing but it was horrible. When I switched over to Norwegian with English subtitles it was much better.

I have an issue with one aspect, however I may have missed something. I was under the impression that a large percentage of Birkebeinernes support the new King, and he will make an alliance with the oncoming Baglers. It was implied that the Baglers are a large, brutal force who already control half of Norway. As the movie progresses the two main characters and their small band of loyal country people slowly whittle down the group seeking to kill the baby. When they finally kill the main bad guy they return to the castle, the baby is recognized as the rightful king, and all is right with the world. I was waiting to see how they would regroup and come up with some plan to defeat the onslaught of the Baglers, but that never happened. Is it possible that the two main characters killed them all? Was there really only about two dozen Baglers? Either the threat of the Baglers was much overplayed in the beginning, or the movie skipped how they were dealt with.