Why do the wife, kids, and maids travel alone?

From what I understand the family's province was in the far north of Honshu.

The father leaves to go south to Kyushu with an entourage. The rest of the family follows along the same road to go to the southern half of Honshu. Why would the four of them go alone? It's a long road, they have to have money for food and shelter, and it must be dangerous from other sources. But there they go walking by themselves. It seems an odd thing for them to do.