Why are Assumpta and Peter missing for so much of season 3?

They're gone for two episodes at a time, twice so far. Was something going on behind the scenes? They were basically the stars and it doesn't seem typical that you would pull them from the show like that.