Andy left his son to Deb?

No, you were just meant to think that for a moment before it switched back to the baby really in the car with his father. Nate's mom was saying earlier that she sometimes would look back and see Nate there as a baby, so that set it up to momentarily make one think that.