Why didn't Bobby ever visit sooner?

When Bobby arrives in New York, it's pretty obvious it was his first time there. Thing is, why? With Jonathan's having attended NYU and remained in the city, you'd think Bobby would've been itching to visit him at least a handful of times. I wonder if the two had drifted apart - or rather, if Jonathan had drifted apart from Bobby and everything else that reminded him of Cleveland, coming home only for holidays - during those years. This seems especially apparent when Jonathan brings up the topic of what the two of them used to do as kids. You'd think this talk would've happened much sooner.