Was Shep rich like Vivi and her friends?

I know he mentioned working in the fields, but he was also at Vivi's birthday party and apart of their social circle. So was he just one of those guys who worked alongside his tenants or something like that?

"A half-finished book is, after all, a half-finished love affair."