In 1860 the Green family, the owners, were not big slave holders...

According to the following essay, in 1860 the Green family were not big slave holders.
http://sociallogic.iath.virginia.edu/sites/default/files/EmmaGreenNarrative.pdf

Episode 1.1 shows two pretty daughters and one sickly son, who is chomping at the bit to enlist, even though he has a profound limp that would explain to any Southern patriot why he had not enlisted. The essay says that the Greens were immigrants, from England, not a long established southern family.

In episode 1.1 several scenes show the Green's (famous) furniture factory -- showing they employed slave labor there. Green senior tells his son that no matter who wins the Civil War factories like theirs will only employ skilled free laborers -- no slaves.

But the essay says the Green's never employed slave labor in their factory. They did employ slave labor in the hotel, but the bulk of those slaves weren't owned by the Greens. The Greens rented the labor of slaves owned by others. The essay says that Green's eldest sons, who had homes and families of their own, never owned any slaves. The parents did own a couple of slave, in 1860. The Green family was, apparently, the richest family in the city.

Oh yeah, the essay says that the Green family had eight siblings who survived to adulthood. They had five daughters and three sons.