I think he felt self-conscious because of the attraction that he had to Sophie, and the fact that she and everyone else was looking at him. Or might have had something to do with what Maddox said to him when he first arrived, when he told him to 'cover all this up' in reference to his body and inappropriate t-shirt, even though Sydney really wasn't that out of shape.