Why was everyone looking at Lancy when he took Pig out?

They acted like he did something wrong, its poker, people are going to lose and he was easy money to take out. Pig, I can see why he would be mad he lost but even Steve McQueen's character looked at him kind of queer, like he did something wrong.