The bar scene did you notice (spoilers)

When the street gang and the maffia have a shootout, did you notice that when harvey keithel says: fu*k you refried, and rapahel replies: fu*k me haha fu*k you.. after he say that to keithel he gets this facial expression like he is thinking what did i just say, and regrets it and gets a bit scared like he know it´s was done with them all