Significance of color?

What was the significance(if any) of everyone only wearing black, white or both? Only a couple times did anyone wear a different color and they ended up dead