The mirror people would be easily detected!

Right handed person will have a left handed mirror person, and vice versa, thus making them easily detected. Case closed!

Show me the holes!