That hat's too far back on your head!
If you notice the first man when he gets up and puts on the hat, just before he opens the door to find his doppelganger there looking at him, it's already too far back, so when she tells the new guy "it's too far back" that's hogwash. Go back and look at the two characters and you'll see what I mean.
"Cum Grano Salis"