What is the significance of the charm?

When she finds her missing charm in his pocket at the end she becomes convinced he is the killer. Why? Didn't she lose that at his apartment the night they first had sex? How would him finding that mean anything?