It's not he knew where it was when he was alive because Harry didn't die in real life.
George didn't find it. Clarence showed it to him.
By accident or design, it was right at the front of the cemetery.