What ruins the plot

Actually, only those physically close to him, people who are at the epicenter of his effective dreaming, remember the changes. And then only somewhat hazily, as the new reality settles in to replace the old. Once Dr. Haber & Heather witness George dreaming & comprehend that reality is changing, that knowledge stays with them.