It is possible that Bill used to slap Antony at the nursing home?
Theres a 50/50 chance of that being something he imagined.
As we see things from his perspective, we don't necessarily know what's true about this.