How much of this is about autism?
Eliezer's behavior throughout could be explained as his being an overly-pedantic highly-individualistic sour old man.
It could ALSO be explained as his being on the autism spectrum.
(For example, a possible subtext was that Grossman was personally "uncomfortable" with Eliezer's personality [which typical of autism would have been even stranger when Eliezer was younger]. Uriel at one point explicitly states his father is "weird". And it's implied that Grossman finds Eliezer's scholarly contributions --even in the world of Talmudic scholarship-- to be so picayune they're not useful.)
In either case, how could he have such a seemingly comfortable relationship with the "mystery woman" when he couldn't relate to anyone else very well?
And more importantly, do you think autism caused sourness (or sourness caused autism)?