Have any of the former owners ever given them grief?

I just saw the dog house episode, and you can see the name of the business on the flier.

And, I'm sure the locals know who lived in the houses, and some of these houses can be embarassing like the makeshift plastic surgery house, the blackmail photos, etc...

I don't think former owners would have any rights to complain, but perhaps there was fallout in some way?