Sure, but if a pissed-off rich person is willing to buy it, doesn't that mean your home's highest and best use [1] is as a rich person's cudgel to make you miserable?
So really, as a God-fearing capitalist you should be all for it!
Or you go around intentionally pissing off rich people in order to bait them into buying your home for double its value simply by doubling your property tax.