It sounds diplomatic to let each group choose their preference, but what is much more valuable here is to learn what exactly those preferences are, and why they are held. If there were an option to let each choose according to their preference, then we could all quietly revert to our preferences instead of taking the opportunity to be confronted with a bigger picture.
I'm not so sure there is a bigger picture, just a bunch of people who each get different things out of reading/posting here on the site. Look at any of the comments on the articles about this so far, and you get the what and the why (people's reasons seem to run the gamut).
But let's postulate that we revert back to the previous system where comment points are displayed. I can't think of a reason why it would matter if I personally don't want to see comment points.