I personally find that seeing the points by comments allows me to see interesting comments while I am skimming over a thread. I wouldn't mind having points hidden if there was some way that the most commented on threads or most popular threads appeared closer to the top of the story.