I thought I would hate not seeing points on comments, but I find it's been very refreshing. It's much rarer that I find myself annoyed at the number of people who have upvoted something stupid or ignored something insightful. I still see the points on my own comments, which is the important part.

My vote: definitely continue hiding the points. It takes focus away from the content.