It might, but there are thousands of people with awful stories about Heroin. Negative effects extend far beyond the individual user, entire communities can be crushed by it's use.

Most of the effects that extend beyond the user are more a facet of prohibition than the drug use itself, no?

That is another point in entirely. But yes you are quite right. That is true for most drugs and how they are consumed.