Not even really true of the old internet, depending how far back you want to go. Remember there are entire archives of Geocities, and everyone was frantically archiving the entire Yahoo Groups. There was the Dejanews archive of Usenet, and so on.

The idea that "I'm not important enough" needs to disappear. It doesn't matter if you're important or not to automated bots.