It's not pre "internet", but the earliest memes I remember were passed around in email chains. Stuff like dancing baby, the video of that office worker going ham on his computer, those websites with a gif some text and a sound file that spurred the creation of ytmnd.