Archiving 300,000 Fidonet messages

In 2015, I began looking for archives of networked BBS messageboards, hoping to find contemporary discussions of BBS door games from the 1990s. The best source I found was the fidonet.ozzmosis.com archive.

The Ozzmosis archive is awesome — and it’s still active, archiving any new messages posted to Fidonet. (yes, Fidonet still exists!) But I quickly realized the archive was heavily weighted to the new millenium. I put my data journalism skills to work, analyzing the dates of every message in the Ozzmosis archive. I found that only 7% of the archive was from years prior to 2000.

That realization set me on a search. I began visiting long-running BBSes, looking for caches of old Fidonet messages. I found two, of differing scopes.

Do you enjoy my retrocomputing research on Break Into Chat? Please join my email list so I can share future projects with you. 📬

Wisconsin-based ExecPC BBS, once one of the largest bulletin boards in the world, had continued running in a sort of suspended animation since its heyday. I had an old user account on this BBS, but I had never been active. As I poked around, I found ExecPC had extensive local and Fidonet messageboards. The Fidonet boards contained hundreds of thousands of old messages from the late 1990s, though some boards went as far back as 1993.

I wrote a Python script that could telnet to the BBS and save the messages locally. Because of oddities in ExecPC’s time limits and user limits, this archiving process took weeks. But eventually I had saved all the Fidonet messages.

The other BBS was Starfleet HQ, a resurrected Atari ST board which I loved to call. It hosted some of my favorite games, including Space Empire Elite, and a number of frozen-in-amber networked message bases on Atari topics. Some of these were Fidonet, and others were from Atari networks. Again, I wrote a new scraper to capture Starfleet HQ’s Fidonet messages and saved them to a text file.

Unfortunately, both these BBSes have gone offline since 2015. There’s some hope Starfleet HQ may come back to life again, but I imagine ExecPC is gone for good.

This year I finally made contact with the maintainer of the Ozzmosis archive. I sent him my caches, and I hope that the messages can be integrated there. That’s really where they belong. But I also sent them to Jason Scott, who made sure they are permanently housed on archive.org.

Finally, please check out my Fidonet Message archive in the Special Collections section of Break Into Chat, which includes download links and much more explanation and analysis of the 300,000 messages I collected.


Posted

in

by

Comments

3 responses to “Archiving 300,000 Fidonet messages”

  1. April Avatar

    Any idea how long http://fidonet.ozzmosis.com/ has been down for? I came across this article, downloaded the archive.org link, but the best I’m getting from ozzmosis.com is a Wayback Machine scrape from June 16th, 2019. I do hope the newer Fidonet data is still being archived somewhere.

    And good work on the earlier scraping of the Fidonet messages. Being on archive.org certainly makes me feel a lot better about the data remaining in existence.

    1. Josh Renaud Avatar

      April, I apologize for not getting back to you sooner. I’m honestly unsure what happened to Andrew Clarke’s Ozzmosis site. I was corresponding with him in May, but then it all just went down. Very distressing.

  2. Glenn Rossi Avatar

    The entire Fidonet Archive was scraped before it went offline. The Exec-PC collection was merged into it. Several related Usenet newsgroups were retrieved and archived as well. All of this is tentatively online at:

    https://www.ipingthereforeiam.com/bbs

    New Fidonet messages have been and are being archived as well.

Share your thoughts!