Omnimaga

Omnimaga => News => Topic started by: DJ Omnimaga on February 26, 2012, 04:49:39 am

Title: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 26, 2012, 04:49:39 am
(http://www.omnimaga.org/index.php?action=dlattach;topic=12728.0;attach=11910;image)

Since this incarnation of Omnimaga started, the goal was to either merge the old boards with this one or convert it to SMF as soon as Invisionfree restores the content. Since the Invisionfree team restored their content earlier this month, over the past weeks or so, I started attempting conversions of the old boards posts into SMF format. Thanks to a Zetaboards->SMF script on Simplemachines Forums and an Invisionfree->SMF script by Jimbauwens, the old data was finally converted into 3 SMF databases, which were later merged together with the help of MyBB Merge System (a temporary conversion to MyBB was required for this).

Afterward, the next goal was to sort all the 16000+ posts from the z7 IF site into their appropriate categories, as they were all scrambled into a single one.

All of this has now been done, everything is in the exact same format as this board install and hosted on Netham45 server. The only thing, however, is that several of the old posts and topics were duplicates of several sections of the current site, such as the About section, the articles, file archives info pages, along with the old link section that eventually got replaced with TI-Freakware's (http://tifreakware.net/admin/link.php?catag=index) in April 2006. Those posts were not kept during the move. The staff section of the z9 board was also pruned, since nobody would be able to access it anyway. This resulted in the loss of over 2000 posts and 800 topics. Special thanks to Netham45 and Jimbauwens for fixing some of the compatibility issues that occured through the multiple conversion processes. Granted, some of the old posts data has partially be lost in the process, but what matters is that it is now located here. The move from Invisionfree also means that it's now possible to actually search through those old posts!

Since the old posts are still a separate database from the current site, for now that part of Omnimaga still remains independent in some ways. As a result, when you visit it, several Omnimaga features will be disabled there:
-OmnomIRC
-Post rating system
-Logging in (basically you view that board as guest, in read-only mode. I guess it's good to stop necroposting, though.)
-Skin settings (an alternate skin, using the current default design but the old color scheme, will replace your usual skin. That alternate skin can be viewed here (http://djomni.57o9.org/oldboardmergedsmf/).)

The archives, which are still being worked on, can be accessed from the board index below the suggestions board or at www.omnimaga.org/oldsite2 (http://www.omnimaga.org/oldsite2/).

TODO List:
-Install the alternate forum theme in the archives (in the works: Some images are still missing)
-Move http://djomni.57o9.org/oldboardmergedsmf/smileyreplacer.gif to http://www.omnimaga.org/Themes/omnimaga4/images/
-Get rid of the board statistics at the bottom of the board index (along with the EzBlocks), along withe the latest activity EzBlock at the top.
-Fix the Omni front page and board index's total post count since 2005 to reflect the deletion of the 2200 posts and 800 topics.
-Fix the Old Board Archive postcount on the Omnimaga board index so it says 54207 posts in 2329 topics instead of 56401 posts in 3126 or simply sync it with the archive.
-Fix the top navigation so that it's the exact same as the current site. (in the works: Login/Register links still won't switch to Inbox/Logout when logged in on the current board)
-Change some board titles and descriptions to the current ones, to make it easier for newer users to visit the archives.
-Merge every category (News, Community, International) into one, to make sure the entire board looks like an actual sub-forum rather than a separate board

Other possible future fixes and additions:
-Share current forum accounts with the old board, so you can use OmnomIRC and have the same skin on both sites.
-Merging entire board with current one (less likely, due to how SMF handles topic sorting)

For those who still want to browse the old topics in their original format, you can still do so here (http://z9.invisionfree.com/omnimaga). In the future, a full copy of that site might be done as is for nostalgia purposes, in case Invisionfree ever shutted down.

Enjoy!
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 26, 2012, 07:30:26 am
Well done for such a mammoth effort from DJ_O, Netham45, Juju and the rest of the team! What is being attempted is quite unprecedented, a feat that few other sites would dare to attempt, and it is great to see the results so far!

PS: I quite like the alternative archive theme.
Title: Re: The Old board archive SMF conversion project
Post by: Jim Bauwens on February 26, 2012, 09:34:57 am
Glad the theming worked out :)

Also, could you give me some links to the a topic with <!-- bugs? I thought I removed all of those stuff x.x

Title: Re: The Old board archive SMF conversion project
Post by: Eeems on February 26, 2012, 12:23:06 pm
The conversion is finally done?! You've been working on that for like, forever :P
Yay!
Title: Re: The Old board archive SMF conversion project
Post by: Netham45 on February 26, 2012, 12:35:31 pm

Since the old posts are still a separate database from the current site, for now that part of Omnimaga still remains independent in some ways. As a result, when you visit it, several Omnimaga features will be disabled there:
-OmnomIRC
-Post rating system
-Logging in (basically you view that board as guest, in read-only mode. I guess it's good to stop necroposting, though.)
-Skin settings (an alternate skin, using the current default design but the old color scheme, will replace your usual skin. That alternate skin can be viewed here (http://djomni.57o9.org/oldboardmergedsmf/).)

TODO List:
-Fix broken posts (as in, add a bad word filter to get rid of "<!--" strings that makes some threads unviewable)
-Install the alternate forum theme in the archives
-Get rid of the board statistics at the bottom of the board index (along with the EzBlocks)
-Fix the Old Board Archive postcount on the Omnimaga board index so it says 54207 posts in 2329 topics instead of 56401 posts in 3126 or simply sync it with the archive. (During the move, the former links database, the two downloads sections as well as several duplicate pages that are already available here were deleted)
-Fix the Omni front page and board index's total post count since 2005 to reflect the deletion of the 2200 posts and 800 topics.
-Fix the top navigation so that it's the exact same as the current site.
-Change some board titles and descriptions to the current ones, to make it easier for newer users to visit the archives.

Other possible future fixes and additions:
-Share current forum accounts with the old board, so you can use OmnomIRC and have the same skin on both sites.
-Merging entire board with current one (less likely, due to how SMF handles topic sorting)


OmnomIRC now works on the archives (It was really simple due to the way that I'm handling user logins)
Fixed the broken posts
Installed the themes
Removed as many of the ezblocks as I could
Fixed the navigation bar
Title: Re: The Old board archive SMF conversion project
Post by: Juju on February 26, 2012, 12:51:44 pm
Glad it worked out! We had a lot of problems in the process, but it worked, thanks to DJ_O, jimbauwens, Netham45 and myself :D
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 26, 2012, 01:15:04 pm
OmnomIRC now works on the archives (It was really simple due to the way that I'm handling user logins)
Fixed the broken posts
Installed the themes
Removed as many of the ezblocks as I could
Fixed the navigation bar
Actually OmnomIRC still doesn't work on my side. It still shows the block saying it's disabled even if I'm logged in from here. The navbar also won't update when I'm logged in (so the login/register button won't get replaced with Inbox/logout).

Also if the themes are installed, does it means the alternate theme will finally not make it through? So far my theme settings over here won't carry over the old board archive.

Nice work so far though. I'll update the first post with everything that remains to be done yet.
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 26, 2012, 08:34:31 pm
Same, the "OmnimIRC is not available..." is still there.
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 26, 2012, 08:39:36 pm
Actually now I think Netham45 is trying to integrate the old posts here as he found a way to do it without touching the current IDs. Basically, Omnimaga would have a minus world like Super Mario Bros :P
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 26, 2012, 08:53:00 pm
Yeah, I may have mentioned having negative topic IDs somewhere, (if I did?)
It's a good workaround.
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 26, 2012, 09:03:43 pm
Yeah or maybe it was Netham45. I wasn't sure if it would work because I didn't know if SMF and MySQL could support such thing, but it seems he managed to do it, in addition to adding all the missing columns to the old post tables.

Also by having the old posts here they would be sorted with the rest and on top of that some old threads like Lost Legends 1 and 2 and Pokémon Purple could be moved back to their new project sub-forums (or even merged). Now hoping there isn't too much necroposting, though. <_<
Title: Re: The Old board archive SMF conversion project
Post by: Juju on February 26, 2012, 10:06:34 pm
Cool, minus worlds :D
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 27, 2012, 03:41:42 am
Actually now I think Netham45 is trying to integrate the old posts here as he found a way to do it without touching the current IDs. Basically, Omnimaga would have a minus world like Super Mario Bros :P
Cool, minus worlds :D

Actually, I did think of it, but I don't think I posted about it. But from what I can see, it's the most viable and easy solution. However it would be weird to find out which topic has the lowest Topic ID, and try and count up from that.
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 27, 2012, 03:46:02 am
Actually now I think Netham45 is trying to integrate the old posts here as he found a way to do it without touching the current IDs. Basically, Omnimaga would have a minus world like Super Mario Bros :P
Cool, minus worlds :D

Actually, I did think of it, but I don't think I posted about it. But from what I can see, it's the most viable and easy solution. However it would be weird to find out which topic has the lowest Topic ID, and try and count up from that.
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 27, 2012, 04:40:56 am
Netham45 is it me or does double-posting (accidental) like this occurs more since the boards are tied more together? Last night I clicked submit once and it posted the same message twice ???
Title: Re: The Old board archive SMF conversion project
Post by: apcalc on February 27, 2012, 04:38:46 pm
Great news, and great work! :)
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 28, 2012, 05:39:20 am
Great news, and great work! :)

Also I just noticed that the format of the Quotes have changed, with standard font at the top of the quote (outside the quote box) and bold small font for the quote content. Is this mentioned anywhere?

Netham, what have you done?

jks. It just looks quite different, trying to get used to it...
Title: Re: The Old board archive SMF conversion project
Post by: TIfanx1999 on February 28, 2012, 06:25:30 am
A Mammoth thank you to you guys for all the time and effort that went into this conversion. You guys are awesome! :D :D :D
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on February 28, 2012, 02:46:48 pm
Yeah thanks a lot Netham, jim, juju and whoever else participated. :D
Title: Re: The Old board archive SMF conversion project
Post by: Jonius7 on February 28, 2012, 08:12:52 pm
Few other websites/communities go to such an extent to restore the old forums, to the point where it is now located within the same boards! Must be an almost unprecedented move by those who contributed. And the results are for all to see. Well done!

What's next?
Title: Re: The Old board archive SMF conversion project
Post by: DJ Omnimaga on April 02, 2012, 12:06:49 am
Sorry to reply late, but yeah that was definitively a lot of work. I still wish other sites would do the same, though, such as MaxCoderz (assuming Joe still got the old db from 2003-04 or even the 2002-03 posts), and I wish Revsoft didn't lose all their work, since that stuff is part of the community history in my view (and there can be very useful stuff there as well).