Pre-Parse Post/Signatures & Sphinx Search plugins
#1
Hi Guys,

I am releasing a few of my plugins that I use on ncaabbs.com and other high profile forums. These plugins allow functionality for better performance on identified weak-areas of MyBB on high profile forums. I am not releasing these plugins in my official plugin release thread for several reasons:
  • These plugins require advanced knowledge of website administration
  • They are only needed for high profile forums with a need to push the most out of MyBB for stability and performance reasons
  • I don't have enough time to upkeep these to the amount that would be required for the average-joe and it's unlikely that someone will be running a forum that requires these without having advanced knowledge of website administration

These plugins have been under intense testing (stress testing, usability testing, et cetera) for the past 2 years and I believe they have reached a point to which they can be safely released and therefore operated by those who have enough knowledge to. These plugins are only being released for knowledge to developers and for other high profile forums wishing or requiring the most performance they can pack out of MyBB for stability reasons.

A readme.txt has been included in each zip. Please read it carefully.

1. Pre-Parse Post Plugin
Description: This plugin pre-parses high profile threads (a thread or post created within the last 30 days or a thread which contains 100 or more posts) and puts them into a separate database table. This is used to bypass the normal MyBB procedure to parse "on-the-go" and instead "pre"-parses when the thread or post is created or updated.
Technical Details: A weak-area in MyBB was identified in multiple tests which consistently showed the MyBB post parser was contributing a large portion to the "Server Load" of a high profile MyBB forum. A work-around was created and tested. The results consistently shows this flow-of-procedure versus MyBB's standard flow-of-procedure takes up less processing power in exchange for a relatively low amount of disk space.

Download: preparsepost.zip

2. Pre-Parse Signature Plugin
Description: This plugin pre-parses all users signatures and puts them into a separate database column. This is used to bypass the normal MyBB procedure to parse "on-the-go" and instead "pre"-parses when the signature is created or updated.
Technical Details: A weak-area in MyBB was identified in multiple tests which consistently showed the MyBB signature parser was contributing a large portion to the "Server Load" of a high profile MyBB forum. A work-around was created and tested. The results consistently shows this flow-of-procedure versus MyBB's standard flow-of-procedure takes up less processing power in exchange for a relatively low amount of disk space.

Download: preparsesig.zip

3. Sphinx Plugin
Description: This plugin uses a specialized searching engine to perform extremely fast searches among tables with millions or even billions of rows. This plugin takes advantage of the "Sphinx Search" engine to search the MyBB posts table on high profile forums with a large number of posts.
Technical Details: A weak-area in MyBB was identified in multiple tests which consistently showed the MyBB/MySQL search engines are slow on large forums and therefore "lockup" the MyBB posts table during the search. This in turn could lead to, essentially, a Denial of Service attack. A work-around was created and tested. The results consistently shows this flow-of-procedure versus MyBB's standard flow-of-procedure takes up less processing power in exchange for a relatively low amount of disk space.

Dependencies: Sphinx Search Engine (NOT SphinxSE); A dedicated server & IT skills to install Sphinx Search Engine.
Download: sphinx.zip

Hope you enjoy these.

Ryan


Attached Files
.zip   preparsepost.zip (Size: 4.46 KB / Downloads: 1,147)
.zip   preparsersig.zip (Size: 2.58 KB / Downloads: 982)
.zip   sphinx.zip (Size: 13.35 KB / Downloads: 926)
Reply


Messages In This Thread
Pre-Parse Post/Signatures & Sphinx Search plugins - by Ryan Gordon - 01-08-2009, 05:51 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)