MyBB Community Forums

Full Version: Urgent: Cannot Locate Reason for Excessive Server Load
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2 3
(2011-05-30, 08:56 PM)labrocca Wrote: [ -> ]Fit on Page
While you were typing

Both are going to cause higher load.

Fit on Page runs most of his code client side and it doesn't do any xmlhttp request to the server. It only adds an extra Javascript file into the templates together with a few variables. It may appear that the page is loading slower because the browser needs to calculate the dimensions of the large image to fit on the page but this depends on how fast your computer is. This can't cause a higher server load.
"While you were typing" can with "realtime notifications" enabled, but it's highly unlikely with only 200 members per day. If you would say 200 members/second, it's plausible. If they aren't visiting all at the exact same time, all reading a thread, it's almost impossible that this plugin causes this much server load.
The site loads very, very slowly for me. Like nearly 20 seconds. Ping times ae relatively quick, so I'd say its definitely something in the theme or fileset.

Here's a link to a page load time analyzer that you can use, which may help determine the issue: http://www.websiteoptimization.com/services/analyze/

You might also try opening your forum in the default theme and see if there's any difference. That could help to determine if it's in the theme, a plugin, or javascript.
Currently I have not re-enabled Fit on Page or While You Were Typing, if these plugins are disabled but not uninstalled, they should not be affecting anything?

I did the analysis you linked mark-in-dallas, and the result was as follows:

Analysis and Recommendations

QTY	SIZE#	TYPE	URL	COMMENTS
1	169393	SCRIPT	www.vampirecounts.net ... jscripts/prototype.js?...	 Header size = 312 bytes 
Up to 132059 bytes could have been saved through compression. 
1	67110	IMG	www.vampirecounts.net ... ges/carpe-noctem/logo.php	 Header size = 590 bytes 
Missing width attribute. 
Missing height attribute.  
1	52305	CSS IMG	www.vampirecounts.net ... /carpe-noctem/head-bg.jpg	 Header size = 298 bytes  
2	50549	CSS IMG	www.vampirecounts.net ... rpe-noctem/footer_bg2.gif	 Header size = 297 bytes  
1	49898	CSS IMG	www.vampirecounts.net ... bfont.svg#webfontQvyKutP1	 Header size = 301 bytes  
1	30043	SCRIPT	ajax.googleapis.com ... /jquery/1.5/jquery.min.js	 Header size = 373 bytes 
Congratulations! This file was compressed. 
1	27552	CSS IMG	www.vampirecounts.net ... onts/cw_bandy-webfont.ttf	 Header size = 310 bytes  
1	18678	SCRIPT	www.vampirecounts.net ... t/jscripts/general.js?...	 Header size = 310 bytes 
Up to 13760 bytes could have been saved through compression. 
1	17464	CSS IMG	www.vampirecounts.net ... nts/cw_bandy-webfont.woff	 Header size = 298 bytes  
1	15209	CSS IMG	www.vampirecounts.net ... /cw_bandy-webfont.eot?...	 Header size = 317 bytes  
1	14644	HTML	http://www.vampirecounts.net	 Header size = 743 bytes 
Congratulations! This file was compressed. 
View a formatted version of this HTML file  
1	Not found	CSS IMG	www.vampirecounts.net ... ctem/english/rateuser.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... m/english/postbit_www.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... /english/postbit_warn.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... sh/postbit_reputation.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... nglish/postbit_report.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... lish/postbit_replyall.png	 Header size = 633 bytes  
2	Not found	CSS IMG	www.vampirecounts.net ... english/postbit_quote.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... em/english/postbit_pm.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... sh/postbit_multiquote.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... /english/postbit_find.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... english/postbit_email.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... /english/postbit_edit.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... nglish/postbit_delete.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... em/english/pm_forward.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... tem/english/pm_delete.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... tem/english/newthread.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... ctem/english/newreply.png	 Header size = 633 bytes  
1	Not found	CSS IMG	www.vampirecounts.net ... noctem/english/closed.png	 Header size = 633 bytes  
2	20052	CSS IMG	www.vampirecounts.net ... e-noctem/button-hover.jpg	 Header size = 298 bytes  
2	17699	CSS IMG	www.vampirecounts.net ... s/carpe-noctem/button.jpg	 Header size = 298 bytes  
1	6016	IMG	http://www.warvault.net/webring/button.php?...	 Header size = 443 bytes 
Missing width attribute. 
Missing height attribute.  
1	4617	CSS	www.vampirecounts.net ... themes/theme10/global.css	 Header size = 340 bytes 
Congratulations! This file was compressed. 
View a formatted version of this CSS file  
2	3952	CSS IMG	www.vampirecounts.net ... /carpe-noctem/li-desc.png	 Header size = 295 bytes  
1	3847	CSS IMG	www.vampirecounts.net ... s/carpe-noctem/search.png	 Header size = 295 bytes  
1	3286	CSS IMG	www.vampirecounts.net ... ctem/border-top-right.gif	 Header size = 295 bytes  
1	3271	CSS IMG	www.vampirecounts.net ... m/border-bottom-right.gif	 Header size = 295 bytes  
1	3250	CSS IMG	www.vampirecounts.net ... octem/border-top-left.gif	 Header size = 295 bytes  
1	3247	CSS IMG	www.vampirecounts.net ... em/border-bottom-left.gif	 Header size = 295 bytes  
1	3047	CSS IMG	www.vampirecounts.net ... /border-bottom-middle.gif	 Header size = 295 bytes  
1	3015	CSS IMG	www.vampirecounts.net ... es/carpe-noctem/arrow.png	 Header size = 295 bytes  
1	2978	CSS IMG	www.vampirecounts.net ... tem/border-top-middle.gif	 Header size = 295 bytes  
1	2799	SCRIPT	www.vampirecounts.net ... ctem/jscripts/theme-js.js	 Header size = 308 bytes 
Up to 1938 bytes could have been saved through compression. 
1	2755	SCRIPT	www.vampirecounts.net ... scripts/popup_menu.js?...	 Header size = 308 bytes 
Up to 1841 bytes could have been saved through compression. 
1	1542	CSS IMG	http://www.vampirecounts.net/images/spinner.gif	 Header size = 295 bytes  
1	1506	CSS IMG	www.vampirecounts.net ... carpe-noctem/left-bar.gif	 Header size = 295 bytes  
1	1503	CSS IMG	www.vampirecounts.net ... arpe-noctem/right-bar.gif	 Header size = 295 bytes  
39	1101	IMG	www.vampirecounts.net ... mages/carpe-noctem/on.gif	 Header size = 295 bytes 
Missing width attribute. 
Missing height attribute.  
1	1013	CSS IMG	http://www.vampirecounts.net/images/error.gif	 Header size = 295 bytes  
2	876	IMG	www.vampirecounts.net ... arpe-noctem/no-avatar.gif	 Header size = 294 bytes 
Missing width attribute. 
Missing height attribute.  
3	748	CSS IMG	www.vampirecounts.net ... carpe-noctem/thead_bg.gif	 Header size = 294 bytes  
1	746	CSS IMG	www.vampirecounts.net ... arpe-noctem/footer_bg.gif	 Header size = 294 bytes  
2	698	IMG	www.vampirecounts.net ... /carpe-noctem/offlock.gif	 Header size = 294 bytes 
Missing width attribute. 
Missing height attribute.  
4	698	IMG	www.vampirecounts.net ... ages/carpe-noctem/off.gif	 Header size = 294 bytes 
Missing width attribute. 
Missing height attribute.  
1	632	CSS IMG	www.vampirecounts.net ... carpe-noctem/inbox_bg.gif	 Header size = 294 bytes  
1	594	CSS IMG	http://www.vampirecounts.net/images/invalid.gif	 Header size = 294 bytes  
1	541	CSS IMG	http://www.vampirecounts.net/images/valid.gif	 Header size = 294 bytes  
10	525	IMG	www.vampirecounts.net ... carpe-noctem/collapse.gif	 Header size = 294 bytes 
Missing width attribute. 
Missing height attribute.  
1	370	CSS IMG	www.vampirecounts.net ... /carpe-noctem/menu_bg.gif	 Header size = 294 bytes  
1	318	CSS IMG	www.vampirecounts.net ... e-noctem/searchbox_bg.gif	 Header size = 294 bytes  
1	289	CSS IMG	http://www.vampirecounts.net/images/jump.gif	 Header size = 294 bytes  
1	242	CSS	www.vampirecounts.net ... arpe-noctem/font-face.css	 Header size = 338 bytes 
Congratulations! This file was compressed. 
View a formatted version of this CSS file  
1	190	CSS IMG	www.vampirecounts.net ... e-noctem/border-right.gif	 Header size = 293 bytes  
1	188	CSS IMG	www.vampirecounts.net ... pe-noctem/border-left.gif	 Header size = 293 bytes  
1	176	CSS IMG	www.vampirecounts.net ... -noctem/bottommenu_bg.gif	 Header size = 293 bytes  
1	157	CSS IMG	www.vampirecounts.net ... carpe-noctem/tfoot_bg.gif	 Header size = 293 bytes  
2	144	CSS IMG	www.vampirecounts.net ... s/carpe-noctem/nav_bg.gif	 Header size = 293 bytes  
1	126	CSS IMG	www.vampirecounts.net ... e-noctem/theadname_bg.gif	 Header size = 293 bytes  
1	89	CSS IMG	www.vampirecounts.net ... rpe-noctem/border-top.gif	 Header size = 292 bytes  
1	89	CSS IMG	www.vampirecounts.net ... -noctem/border-bottom.gif	 Header size = 292 bytes  

TOTAL_HTML - Congratulations, the total number of HTML files on this page (including the main HTML file) is 1 which most browsers can multithread. Minimizing HTTP requests is key for web site optimization. Y
TOTAL_OBJECTS - Warning! The total number of objects on this page is 70 which by their number will dominate web page delay. Consider reducing this to a more reasonable number. Above 20 objects per page the overhead from dealing with the actual objects (description time and wait time) accounts for more than 80% of whole page latency. See Figure II-3: Relative distribution of latency components showing that object overhead dominates web page latency in Website Optimization Secrets for more details on how object overhead dominates web page latency. Combine, refine, and optimize your external objects. Replace graphic rollovers with CSS rollovers to speed display and minimize HTTP requests. Consider using CSS sprites to help consolidate decorative images. Using CSS techniques such as colored backgrounds, borders, or spacing instead of graphic techniques can reduce HTTP requests. Replace graphic text headers with CSS text headers to further reduce HTTP requests. Finally, consider optimizing parallel downloads by using different hostnames or a CDN to reduce object overhead.
TOTAL_IMAGES - Warning! The total number of images on this page is 62 , consider reducing this to a more reasonable number. Recommend combining, replacing, and optimizing your graphics. Replace graphic rollover menus with CSS rollover menus to speed display and minimize HTTP requests. Consider using CSS sprites to help consolidate decorative images. Use CSS techniques such as colored backgrounds, borders, or spacing instead of graphic techniques to reduce HTTP requests. Replace graphic text headers with CSS text headers to further reduce HTTP requests. Finally, consider optimizing parallel downloads by using different hostnames to reduce object overhead.
TOTAL_CSS - Congratulations, the total number of external CSS files on this page is 2 . Because external CSS files must be in the HEAD of your HTML document, they must load first before any BODY content displays. Although they are cached, CSS files slow down the initial display of your page. Remember to place CSS files in the HEAD and JavaScript files at the end of the BODY to enable progressive display.
TOTAL_SIZE - Warning! The total size of this page is 611777 bytes, which will load in 135.93 seconds on a 56Kbps modem. Consider reducing total page size to less than 100K to achieve sub 20 second response times on 56K connections. Pages over 100K exceed most attention thresholds at 56Kbps, even with feedback. Consider optimizing your site with Website Optimization Secrets, Speed Up Your Site or contacting us about our optimization services.
TOTAL_SCRIPT - Caution. The total number of external script files on this page is 5 , consider reducing this to one or two. Combine, refactor, and minify to optimize your JavaScript files. Ideally you should have one (or even embed scripts for high-traffic pages) on your pages. Consider suturing JavaScript files together at the server to minimize HTTP requests. Placing external JavaScript files at the bottom of your BODY, and CSS files in the HEAD enables progressive display in XHTML web pages.
HTML_SIZE - Congratulations, the total size of this HTML file is 14644 bytes, which less than 50K. Assuming that you specify the HEIGHT and WIDTH of your images, this size allows your HTML to display content in under 10 seconds, the average time users are willing to wait for a page to display without feedback.
IMAGES_SIZE - Warning! The total size of your images is 368606 bytes, which is over 100K. Consider switch graphic formats to achive smaller file sizes (from JPEG to PNG for example). Finally, substitute CSS techniques for graphics techniques to create colored borders, backgrounds, and spacing.
SCRIPT_SIZE - Warning! The total size of external your scripts is 223668 bytes, which is over 20K. Consider optimizing your JavaScript for size, combining them, and using HTTP compression where appropriate for any scripts placed in the HEAD of your documents. You can substitute CSS menus for JavaScript-based menus to minimize or even eliminate the use of JavaScript.
CSS_SIZE - Congratulations, the total size of your external CSS is 4859 bytes, which is less than 8K.
MULTIM_SIZE - Congratulations, the total size of all your external multimedia files is 0 bytes, which is less than 10K.

So it does suggest the theme I suppose. I will have to go back to the designers about it.
That is pretty interesting. This weekend I am also having a very high server load and I'm hosted with the same company as you (even though on different VPS of course). I cannot find the solution for my problem either, I shutdown sites, I disabled plenty of scripts and stopped my main high traffic website and debugged the running processes and cannot find the cause for my problem.

I doubt it is related to the theme itself since you said you have reverted back to the old one and the problem remained (or did I misunderstand?). If you find a solution for your problem, please let me know, I can't seem to find mine either.
Hmm, did you report this Pirata? I did to them, but they just said it was my site. I'll keep in investigating as currently my site is so slow. Likewise, if you find a solution let me know, and also I may be in contact soon for some more modifications Smile

Labrocca: How do you join big boards, and what are the requirements?
Yes they said the same to me. I've also thought about re-installing CentOS 5 and installing webmin + virtualmin so I start everything from fresh but I doubt that will fix anything.

I'm removing piece by piece things I do not need until I've got only the basic things so it's easier to debug, but still...this is going to take forever. Right now my server load is at 1.15 but it can suddenly jump to 4.0 which is ridiculous, why the hell would so many processes be created in such a short period of time?

I'll let you know if I find a cause as well but it is so slow when I start SSH that I can barely do anything right now.
(2011-05-30, 10:30 PM)Disciple of Nagash Wrote: [ -> ]Currently I have not re-enabled Fit on Page or While You Were Typing, if these plugins are disabled but not uninstalled, they should not be affecting anything?

If the plugins are disabled they shouldn't affect anything indeed.

Quote:So it does suggest the theme I suppose. I will have to go back to the designers about it.
Or your server. The main html page takes quite a long time to load. Have you been in contact with your webhost already? It could be that there is a problem on their side or in the datacenter.

A last thing you can try is disabling all plugins. Open /inc/init.php and add the following on a new line below the line that says "<?php":
define('NO_PLUGINS', true);
Save the file and see if your website loads faster now.

If so, it's a plugin that is causing this.
If not, switch to the default MyBB theme and see if the site still loads slow.

If so, it's the theme
If not, it's most likely a problem with your host. They might have changed something to the server that is affecting your website.
My 15 minute average is still 8.28, still too high. I have just posted in the ticket I have with them, asking them to check. It can't be a coincidence it has happened to both of us, especially when we have both done the same things such as basically disabling everything which could affect the servers in this way.
Cheers for the suggestion Aries, I will give that a try, but I am doubtful it will work. The few remaining plugins I have active, were all active before this for about the last 6 months. No problems with them during that time either.
I agree the site is VERY VERY slow.
Just thought you all might like to know that the problem was found to be with the hosts hardware.

Thanks for all your help.....and if anyone can tell me how to join the Big Board Owners as Labrocca suggested it would be much appreciated.
Pages: 1 2 3