Performance

ttiger · March 6th, 2009, 02:58 PM

I would really love to see some performance enhancements, caching, better indexes for the tables, etc.

Love vbgallery but I'm running a very large database of pics and vbgallery absolutely hammers my server. I'm running on a dual xeon 5410 with 16 gigs of ram and even with many features turned off the loads are still high. Usually between 10 - 50, avg around 20.

Luciano · March 7th, 2009, 02:44 AM

I remeber trying to optimize for a big board.. the biggest memory and performance hog being the filmstrip.. with it turned off.. the load went down significantly.. the other hog was the updating of information.. when users deleted or uploaded images.

But also optimizing mysql.ini and apache brought a lot..

Personally i'd be interested in: if your filmstrip is on.. if yes with how many thumbs..
plus.. what options did you turn off..
Do you have an idea what pages give you highest load?

Luc

Chuck S · March 7th, 2009, 06:44 AM

yes along with what Luciano states most things in the program are options. You can turn on or off any combination of options to acheive the performance you wish. To respond more we would definately need to know where your bottleneck is.

ttiger · March 7th, 2009, 01:51 PM

I have turned off a ton of things already, just about everything but basic functionality. I have set things to be listed in random order instead of alphabetically etc. It helps but the load is still way to high. About the only extra I have is some random images on the gallery page but that doesn't seem to make much of a difference so I left it on.

The film strip you are talking about I'm guessing you mean the option to add images to vbulletin forum, yes that I had to turn off. Apache is optimized and mysql.ini I have been through 1000s of configs and its about as good as I can get it.

I have also already tried APC, xcache, eaccelerator etc. None of those seem to do much though it is still better then normal.

Luciano · March 7th, 2009, 02:36 PM

Quote:

Originally Posted by ttiger

The film strip you are talking about I'm guessing you mean the option to add images to vbulletin forum, yes that I had to turn off. Apache is optimized and mysql.ini I have been through 1000s of configs and its about as good as I can get it.

No, the filmstrip is the navigation in showimage.php..
the 2,3,4 or 5 or more thumbnails under the image when you look at the image... if you click them you go to next.. or +2 or +3 images
(its about the same as previous/next image only with thumbnails)
-----------
Have you an idea which pages cause the load? index, browse images or showimage.php?
-----------

When you are in debug mode (vbulletin, you set it on in config.php with $config['Misc']['debug'] = true; ) you should see the mem usage and the queries..
be interesting what mem your pages are using..

(If its a busy live board, You can set debug mode on for your ip only.. by adding instead of :
$config['Misc']['debug'] = true;

$myips = array('127.0.0.1', 'xxx.xxx.xxx.xxx'); // change xxx.xxx.xxx.xxx to your ip
$config['Misc']['debug'] = in_array($_SERVER['REMOTE_ADDR'], $myips);

Luc
Be also interesting to know.. how many images you have per cat...(average)
try creating a new cat.. only 1 or 2 images.. see if the load is as high if you are in that cat..
=========================

ttiger · March 7th, 2009, 02:52 PM

Thanks I will try that. I don't know what pages are causing the load yet.

I checked and the filmstrip thing was already disabled.

Luciano · March 7th, 2009, 03:04 PM

On the other hand.. if you say its a big board.. the load may be normal..
If you have like 1000 simultanius visitors.. browsing through 200.000 images.. that can be too much for the server..

i read on vbulletin.com somewhere.. that a board (not talking about gallery) with 300 simultanious visitors and 20.000 posts can kill a xeon with 4 gigs of ram..

ttiger · March 7th, 2009, 03:52 PM

Quote:

Originally Posted by Luciano

On the other hand.. if you say its a big board.. the load may be normal..
If you have like 1000 simultanius visitors.. browsing through 200.000 images.. that can be too much for the server..

i read on vbulletin.com somewhere.. that a board (not talking about gallery) with 300 simultanious visitors and 20.000 posts can kill a xeon with 4 gigs of ram..

Dual Xeon 5410 w/8 gigs of ram can hand 1000+ users without breaking a sweat on vbulletin alone. I used to run a forum like that.

The vbulletin/gallery site I'm having problems with peaks at about 400 users and is usually around 200-300 online. If I turn off the gallery the load drops to less then .5

Luciano · March 7th, 2009, 04:14 PM

the problem is.. it is difficult to simulate what 300 simultanious users would do..
and if the load results from call of specific pages..

that would be the important to know.. what pages cause the hog..

Luc

Chuck S · March 7th, 2009, 06:12 PM

Correct if you have 400 user all viewing the gallery which has way more bandwidth that a forum I can easily see 400 users killing a server. You can set in vb admin the nix amount to say 5 if nix is working on the server and it will turn people away from your site telling them it is busy until the load goes down.

ttiger · March 7th, 2009, 06:39 PM

Quote:

Originally Posted by Chuck S

Correct if you have 400 user all viewing the gallery which has way more bandwidth that a forum I can easily see 400 users killing a server. You can set in vb admin the nix amount to say 5 if nix is working on the server and it will turn people away from your site telling them it is busy until the load goes down.

Bandwidth has nothing to do with this. I have 100mbit connection and could easily do 700 gigs a day if I needed to.
I'm only using 80 gigs or so of bandwidth so there is plenty of room left on the bandwidth side. I really don't want to set it to turn people away that is pretty counter productive.

I will try to see if I can figure out which pages are causing the most load that seems to be the best way to get to the bottom of this.

Chuck S · March 7th, 2009, 06:42 PM

Yes knowing where the bottleneck is will always help alot.

ttiger · March 24th, 2009, 04:16 AM

Ok most of the pages are about the same, only checked the main ones so far. Less then 10 queries on each page and 11 megs is the top memory usage. One thing I noticed was template usage on the main gallery page was (121) for adv_gallery_categorybit_subcat that was the only number that seemed abnormally high. Although I don't really understand what that means or the effect it would have.

Despite the load most pages seem to be generated in under 1 second.

Any further help?

Luciano · March 24th, 2009, 06:28 AM

121 means that the subcategory template is called 121 times...
This would mean you have x main categories and 121 subcategories displayed on the mainpage.. The template is cached.. so that does not add any extra work todo.. Do you really have over 100 cats displayed on mainpage?????

the only thing is the 11 megs.. (are those 11 megs from the vbulletin info or does this value come from the server side ?)
I myself have 2 servers setup for testing.. one on my laptop.. the other on my main pc...
strange is, that on my laptop exactly the same page with the same images... generates 2,4 Megs on laptop and 5.2 megs on main computer.. (one is wamp server and the other is manually installed apache with php.) they both use simple to over double memory for exactly the same page...

Now even with alle those subcats you are displaying, I think that over 10 megs is a lot (if displayed on the gallery page)
It would be interesting if displaying only half.. would reduce memory usage...
for testing, set the category depth to 1 point lower.. and check if it changes the the mem usage..

Luc