Performance Problems

[rage2]

Just an update, our servers are getting slammed from that RSX thread... a good thing I guess ;).

I've deployed 2 more web servers this morning to handle the workload, so once DNS gets around, you should notice it get faster.

I'll probably build 2 more web servers later this morning to distribute the load more evenly. Please be patient, it'll get better!

[Pee_Sack]

You know, I noticed it getting a bit slower today, then when I clicked on this thread I was like "Wow this is taking along time to load"

[rage2]

ya, the speed won't be blazing today, or until the traffic dies down anyways. we're hitting capacity on bandwidth limits, as well as CPU limits on several quad core servers.

there's also some DB errors randomly, still trying to fix that right now. Usually, a refresh will fix it, comes right back up.

edit - lemme know if you see any DB errors... and what time you got it.

[schocker]

I went to bed hoping that the RSX thread would get huge, wake up and bam, it is. Good job keeping up with the traffic rage2:thumbsup:

[l8braker]

Total guests on right now: 3076

Most ever users viewing the board was this morning @ 8:55am. Definitely cool to see beyond.ca around the 'net.

[abyss]

DB error. Time of occurance....11:05

edit : and when I was trying to post this haha, I can see this being a neverending cycle......:rofl:

[acura_el]

DB error 1:31 pm EST

[TeamBestBud]

2 DB errors at 11:41 am...

[schocker]

DB error at 12:23,12:25,12:28,1:24,1:25 x3,1:33,1:35

bah too many to name but it was worth it:rofl:

[ercchry]

db error 12:24

[hjr]

ya, maaaaad errors today: oh well

There seems to have been a slight problem with the database.
Please try again by pressing the refresh button in your browser.
An E-Mail has been dispatched to our Technical Staff, who you can also contact if the problem persists.

We apologise for any inconvenience.

[benyl]

15:17...

DB error #20 for the day... Damn RSX thread... haha

edit: make that 14:17 as the Servers haven't been patched for DST.

[BigBearWest]

3:33PM

[BerserkerCatSplat]

Oh man, it's been DB errors left right an center today. The RSX thread is great, but it's killing the servers! :rofl:

[BigBearWest]

3:47PM

[GTS Jeff]

haha what I find funny is that the pages are still loading pretty damn fast other than the DB errors.

[rage2]

Well now that the dust has settled, we're back to our original server cluster configuration. We survived it pretty good I guess.

I dunno if the addition revenue will overcome the cost of bandwidth just yet, we moved about 1.7TB of traffic (1748GB to be exact) in the 2 days. In anycase, it was a good test for us, so even if we don't break even on it, it was worth it.

For the techies that wanna know how we managed it, I wrote about it here:

http://www.hatethegrind.com/2007/03/14/how-to-survive-the-digg-effect

[Toms-SC]

Nice job Rage :thumbsup: