The Guitar Gallery Forums - The Guitar Legacy of Matsumoku

Got a "resource limit is reached" error trying to open the forums. Anyone else getting this?

I've seen it a few times recently.

_________________
Quality service since 3:00 last Tuesday

Yes, I think it started for me on Tuesday

_________________
My wife yes
My dog maybe
My Vantages never

I checked our disk and bandwidth usage and we are within limits. If it happens again to you before it does me try to get a screenshot or copy the text. Post the text and if screenshot I can give you an email address to send the screenshot to.

Yup!
Been getting it regularly for a few days, including just before I managed to login now.

Text message only, no server error number, just try again later.

_________________
"A little song, a little dance. A little seltzer down your pants." -Chuckles the Clown
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com

Well, I tracked down the issue and of course Webline was zero help. They SHOULD have seen the problem long before I found it.

RAM and CPU were maxed out so I couldn't get in to take the models section offline to troubleshoot. I grabbed the raw server logs and wham, it was staring me in the face. YandexBot (Russian) was literally hammering the site! They were grabbing EVERYTHING and not being nice about it. Multiple requests from numerous IPs per second. The SQL server just couldn't keep up. Fortunately they do obey the robots.txt file and once I disallowed them the issue went away in seconds. I tried to tell Webline there is no way in h-e-double toothpics we could eat up that much resources. Instead they suggested I contact a web developer to look into the problem. What am I, chopped liver?

Moral of the story: Don't bother asking the experts, you probably know more than they do anyway.

Great customer service eh?

Bloody robots.
Glad that you were able to solve the problem, and lucky that the robot was obedient, or then what?!

_________________
"A little song, a little dance. A little seltzer down your pants." -Chuckles the Clown
Guitars: https://legend.barryeames.com
Music/Pix/Videos: https://getback.barryeames.com

He was probably smoking a Beedi at the time. Broken English.

Most major crawlers are fairly courteous. Google will grab a page or two then wait a while then another. Sometimes several days in between. Other literally scrape the site in a single go. Can you imagine how many pages they were grabbing per second to peg the CPU and RAM like that? Rapid fire.

Since the CPU and RAM were pegged I couldn't get into the stats to see who was hitting the site but the raw logs were accessible and that's how I figured it out. Pages of them sending request after request. Log downloads wasn't hindered. But, that's about all I could do. I had them kill all the PIDS connected to the site but that only stopped it for a little while.