Well I was pleasantly surprised to see a huge jump in traffic one day shortly after I'd written/announced one of my latest code generator modules. I was so pysched that I didn't even bother to check my stats on the jump in traffic, assuming that the traffic was due to the new content. I really thought I had a great feature on my hands! Ok, I still think that ;) ...but boy, was I in for a surprise!
Syncronicity can be defined as: "Coincidence of events that seem to be meaningfully related." (though they may in fact, not be.)
...and that's exactly what it was. In previous days, I was averaging 300-600 uniques a day...but then all of a sudden, 2500, 3000, 3500...and I mean everyday for a month! I was psyched to see "30+ visitors are now online" at any given time...
So I finally had time to check into it and what do I discover? I discover the JetBot has been spidering my site. Good news, right? Um.... Well, for starters, I can't see any reason why they'd need to spider my site all day long everyday from 12 different subdomains of jeteye.com simultaneously, can you? So I head over to the JetEye.com site and WTF to my wondering eyes do appear: you need to login to access the damn thing!?! And I sent them an email about it...which went unanswered.
Nonetheless, the JetBot does seem to obey the robots.txt file and I've noticed my traffic go back to normal in a matter of days...as well as my bandwidth usage back down to a "real" level.
Has anyone else noticed this over-bearing spider wreaking havoc on their stats or bandwidth? And what are your thoughts on it?
John
Watch
GitHub Core
Show your support for Zikula! Sign up at Github account and watch the Core project!
GitHub Modules
Forum Activity
- mesteele101 responded to »ERR (3): E_USER_ERROR: Smarty error: [in pagesvar:pagesitem2en line XXX]…« 07:01 AM
- mazdev responded to »Pages 2.5.0 and updating - Page not found« 06:41 AM
- ehdwma created topic »Hide "Register new account" and change template to 3 col« 06:27 AM
- mesteele101 responded to »Zikula 1.3.3 - Selecting a category in Pages not working« 01:29 AM
- mdee created topic »How to implement returnpage ?« 01:00 AM
- nestormateo responded to »Fillters in Clip« 24. May
- damon responded to »Can the Updated Version Check be Turned Off (Z 1.3)« 24. May
Zikula Blog
- Anatomy of Open Source Projects on Mar 07
- Continuous Review on Mar 01
- Not Invented Here on Feb 24
- How to Contribute Your Code at Github on Jan 13
- 10 Steps to Coding-Nirvana: Tips for Successful Module Writing on Nov 12
- Submitting Bug Report Tickets That Get Results on Aug 17
- Cozi Tricks #1: Syntax Highlighting on Aug 07
Login
JetEye & JetBot: Spent my bandwidth ... what's a boy to
-
**unknown user**
- Rank: Senior
- Registered: Mar 16, 2002
- Last visit: Oct 21, 2009
- Posts: 2330
Posted: Nov 16, 2004 - 08:32 AM
-
**unknown user**
- Rank: Helper
- Registered: Mar 16, 2002
- Last visit: Oct 21, 2009
- Posts: 877
Posted: Nov 18, 2004 - 10:01 AM
Seem weird to me dude. I have 200 spiders on my site at certain times of the day, but it never seems to use much bandwidth.
- Moderated by:
- Support
Users on-line
- 0 users
This list is based on users active over the last 60 minutes.
