I'm stumped. I'm not so sure what is the answer. I'll do some poking around and get back to you if I find an anything. You should email the people at iPage as they probably could answer your iPage question..
Yes, that was one of the threads I referred to in my initial post, although not with a specific link. But I gather that this was for MS1, as MS2 has the spider killer built in..
So my question is this:.
MS2 has an option to prevent spider sessions, which I've enabled. Nonetheless, inktomisearch is given a session id, gets stuck for hours and hours on my site, and adds thousands of dollars worth of merchandise to it's shopping cart..
Does anyone know how to add inktomisearch to the list of "known spiders" that MS2 uses with it's built-in "Prevent Spider Sessions" option?.
Find the correct UserAgent for the troublesome spider and manually add it to the text file called spiders.txt.
Should work fine...
Whats settings are recommended for sessions in OS MS2 admin for a iPage site that doesn't have an ssl server (https) I don't fully understand the processes but I guess I don't want to set all options to true ? .
I encountered the exact same problem starting a few days ago. Inktomi has been visiting me for several months without any problem and no session id. Then, all of a sudden, it is getting a session id, when I look at it's visits through the user tracking contribution. I am also tracking spider visits through an app called robotstats, and it tells me that the session id is not always passed as an explicit parameter. In this latter case, are the pages indexed correctly?.
I searched the web for an update of the UserAgent name for Inktomi and did not find anything. Is there an easy way to find out the UserAgent, like reverse IP lookup or so?.
Thanks for any help..
I have the same problem and went in search for an answer. At.
I found this.
The page goes on a bit, but I figured this was the explanation for the sudden change..
On some other page I found.
Now I know I can't put in "compatible" as the user agent. Can I put in "Yahoo! Slurp" in the spiders.txt?.
This post has been edited by.
: 02 March 2004, 15:34..
Ok, I kinda feel like an idiot. But not really..
So I'm just going to enter "Slurp" in addition to the other slurps I already have on my list...
I am having a problem with inktomisearch it says user agent is yahooseeker/1.1 I have this in my spider txt still getting oscid.
I need help also..
As suggested by MickiCheers, I tried to add "Slurp" to my spider.txt, but the robot is still getting a session Id....
Any other hint?..
Just so you know, I haven't found anything that works either. and inktomi is driving me stone crazy! inktomi is wearing me out. most of the sessions on my user_tracking are all inktomi. makes it so hard to find the real visits. if anyone has any idea what to do, please share...
If you've fixed it so that Intomi is not begin assigned any NEW sids, then you'll just have to wait it out. It can take several months for intomi to stop trying to parse old URLs with sids that it collected previously..
You can, however, filter your user tacking and whos online scripts so that it doesn't show Intomi anymore...
My logs show that Inktomi is using a user-agent of "YahooSeeker/1.1".
Ok, I feel dumb. I see that someone already posted the user-agent..
Can anyone confirm that this indeed stops the SIDs for that agent?.
From other threads, it seems that the SIDs may still continue for weeks, gradually dying down. Is this understanding correct ? .
I have the same problem I temporaraly blocked yahoo from my iPage site be cause of this..
I did indeed use yahooseeke/1.1 and it stoped producing new oscids but they cept poping up I put yahooseeker/1.1 in by browser as the user agent and did not get any sids..
When I get back from my vacation I will allow yahoo to come back and see if it produces sids again..
I balieve this quote to be true...
I don't know what Yahoo recently changed in it's spider behavior, but WITHOUT trying the new user agent that was recently suggested in the thread (Yahooseeker), the Inktomi spider no longer gets a sid... Back to normal..
Of course, I still have the spider checking urls containing sids that it received earlier in February, but even in this case, it appears in the user tracking contrib without a sid (as expected)..
I hope this is the same for you...
Hello I just started looking at my log files and I noticed yahooseeker is still going to those old oscsids it got before I stoped found the user agent. So I was looking in my logs and it is still able to go to those pages with the oscsid? I get a code 200 for those pages with the oscsid I thought it would not be able to access them at this point ?
I am continually getting problems with the Inktomi spider/s...
It can still 'attempt' to get there several months afterwards. Just make sure it doesn't collect any new URLs with SIDs and you should be fine...
I've seen the other threads about html_output.php, Inktomi, session ID's, etc., but I'm still stumpted. I have "Prevent Spider Sessions" turned on in the admin, but inktomisearch is still getting SID's. It comes to my site, adds thousands of products to it's shopping cart, and stays for hours and hours..
Can someone provide me with some advice on ridding myself of this nuisance?.
Thanks in advance,.
Dunno if you saw this....
This post has been edited by.
: 20 February 2004, 21:02..