I modified my website's search engine to log queries--including the search string, timestamp, referer, and visitor IP--in order to discover what visitors are searching for from which pages. Several of the queries have a blank referer and come from the IP 18.104.22.168. Those query strings are not spam-like. Typically they have some relation to my site's topic.
The IP appears to belong to the Googlebot, buy why would it behave that way? The queries seem like things a human would enter. Is there some method of accessing a site's search engine that strips the referer header and leaves a bogus IP? As I said, nothing about this appears malicious. I am just wondering what is happening.
posted by Fred Mars
on Apr 11, 2008 -
I have a private wiki, & I'd like to keep it from showing up in server logs. Specifically, I'd like to strip out the referrer information by having external links go through a redirect. How do I have Mediawiki munge external links to include the redirector? Also, would using a redirect really do what I want, or does this really vary by browser?
posted by Pronoiac
on Mar 18, 2008 -
I'm getting a lot of weird URLs in my site's referrer logs that look like this: wysiwyg://5/http://www.mydomain.com/somepage.php. Anybody know what the heck's going on? [more inside] [more inside]
posted by web-goddess
on Feb 4, 2004 -