Initially, I’ve thought this is something that is done by bing.com haters, but it seems the HTTP referrer SPAM made for bing’s benefit is done from IPs belonging to the Microsoft corporation. The apache logs don’t lie:
65.55.104.61 – Referrer: http://www.bing.com/search?q=month (using IE 6)
65.55.104.64 – Referrer: http://www.bing.com/search?q=month (IE6)
… and so on, for 30 more times in a weekend
Now, try a whois for these IP addresses, like so.
I’ve noticed this two weeks after bing was launched and I’m not sure how legit this is from Microsoft’s side.
65.55.104.61, bing, bing.com, http referrer spam, microsoft, search engines, spam
Loopthing is now a big site, there are over 150.000 pages waiting to be indexed. In order to achieve this indexing as fast as possible, a sitemap of sitemaps has been placed inside the robots.txt file of the service.
I’m going to extract feedback on how Google and Yahoo! manages to process all these feeds and maybe compile a technical report early next year.
The whole process is also supervised thank to Google’s Webmaster Tools service, and Yahoo’s Site Explorer.
The process of indexing the whole site, jumping from link to link it’s very difficult, even for today’s performant spiders. The sitemaps.org website has been put together with help from major search engine market players (Google, Microsoft and Yahoo!) to address this issue.
The end result is enabling webmasters suggest search engines where their pages are located. End result is that indexing becomes a much faster process.
Some reading on sitemaps:
- sitemaps.org – the sitemaps standards home page (ironically, it doesn’t have a sitemap)
- sitemaps on wikipedia (syndicated information from everywhere, condensed in a single page)
bing, google, indexing, microsoft, search engines, SEO, sitemaps, yahoo
Today’s links are as random as the previous ones. Here’s a set of fresh ones:
This is it, keep an eye on my blog until next time. Also, for other news check out my twitter page or subscribe to this blog’s RSS feed.
Cheers!
australia, Building Scalable Web Sites, cal henderson, ecology, flickr, green, ISBN 0-596-10235-6, microsoft, pingoat, social entrepreneurs, tengrandisburiedthere.com
It’s time for a new set of half-geek links today, and I’ve got some special ones to share:
- radio54, kick ass radio from Netherlands
- Steve Balmer shares Microsoft’s plans in relation to developers (ask him not me)
- rock lives on, LOL
- how to block annoying ads servers using your hosts file (article applies to all windows versions). Article comes with a demo collection of such services
- it’s summer! planning a trip? not sure where to go? try placeblogger.com, a place where real people blog about your future destination.
Don’t forget: if you stumble upon any good link, pass it on.
half-geek link, hosts file, microsoft, placeblogger, radio54, rock, steve balmer
I’m starting a linking periodical which means I’m going to post tech/web related links now and I decided to call it “half-geek links”. This is a list of quick and important links I consider you should visit and you can post your comments or send your suggestions whenever you got something that may fit the list. (thank you).
bugmenot, Edward Deming, Half-geek Links, kumo, loopthing, microsoft, myspace, pr, twitter
