Google's crawling javascript links
After finding an unusual error message in the servers logs of our Intermedia Fotoficient demo server, I drilled deeper to find the reason behind that.
It seems, that Google is now following or probing links, it finds within javascript-parts of a webpage.
That's not unusual, especially in this case, the links concerned are found within the javascript block of a standard web page:
66.249.66.238 - - [16/Aug/2010:04:40:01 +0200] "GET /demo/img/ HTTP/1.1" 200 43 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.238 - - [16/Aug/2010:04:40:35 +0200] "GET /demo/download/ HTTP/1.1" 200 43 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.238 - - [16/Aug/2010:04:41:30 +0200] "GET /demo/fontlist/ HTTP/1.1" 200 350 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.66.238 - - [16/Aug/2010:04:42:26 +0200] "GET /demo/static/imgpro/ HTTP/1.1" 403 1384 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
These links are found (in reverse order) within our Imageprocessing application.:
window.imgprourl = 'http://intermedia.pixelboxx.com/demo/static/imgpro/';
window.imgproprefix = 'http://intermedia.pixelboxx.com/demo/img/';
window.imgproprefixdl = 'http://intermedia.pixelboxx.com/demo/download/';
window.imgproprefixfont = 'http://intermedia.pixelboxx.com/demo/fontlist/';
... read more stories on the topic Intermedia Fotofoficient
Seeing some of the new games out for the holidays this year has reminded me of what...
Attempts by T-Mobile to speed up mobile data connections are breaking websites. The...
HPCC Systems, the division of LexisNexis Risk Solutions dedicated to big data, has...
There are several standards connected with color management. Some technical standards...
Alice.js - (A Lightweight Independent CSS Engine) is a micro JavaScript library focused...
Jon Rohan: I've come across a few techniques and tips in my career, while working...
A survey of over 100 developers, previously posted here on Hacker News, aimed to...
Launch your personal, specially equipped WASP drone ? short for Wireless Aerial Surveillance...
Introducing OpenSocial 2.0 Now in 2011, OpenSocial has the largest revision coming...
This article will look into four ways to update game objects in the DOM to find which...
If you try to find place where you can get resume writing...
I would get more information about this good topic...
Consequently url submission directory service can got...
August 2010 |
||||||
Mon |
Tue |
Wed |
Thu |
Fri |
Sat |
Sun |
1 |
||||||
2 |
3 |
4 |
5 |
6 |
7 |
8 |
9 |
10 |
11 |
12 |
13 |
14 |
15 |
18 |
19 |
20 |
21 |
22 |
||
23 |
28 |
29 |
||||
30 |
||||||
