Can you see when the crawler visits your site ?
Can you see when the crawler visits your site ?
| Sponsored Links |
For WordPress you can use WP-UserOnline plugin
I use this and I can see the bots which visit my websites.
In your log files:
--
Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html)
--
Googlebot-Image/1.0
go to statcounter website >> register yourself >> create a script ( choose normal HTML script ) >> place the script just before the tag in your html. If you are using wordpress blog, then open the footer file, you will find tag there. Place the script before this tag.
Then login to stat counter and select "Recent visitor activity", you will see google bots entry there whenever bots arrive. The time there would be 0 seconds.
Hope this helps.
good idea
It's called user agent. Every webbrowser, crawler, etc. has it's own user agent.
Bookmarks