Welcome our webmaster and SEO forum
Please enjoy the forum, contribute what you can, and wind up the Moderators!
Results 1 to 5 of 5

Thread: Site Crawlers

  1. #1
    Pentarix Guest

    Default Site Crawlers

    How do I know if my sites been crawled? I've heard Duke mention seeing that he was crawled or being crawled, now that I have one of my sites up and the other going up this week, I'd like to start keeping track of this.

  2. #2
    temi's Avatar
    temi is offline Facilitator
    Join Date
    Jun 2003
    Location
    London, England.
    Posts
    10,303

    Default

    There are lots of ways to find out if your has been crawled but the two I favour are:
    1. Look in the raw logs. Raw log look something like this,



    it shows the search engines that has been "crawling" your site. But because you have just put your site online you may not see your first visit for a day or so unless you have links from very strong sites.

    2. If your hosting package come with Webalize or other graphical stats package you can also see visits from crawlers, see attached image for example


    Thanks

    * Comprehensive UK Web Directory List . eCommerce software UK
    * BossCart.com can build you a.
    Register your domain names at Velnet
    ::
    Add Eco sites to The Green Directory free of charge.
    Use LBS Free PHP Directory Script . Web Hosting Blog

  3. #3
    Duke Guest

    Default

    I do that but I also go into the site admin panel, click on forums and it shows me the IP of everyone who's online. Click on the IP and it will take you to Network Tools.com and already have that IP entered. Click submit and it tells you who's at the other end.

  4. #4
    temi's Avatar
    temi is offline Facilitator
    Join Date
    Jun 2003
    Location
    London, England.
    Posts
    10,303

    Default

    Are you talking about phpnuke Ken?

    * Comprehensive UK Web Directory List . eCommerce software UK
    * BossCart.com can build you a.
    Register your domain names at Velnet
    ::
    Add Eco sites to The Green Directory free of charge.
    Use LBS Free PHP Directory Script . Web Hosting Blog

  5. #5
    Duke Guest

    Default

    Ya it's the admin panel in all phpnuke websites.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Link from SEO Site promotion site
    By temi in forum Links Market
    Replies: 3
    Last Post: 01-04-2008, 11:56 PM
  2. Replies: 4
    Last Post: 10-28-2007, 06:00 PM
  3. My LBS powered site is #1 for Decent Site in Google
    By stock_post in forum Directories
    Replies: 2
    Last Post: 10-09-2007, 01:40 AM
  4. Site submission to thousands of site
    By temi in forum General Webmaster Talk
    Replies: 7
    Last Post: 04-17-2007, 12:33 PM

Bookmarks

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124