Ads By IM Forum
Results 1 to 8 of 8

Thread: What is Web Crawler?

  1. #1
    IM GreenHorn
    Join Date
    Jun 2016
    Location
    UK
    Posts
    21
    Points
    261.80
    Thanks
    0
    Thanked 0 Times in 0 Posts

    What is Web Crawler?

    Hello Friends,

    Please tell me what is web crawler.

  2. #2
    IM Apprentice
    Join Date
    Sep 2016
    Posts
    44
    Points
    442.99
    Thanks
    0
    Thanked 0 Times in 0 Posts
    i have no idea mate, sounds like creepy things, im gonna find out
    Agen Poker Online bergaransi, Teraman & Terpercaya

  3. #3
    IM Apprentice
    Join Date
    May 2016
    Posts
    46
    Points
    474.77
    Thanks
    0
    Thanked 0 Times in 0 Posts
    A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

  4. #4
    IM Junior Expert
    Join Date
    Mar 2016
    Posts
    119
    Points
    1,220.74
    Thanks
    0
    Thanked 0 Times in 0 Posts
    A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index.
    It is also known as "spider" or a "bot."

  5. #5
    IM Junior Expert
    Join Date
    May 2016
    Posts
    112
    Points
    1,143.43
    Thanks
    0
    Thanked 0 Times in 0 Posts
    A crawler is a program that visits Web sites and flows their pages and other information to make records for search engines index.

  6. #6
    IM Master RH-Calvin's Avatar
    Join Date
    Mar 2014
    Posts
    560
    Points
    6,466.77
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Web crawler is a search engine automated program that reads through webpage sources to provide information to search engines. They are known as bots, robots and spiders.

  7. #7
    IM GreenHorn
    Join Date
    Feb 2016
    Posts
    11
    Points
    122.53
    Thanks
    0
    Thanked 0 Times in 0 Posts
    A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide Web in a methodical, automated manner. This process is called Web crawling or spidering. Many legitimate sites, in particular search engines, use spidering as a means of providing up-to-date data.

  8. #8
    IM Noob
    Join Date
    Jan 2017
    Posts
    8
    Points
    80.97
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Web crawler is the program which is also known as spider or bots. The main purpose of web crawler is to find the webpage of the website and added it for indexing for search results.

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •