Spiders and Bots
Hi! Welcome to the Feedback forum.
Before reading anything or asking anything; please check out the FAQs. Your question might be in there. However if you want a better understanding after reading the FAQs, like if it didn't explain it good enough, then by all means ask your question.
Please read the following before posting in this forum...
In this forum you will see an Announcement, and several "sticky" topics. The announcement is the Universal Board Rules. If you are new, read this before doing anything else! The sticky topics will stay above and separated from normal user-made topics in the forum. This is because they outline important information about the board. If you see a sticky topic concerning your issue, please reply with your question or concern in the correct topic. Moderators will see your reply within these topics. Before asking your question, be sure to read the topic and its first page especially. It contains information about your issue that is valuable and may even answer your questions. If the topic does not answer your question, ask your question within the topic, not the forum. If no sticky topic concerns your issue, then you are welcome to ask your own questions by creating a new topic within the forum.
Thank you for keeping the Board Help forum organized!
Before reading anything or asking anything; please check out the FAQs. Your question might be in there. However if you want a better understanding after reading the FAQs, like if it didn't explain it good enough, then by all means ask your question.
Please read the following before posting in this forum...
In this forum you will see an Announcement, and several "sticky" topics. The announcement is the Universal Board Rules. If you are new, read this before doing anything else! The sticky topics will stay above and separated from normal user-made topics in the forum. This is because they outline important information about the board. If you see a sticky topic concerning your issue, please reply with your question or concern in the correct topic. Moderators will see your reply within these topics. Before asking your question, be sure to read the topic and its first page especially. It contains information about your issue that is valuable and may even answer your questions. If the topic does not answer your question, ask your question within the topic, not the forum. If no sticky topic concerns your issue, then you are welcome to ask your own questions by creating a new topic within the forum.
Thank you for keeping the Board Help forum organized!
6 posts
• Page 1 of 1
Spiders and Bots
by SnowyCheetah » January 24th, 2011, 11:09 pm
I've seen websites like Google browsing the forum with their accounts. They seem to be labeled "bot" sometimes, and "spider" other times. What's the difference between the two, if any?
That 2in diameter fart can probably adds at least 50bhp.
-
SnowyCheetah
The Meme de la Meme
is mayonnaise a gender
- Posts: 3490
- Joined: August 21st, 2009, 11:47 pm
- Location: USA
- Nickname(s): Snowy, Snow, Sno, SC, SS, Snowball, Stormy
- Gender: Male
- Pride Points: 23
Re: Spiders and Bots
by Moka » January 25th, 2011, 6:09 am
There isn't much of a difference. Spiders download webpages and bots peruse them and execute a predefined function such as index the page for use in a search engine.
-
Moka
:D
- Posts: 6240
- Joined: June 5th, 2008, 5:04 am
- Gender: Male
- Pride Points: 138
Re: Spiders and Bots
by SnowyCheetah » January 25th, 2011, 6:12 am
What do spiders do with downloaded webpages? o.o
That 2in diameter fart can probably adds at least 50bhp.
-
SnowyCheetah
The Meme de la Meme
is mayonnaise a gender
- Posts: 3490
- Joined: August 21st, 2009, 11:47 pm
- Location: USA
- Nickname(s): Snowy, Snow, Sno, SC, SS, Snowball, Stormy
- Gender: Male
- Pride Points: 23
Re: Spiders and Bots
by Moka » January 25th, 2011, 6:36 am
It can vary...a good example is the web archive spider that downloads webpages to archive them: http://www.archive.org/web/web.php
-
Moka
:D
- Posts: 6240
- Joined: June 5th, 2008, 5:04 am
- Gender: Male
- Pride Points: 138
Re: Spiders and Bots
by SnowyCheetah » January 25th, 2011, 7:51 am
Ok. And finally, crawlers?
That 2in diameter fart can probably adds at least 50bhp.
-
SnowyCheetah
The Meme de la Meme
is mayonnaise a gender
- Posts: 3490
- Joined: August 21st, 2009, 11:47 pm
- Location: USA
- Nickname(s): Snowy, Snow, Sno, SC, SS, Snowball, Stormy
- Gender: Male
- Pride Points: 23
Re: Spiders and Bots
by Moka » January 25th, 2011, 9:43 am
I think crawlers are just a name for bots and spiders that "crawl" the web by following links on the web page itself.
They are definitely loose terms, and some programmers define them differently than others. Their meaning is somewhat lost and people use them interchangeably. Personally, I call everything a bot. :]
They are definitely loose terms, and some programmers define them differently than others. Their meaning is somewhat lost and people use them interchangeably. Personally, I call everything a bot. :]
-
Moka
:D
- Posts: 6240
- Joined: June 5th, 2008, 5:04 am
- Gender: Male
- Pride Points: 138
6 posts
• Page 1 of 1
Who is online
Users browsing this forum: No registered users and 47 guests
- The team • Delete all board cookies • All times are UTC [ DST ]