Spider trap

A spider trap (or crawler trap) is a set of web pages that may intentionally or unintentionally be used to cause a web crawler or search bot to make an infinite number of requests or cause a poorly constructed crawler to crash. Web crawlers are also called web spiders, from which the name is derived. Spider traps may be created to "catch" spambots or other crawlers that waste a website's bandwidth. They may also be created unintentionally by calendars that use dynamic pages with links that continually point to the next day or year.

单词	Spider trap
释义	Spider trap 英语百科 Spider trap A spider trap (or crawler trap) is a set of web pages that may intentionally or unintentionally be used to cause a web crawler or search bot to make an infinite number of requests or cause a poorly constructed crawler to crash. Web crawlers are also called web spiders, from which the name is derived. Spider traps may be created to "catch" spambots or other crawlers that waste a website's bandwidth. They may also be created unintentionally by calendars that use dynamic pages with links that continually point to the next day or year.
随便看	hardware cost的意思 hardware costs的意思 hardware cryptographic module的意思 hardware cursor的意思 hardware data control的意思 hardware data extraction的意思 hardwared automation的意思 hardware dealer的意思 hardware debug的意思 hardware default font的意思 hardware deficiency的意思 hardware dependency的意思 Hardware dependent的意思 Hardware description language的意思 hardware description language, HDL的意思 Hardware description languages的意思 Hardware design的意思 hardware design language的意思 hardware design language, HDL的意思 hardware development的意思 hardware device的意思 Hardware device driver的意思 hardware devices的意思 hardware diagnoise的意思 hardware diagnostic的意思