Aktywność robota Yahoo na stronie

[cassyalic]

Jak ograniczyć aktywność robota Yahoo ??

pozdr.

[hejowicz]

https://help.yahoo.com/l/us/yahoo/search/we...r/slurp-03.html

patrz na sam dół

robot.txt Examples:

A rule for a delay value of 0.5 would look like:

User-agent: Slurp
Crawl-delay: 0.5

A robots.txt rule to set a higher crawl-delay of 5 for Yahoo! Slurp looks like:

User-agent: Slurp
Crawl-delay: 5

If you have continuing issues regarding the higher or lower frequency of Yahoo! crawlers, please use the "Contact Customer Care" button below to open an inquiry form. Copy snippets from your most recent web server access log file that shows the Yahoo! crawler activity, and the URL of the host affected, into the feedback area. Yahoo! requires this information to process your request.