Blokowanie niechcianych botów

[macet]

Czy to wystarczy w htaccess żeby zablokować niechciane boty?

#The next line modified by DenyIP

order allow,deny

#The next line modified by DenyIP

#deny from all

allow from all

order deny,allow

deny from all

order allow,deny

allow from all

SetEnvIfNoCase User-Agent .*Twiceler.* bad_bot

SetEnvIfNoCase User-Agent .*VoilaBot BETA 1.2.* bad_bot

SetEnvIfNoCase User-Agent .*libwww-perl/5.805.* bad_bot

SetEnvIfNoCase User-Agent .*Java/1.5.0_11.* bad_bot

SetEnvIfNoCase User-Agent .*Sogou web spider/3.0.* bad_bot

SetEnvIfNoCase User-Agent .*psbot.* bad_bot

SetEnvIfNoCase User-Agent .*Exabot.* bad_bot

SetEnvIfNoCase User-Agent .*Charlotte/1.0b.* bad_bot

SetEnvIfNoCase User-Agent .*boitho.com-dc.* bad_bot

SetEnvIfNoCase User-Agent .*ajSitemap.* bad_bot

SetEnvIfNoCase User-Agent .*bot/1.0.* bad_bot

SetEnvIfNoCase User-Agent .*panscient.com.* bad_bot

SetEnvIfNoCase User-Agent .*Java/1.6.0_11.* bad_bot

SetEnvIfNoCase User-Agent .*WebDataCentreBot/1.0.* bad_bot

SetEnvIfNoCase User-Agent .*Java.* bad_bot

SetEnvIfNoCase User-Agent .*SapphireWebCrawler.* bad_bot

SetEnvIfNoCase User-Agent .*Yandex.* bad_bot

SetEnvIfNoCase User-Agent .*Baiduspider.* bad_bot

SetEnvIfNoCase User-Agent .*Rankivabot.* bad_bot

SetEnvIfNoCase User-Agent .*DBLBot/1.0.* bad_bot

SetEnvIfNoCase User-Agent .*DotBot* bad_bot

SetEnvIfNoCase User-Agent .*MJ12bot* bad_bot

SetEnvIfNoCase User-Agent .*AhrefsBot* bad_bot

SetEnvIfNoCase User-Agent .*sitebot* bad_bot

SetEnvIfNoCase User-Agent .*LexxeBot* bad_bot

SetEnvIfNoCase User-Agent .*Ezooms* bad_bot

SetEnvIfNoCase User-Agent .*ichiro* bad_bot

SetEnvIfNoCase User-Agent .*AppEngine-Google* bad_bot

order allow,deny

deny from env=bad_bot

allow from all

[Probity]

To zależy jakich botów nie chcesz.

Edit

Więcej znajdziesz tutaj: https://www.forum.optymalizacja.com/index.php?showforum=18

[macet]

To zależy jakich botów nie chcesz.

Edit

Więcej znajdziesz tutaj: https://www.forum.optymalizacja.com/index.php?showforum=18

wszystkich oprócz google

[Rzezniczek]

Ja te blokuję:

RewriteCond %{HTTP_USER_AGENT} .*Twice.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*roge.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yand.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Baidu.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*site.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Ahre.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*seo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yahoo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Voil.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*libw.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Java.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Sogou.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*psbot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Exabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*boitho.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ajSitemap.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Rankivabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*DBLBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*MJ1.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ask.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*DotBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*MJ12bot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*AhrefsBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*sitebot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*LexxeBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yandex.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Ezooms.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ichiro.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*AppEngine-Google.* [OR]

[macet]

Ok. Dzięki

Jakbym chciał jeszcze do pliku .htaccess dołożyć przekierowanie podstron serwisu na inne podstrony to jak zrobić:

1. dopisać nad "botami" -

RewriteEngine On

RewriteBase /

RewriteRule $podstrona-jakas1.html podstrona-jaksa2.html [R=301,L]

2. czy dopisać pod "botami"

[Rzezniczek]

Ja np. dla tej stronki: https://www.ipolisa.org/

Tak zrobiłem:

RewriteEngine On
RewriteCond %{HTTP_HOST} ^ipolisa.org
RewriteRule ^(.*)$ https://www.ipolisa.org/$1 [R=301,L]

RewriteBase /
RewriteCond %{HTTP_USER_AGENT} .*Twice.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*roge.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yand.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Baidu.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*site.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Ahre.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*seo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yahoo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Voil.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*libw.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Java.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Sogou.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*psbot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Exabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*boitho.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ajSitemap.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Rankivabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*DBLBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*MJ1.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ask.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*DotBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*MJ12bot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*AhrefsBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*sitebot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*LexxeBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yandex.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Ezooms.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ichiro.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*AppEngine-Google.* [OR]
Allow from all
Deny from 110.0.0.0/8
Deny from 111.0.0.0/8
Deny from 112.0.0.0/5
Deny from 120.0.0.0/6
Deny from 124.0.0.0/8
Deny from 125.0.0.0/8
Deny from 147.0.0.0/8
Deny from 169.208.0.0/8
Deny from 175.0.0.0/8
Deny from 180.0.0.0/8
Deny from 182.0.0.0/8
Deny from 183.0.0.0/8
Deny from 202.0.0.0/8
Deny from 203.0.0.0/8
Deny from 210.0.0.0/8
Deny from 211.0.0.0/8
Deny from 218.0.0.0/8
Deny from 219.0.0.0/8
Deny from 220.0.0.0/8
Deny from 221.0.0.0/8
Deny from 222.0.0.0/8

Możesz tam zadziałać z przekierowaniem na różnych podstronach.

[macet]

ok dzięki za odpowiedź