blokada robotow + htaccess + modrewrite

breja · 15 Marca 2005

Cos nie moge sobie poradzic z polaczeniem tego

Obecnie mam w dmozie


RewriteEngine On

RewriteRule ^([^.]+)$ index.php?c=/$1 [L]

a chce dodac cos takiego do wykopywania sepow:


RewriteEngine On





RewriteBase / 









#crawlery co szukaja same nie wiedza czego





RewriteCond %{HTTP_USER_AGENT} ^arachnofilia* [OR]





RewriteCond %{HTTP_USER_AGENT} ^aspseek* [OR]





RewriteCond %{HTTP_USER_AGENT} ^attach [OR]





RewriteCond %{HTTP_USER_AGENT} ^BackWeb [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Bandit [OR] 





RewriteCond %{HTTP_USER_AGENT} ^BatchFTP [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Botmailto:craftbot@yahoo.com [OR]





RewriteCond %{HTTP_USER_AGENT} ^Buddy [OR]





RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Collector [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Copier [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Crescent [OR]





RewriteCond %{HTTP_USER_AGENT} ^CherryPicker [OR]





RewriteCond %{HTTP_USER_AGENT} ^DA [OR] 





RewriteCond %{HTTP_USER_AGENT} ^DISCoPump [OR] 





RewriteCond %{HTTP_USER_AGENT} ^DownloadDemon [OR] 





RewriteCond %{HTTP_USER_AGENT} ^DownloadWonder [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Downloader [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Drip [OR] 





RewriteCond %{HTTP_USER_AGENT} ^DIIbot [OR]





RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR] 





RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR] 





RewriteCond %{HTTP_USER_AGENT} ^ExpressWebPictures [OR] 





RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR] 





RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR] 





RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]





RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]





RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]





RewriteCond %{HTTP_USER_AGENT} ^EmailCollector [OR]





RewriteCond %{HTTP_USER_AGENT} ^FileHound [OR] 





RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR] 





RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR] 





RewriteCond %{HTTP_USER_AGENT} ^GetSmart [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR] 





RewriteCond %{HTTP_USER_AGENT} ^gotit [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Grabber [OR] 





RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR] 





RewriteCond %{HTTP_USER_AGENT} ^HMView [OR] 





RewriteCond %{HTTP_USER_AGENT} ^HTTrack [OR] 





RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR] 





RewriteCond %{HTTP_USER_AGENT} ^InternetNinja [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Iria [OR]





RewriteCond %{HTTP_USER_AGENT} ^ia_archiver [OR]





RewriteCond %{HTTP_USER_AGENT} ^InternetSeer.com [OR]  





RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR] 





RewriteCond %{HTTP_USER_AGENT} ^JOC [OR] 





RewriteCond %{HTTP_USER_AGENT} ^JustView [OR] 





RewriteCond %{HTTP_USER_AGENT} ^lftp [OR] 





RewriteCond %{HTTP_USER_AGENT} ^likse [OR]





RewriteCond %{HTTP_USER_AGENT} ^Link [OR] 





RewriteCond %{HTTP_USER_AGENT} ^LinkWalker [OR]





RewriteCond %{HTTP_USER_AGENT} ^Magnet [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Mag-Net [OR] 





RewriteCond %{HTTP_USER_AGENT} ^MassDownloader [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Memo [OR] 





RewriteCond %{HTTP_USER_AGENT} ^MIDowntool [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Mirror [OR] 





RewriteCond %{HTTP_USER_AGENT} ^MisterPiX [OR]





RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*NEWT [OR]





RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*Indy [OR] 





RewriteCond %{HTTP_USER_AGENT} ^MSFrontPage [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Microsoft.URL [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Microsoft.URL [OR]





RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NetVampire [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NetZip [OR] 





RewriteCond %{HTTP_USER_AGENT} ^NICErsPRO [OR]





RewriteCond %{HTTP_USER_AGENT} ^Ninja [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR] 





RewriteCond %{HTTP_USER_AGENT} ^OfflineExplorer [OR] 





RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR] 





RewriteCond %{HTTP_USER_AGENT} ^PapaFoto [OR] 





RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Pockey [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Pump [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Ping [OR] 





RewriteCond %{HTTP_USER_AGENT} ^psbot [OR]





RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Reaper [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Recorder [OR] 





RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Siphon [OR] 





RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]





RewriteCond %{HTTP_USER_AGENT} ^sitecheck.internetseer.com [OR] 





RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Snake [OR] 





RewriteCond %{HTTP_USER_AGENT} ^SpaceBison [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Stripper [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Sucker [OR] 





RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR] 





RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR] 





RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Teleport Pro [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Vacuum [OR] 





RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebImageCollector [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebSucker [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Website [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Webster [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Wget [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Whacker [OR] 





RewriteCond %{HTTP_USER_AGENT} ^Widow [OR] 





RewriteCond %{HTTP_USER_AGENT} ^WebEMailExtrac.* [OR] 





RewriteCond %{HTTP_USER_AGENT} ^[Ww]eb[Bb]andit [OR]





RewriteCond %{HTTP_USER_AGENT} ^Zeus.*Webster [OR]





RewriteCond %{HTTP_USER_AGENT} ^Xaldon 





RewriteRule !^err403.htm$ - [F,L] 









RewriteCond %{HTTP_REFERER} ^https://www.iaea.org$ 





RewriteRule !^err403.htm$ - [F,L] 









# Cyveillance 





RewriteCond %{REMOTE_ADDR} ^63.148.99.2(2[4-9]¦[34][0-9]¦5[0-5])$ [OR] 





RewriteCond %{REMOTE_ADDR} ^63.226.3[34]. [OR] 





RewriteCond %{REMOTE_ADDR} ^63.212.171.161$ [OR]









# Webcontent International 





RewriteCond %{REMOTE_ADDR} ^65.102.12.2(2[4-9]¦3[01])$ [OR] 





RewriteCond %{REMOTE_ADDR} ^65.102.17.(3[2-9]¦[4-6][0-9]¦7[0-1]¦8[89]¦9[0-5]¦10[4-9]¦11[01])$ [OR] 





RewriteCond %{REMOTE_ADDR} ^65.102.23.1(5[2-9]¦6[0-7])$ 





RewriteRule !^err403.htm$ - [F,L]

i cos mi nie wychodzi bo "RewriteBase / " psuje mi modrewrite i nie wiem w jaki sposob to polaczyc

michal · 15 Marca 2005


RewriteEngine On

RewriteBase /



#crawlery co szukaja same nie wiedza czego





RewriteCond %{HTTP_USER_AGENT} ^arachnofilia* [OR]





RewriteCond %{HTTP_USER_AGENT} ^aspseek* [OR]





RewriteCond %{HTTP_USER_AGENT} ^attach [OR]





RewriteCond %{HTTP_USER_AGENT} ^BackWeb [OR]





RewriteCond %{HTTP_USER_AGENT} ^Bandit [OR]





RewriteCond %{HTTP_USER_AGENT} ^BatchFTP [OR]



<reszta tego dlugiego kodu>



RewriteRule ^([^.]+)$ index.php?c=/$1 [L]

i powinno dzialac. Niekiedy wazne jest kolejnosc regulek w .htaccess.

breja · 15 Marca 2005

Nie dziala:


RewriteEngine On

RewriteBase /

RewriteCond %{HTTP_USER_AGENT} ^crawl* [OR]

RewriteCond %{HTTP_USER_AGENT} ^jeeves

RewriteRule !^err403.htm$ - [F,L]

RewriteRule ^([^.]+)$ index.php?c=/$1 [L]

Po takim kodzie wszystko jest przekierowywane na domene glowna :/

michal · 15 Marca 2005

W takim razie sprobuj wogole pozbyc sie RewriteBase /. To nie jest czesto potrzebne.

Moze cos takiego:


RewriteEngine On



RewriteCond %{HTTP_USER_AGENT} "crawl" [OR]

RewriteCond %{HTTP_USER_AGENT} "jeeves"

RewriteRule .* - [F]



RewriteRule ^([^.]+)$ index.php?c=/$1 [L]

breja · 15 Marca 2005

Dziala dzieki!

qazy · 20 Maja 2005

W takim razie sprobuj wogole pozbyc sie RewriteBase /. To nie jest czesto potrzebne.
Moze cos takiego:
RewriteEngine On



RewriteCond %{HTTP_USER_AGENT} "crawl" [OR]

RewriteCond %{HTTP_USER_AGENT} "jeeves"

RewriteRule .* - [F]



RewriteRule ^([^.]+)$ index.php?c=/$1 [L]

Czy wrzucenie tego w .htaccess rozwiaze mi problem z masakrycznym transferem jaki robia mi roboty w kopii DMOZa na serwerze?

Jesli nie to co moge zrobic zeby dac "zielone swiatlo" jedynie dla Googlebota?

michal · 20 Maja 2005

Czy wrzucenie tego w .htaccess rozwiaze mi problem z masakrycznym transferem jaki robia mi roboty w kopii DMOZa na serwerze?

Tak

Zaloguj się

blokada robotow + htaccess + modrewrite

Rekomendowane odpowiedzi

breja

Odnośnik do komentarza

Udostępnij na innych stronach

michal

Odnośnik do komentarza

Udostępnij na innych stronach

breja

Odnośnik do komentarza

Udostępnij na innych stronach

michal

Odnośnik do komentarza

Udostępnij na innych stronach

breja

Odnośnik do komentarza

Udostępnij na innych stronach

qazy

Odnośnik do komentarza

Udostępnij na innych stronach

michal

Odnośnik do komentarza

Udostępnij na innych stronach

Zarchiwizowany

Ostatnio przeglądający 0 użytkowników

Polecamy

Senuto

netBOMB.pl
dariuszjurek.pl
noclegi.biz.pl
www.zgred.pl

Współpracują z nami

SEOsklep24.pl
Zdalny Admin

Przeglądaj

Cała aktywność

Twoje kanały aktywności

Powiadomienie o plikach cookie