Blokada IP spam robotów

[EDDY]

W prezencie na nowy rok udostępniam moją listę spam robotów, którą zebrałem w ciągu 3 lat.

Wystarczy przekopiować do pliku .htaccess

<Files *>
Order Allow,Deny
Allow from all
deny from 65.19.169
deny from 65.19.150
deny from 65.19.134
deny from 64.71.131
deny from 85.186.163.12
deny from 83.17.138.202
deny from 208.66.195
deny from 66.55.138.98
deny from 72.3.
deny from 69.244.
deny from 69.255.
deny from 200.3.114
deny from 58.187.68.186
deny from 58.187.124.27
deny from 222.255.63.99
deny from 222.255.192.118
deny from 69.25.71.12
deny from 209.8.20.194
deny from 85.255.117.221
deny from 85.255.118.108
deny from 128.241.20.199
deny from 128.241.20.196
deny from 64.92.167.82
deny from 203.223.150.64
deny from 203.121.79.95
deny from 211.24.141.98
deny from 24.95.243.224
deny from 72.36.205.10
deny from 219.93.182.99
deny from 64.92.167.82
deny from 81.177.22.111
deny from 125.136.136.78
deny from 168.188.14.215
deny from 221.19.244.74
deny from 68.229.85.135
deny from 59.186.67.28
deny from 66.122.198.87
deny from 24.168.99.115
deny from 75.68.184.244
deny from 67.82.212.245
deny from 210.123.124.168
deny from 71.201.216.239
deny from 24.149.233.170
deny from 81.177.34.184
deny from 69.123.158.121
deny from 77.91.0.109
deny from 87.116.95.219
deny from 68.106.94.63
deny from 85.255.117.98
deny from 218.38.13.111
deny from 85.180.186.90
deny from 58.120.132.232
deny from 67.84.47.97
deny from 211.41.249.126
deny from 220.29.4.184
deny from 67.81.235.37
deny from 24.30.24.205
deny from 68.198.15.106
deny from 24.185.253.215
deny from 4.156.129.9
deny from 203.235.13.73
deny from 125.189.53.221
deny from 82.245.226.52
deny from 195.224.154.232
deny from 82.247.25.226
deny from 66.232.123.132
deny from 61.10.22.11
deny from 71.203.137.166
deny from 200.50.66.98
deny from 59.171.236.55
deny from 209.9.169.98
deny from 89.163.145.240
deny from 72.36.95.228
deny from 203.162.27.93
deny from 72.47.23.84
deny from 207.61.242.110
deny from 221.162.91.254
deny from 12.190.1.141
deny from 74.130.235.74
deny from 70.42.51.30
deny from 75.126.151.122
deny from 66.232.103.246
deny from 24.131.104.124
deny from 58.239.32.181
deny from 125.128.146.104
deny from 59.25.9.95
deny from 24.182.56.15
deny from 221.151.103.84
deny from 121.130.123.37
deny from 220.116.142.200
deny from 219.240.36.175
deny from 61.253.10.18
deny from 72.232.7.242
deny from 38.99.44.107
deny from 72.29.90.23
deny from 220.117.157.16
deny from 221.151.103.84
deny from 218.235.251.164
deny from 70.87.15.10
deny from 218.188.67.222
deny from 66.122.198.87
deny from 218.42.64.60
deny from 195.76.242.227
deny from 213.170.35.27
deny from 59.165.204.67
deny from 207.67.117.173
deny from 190.7.62.202
deny from 204.169.23.246
deny from 209.58.83.178
deny from 89.202.127.9
deny from 85.100.234.139
deny from 125.244.148.2
deny from 216.56.12.20
deny from 200.81.1.45
deny from 201.48.159.138
deny from 161.53.7.184
deny from 201.63.98.83
deny from 85.17.187.9
deny from 209.131.124.42
deny from 60.244.123.129
deny from 195.254.148.73
deny from 213.254.232.74
deny from 200.84.84.172
deny from 195.229.242.57
deny from 203.147.0.30
deny from 203.144.144.164
deny from 85.21.125.100
deny from 210.0.140.99
deny from 209.50.135.53
deny from 201.18.38.242
deny from 74.136.32.114
deny from 200.138.45.244
deny from 122.210.177.181
deny from 75.125.34.66
deny from 216.217.98.100
deny from 193.90.144.102
deny from 195.225.178.28
deny from 65.98.103.12
deny from 71.145.140.32
deny from 208.36.144.8
deny from 85.92.130.117
deny from 203.160.1.162
deny from 82.112.124.79
deny from 210.18.104.227
deny from 24.56.211.200
deny from 212.51.122.19
deny from 85.108.208.78
deny from 84.145.222.53
deny from 212.51.122.19
deny from 85.17.226.81
deny from 195.229.242.154
deny from 75.157.132.75
deny from 71.188.183.210
deny from 85.255.112.
deny from 85.255.113.
deny from 85.255.114.
deny from 85.255.115.
deny from 85.255.116.
deny from 85.255.117.
deny from 85.255.118.
deny from 85.255.119.
deny from 85.255.120.
deny from 85.255.121.
deny from 85.255.122.
deny from 85.255.123.
deny from 85.255.124.
deny from 85.255.125.
deny from 85.255.126.
deny from 85.255.127.
deny from 85.98.93.111
deny from 193.34.92.187
deny from 85.19.150.85
deny from 67.98.248.51
deny from 82.126.187.114
deny from 66.212.18.198
deny from 74.54.21.34
deny from 200.21.223.90
deny from 77.45.199.239
deny from 89.171.219.150
deny from 201.9.246.229
deny from 89.221.56.139
deny from 210.245.164.10
deny from 217.195.192.40
deny from 211.172.232.90
deny from 64.207.204.19
deny from 213.160.188.77
deny from 213.71.9.25
deny from 82.141.173.75
deny from 220.130.53.126
deny from 83.12.231.38
deny from 217.13.86.10
deny from 81.1.220.207
deny from 91.148.18.139
deny from 66.27.189.29
deny from 212.244.115.33
deny from 78.94.100.82
deny from 219.19.84.83
deny from 96.10.22.152
deny from 74.161.75.102
deny from 220.77.47.44
deny from 89.0.30.180
deny from 211.225.18.156
deny from 80.145.233.160
deny from 218.152.52.242
deny from 216.183.146.68
deny from 220.78.90.47
deny from 69.159.114.242
deny from 219.251.173.136
deny from 72.139.52.205
deny from 67.68.118.211
deny from 92.81.112.99
deny from 24.172.69.134
deny from 89.0.191.230
deny from 211.214.217.87
deny from 88.232.169.81
deny from 220.84.216.107
deny from 206.74.118.83
deny from 67.149.177.24
deny from 77.247.164.174
deny from 83.1.81.194
deny from 88.224.83.243
deny from 92.81.203.67
deny from 80.176.131.32
deny from 85.98.163.45
deny from 69.203.143.49
deny from 200.8.204.115
deny from 80.187.104.2
deny from 78.88.205.87
deny from 88.66.194.106
deny from 201.235.150.234
deny from 189.55.29.143
deny from 212.142.143.116
deny from 212.248.240.1
deny from 76.246.45.204
deny from 69.217.73.52
deny from 216.58.96.135
deny from 80.252.254.241
deny from 83.29.214.221
deny from 62.133.141.15
deny from 217.136.207.168
deny from 77.252.68.253
deny from 78.108.224.27
deny from 81.88.114.208
deny from 62.5.176.249
deny from 85.106.174.44
deny from 124.244.215.225
deny from 201.40.175.237
deny from 200.49.171.126
deny from 80.227.1.101
deny from 222.82.226.145
deny from 71.167.175.55
deny from 79.86.246.228
deny from 200.51.41.29
deny from 198.70.212.57
deny from 189.56.193.250
deny from 200.13.243.76
deny from 200.129.43.168
deny from 74.53.104.146
deny from 83.238.23.214
deny from 203.26.122.8
deny from 213.244.9.50
deny from 89.149.227.100
deny from 212.26.255.102
deny from 216.155.68.242
deny from 38.101.222.130
deny from 60.234.20.98
deny from 125.244.112.66
deny from 89.149.205.199
deny from 63.209.206.122
deny from 124.217.230.104
deny from 203.131.209.142
deny from 218.152.150.147
deny from 24.138.133.97
deny from 116.46.106.16
deny from 123.236.97.173
deny from 221.164.41.29
deny from 89.0.169.227
deny from 59.95.110.2
deny from 80.13.133.38
deny from 206.248.223.151
deny from 88.117.24.0
deny from 211.218.72.195
deny from 85.255.32.30
deny from 92.80.7.48
deny from 61.11.71.53
deny from 61.31.172.63
deny from 121.168.149.47
deny from 124.44.145.208
deny from 211.220.12.90
deny from 211.218.101.7
deny from 222.97.212.71
deny from 61.80.180.238
deny from 121.162.213.50
deny from 71.105.9.80
deny from 121.136.214.161
deny from 66.167.42.180
deny from 69.158.153.198
deny from 121.158.119.12
deny from 71.253.102.165
deny from 80.121.109.190
deny from 66.203.162.203
deny from 217.110.54.240
deny from 86.109.103.76
deny from 89.248.99.153
deny from 194.79.75.195
deny from 216.113.192.99
deny from 66.96.80.31
deny from 213.203.223.115
deny from 61.100.189.222
deny from 64.33.49.76
deny from 85.17.208.143
deny from 70.85.82.84
deny from 68.76.31.154
deny from 218.50.53.151
deny from 218.38.12.74
deny from 64.34.169.108
deny from 62.193.236.107
deny from 222.239.78.91
deny from 74.86.130.109
deny from 75.126.9.99
deny from 63.167.66.230
deny from 189.1.132.59
deny from 222.96.156.153
deny from 83.149.90.29
deny from 209.172.34.237
deny from 130.161.158.3
deny from 211.115.89.60
deny from 88.191.48.162
deny from 196.30.245.149
deny from 217.20.117.47
deny from 209.85.29.25
deny from 201.91.215.136
deny from 161.53.125.15
deny from 208.67.83.25
deny from 62.220.146.59
deny from 193.188.66.23
deny from 83.15.229.170
deny from 208.100.26.14
deny from 80.51.77.2
deny from 194.183.224.104
deny from 85.17.200.74
deny from 61.19.121.124
deny from 85.114.132.12
deny from 66.79.163.220
deny from 211.218.149.119
deny from 222.231.1.53
deny from 204.202.2.203
deny from 218.189.222.164
deny from 204.202.2.203
deny from 61.250.95.201
deny from 69.94.120.198
deny from 85.119.152.152
deny from 76.74.186.159
deny from 70.84.141.194
deny from 202.142.220.82
deny from 87.118.102.153
deny from 202.213.133.233
deny from 85.88.11.140
deny from 88.80.206.12
deny from 75.18.221.75
deny from 217.197.68.66
deny from 201.28.114.173
deny from 72.21.55.2
deny from 201.35.66.58
deny from 62.116.173.131
deny from 201.217.93.91
deny from 213.227.137.187
deny from 204.68.172.35
deny from 211.233.19.105
deny from 211.233.19.105
deny from 80.237.144.235
deny from 89.248.96.141
deny from 222.122.47.228
deny from 222.236.47.176
deny from 83.17.81.2
deny from 212.42.230.152
deny from 69.72.221.130
deny from 83.16.96.219
deny from 207.234.224.141
deny from 194.204.11.65
deny from 72.29.73.171
deny from 74.6.8.107
deny from 80.194.210.35
deny from 87.101.244.6
deny from 85.17.145.57
deny from 210.114.223.160
deny from 81.23.229.105
deny from 81.169.171.5
deny from 194.126.239.14
deny from 72.55.148.27
deny from 217.111.41.132
deny from 218.150.78.201
deny from 195.140.135.102
deny from 221.143.49.246
deny from 196.207.40.212
deny from 62.168.15.147
deny from 87.117.225.155
deny from 92.113.21.146
deny from 209.85.108.34
deny from 84.18.207.65
deny from 204.9.78.190
deny from 72.21.49.130
deny from 91.121.92.203
deny from 64.22.112.178
deny from 213.215.226.36
deny from 206.71.183.50
deny from 74.53.225.98
deny from 217.141.105.203
deny from 196.207.15.201
deny from 61.61.254.36
deny from 217.141.250.204
deny from 203.162.2.134
deny from 157.158.0.30
deny from 91.121.200.220
deny from 203.158.221.227
deny from 61.188.38.192
deny from 38.99.44.105
deny from 195.24.77.247
deny from 88.198.34.243
deny from 24.33.149.14
deny from 211.38.131.22
deny from 65.210.117.93
deny from 81.210.48.58
deny from 84.34.147.92
deny from 83.13.29.123
deny from 209.17.168.2
deny from 200.19.221.136
deny from 83.31.61.200
deny from 80.50.231.222
deny from 85.178.99.165
deny from 67.69.254.243
deny from 91.66.211.49
deny from 66.212.19.148
deny from 208.115.111.242
deny from 213.186.114.175
deny from 200.63.42.89
deny from 76.69.182.67
deny from 193.34.144.72
deny from 85.222.78.178
deny from 208.111.154.16
deny from 196.207.254.45
deny from 41.208.169.34
deny from 84.40.208.74
deny from 78.110.175.15
deny from 93.174.93.220
deny from 213.172.182.110
deny from 209.62.41.210
deny from 65.222.217.211
deny from 87.118.108.229
deny from 58.229.189.184
deny from 78.46.75.178
deny from 68.178.254.149
deny from 64.202.161.131
deny from 221.132.112.94
deny from 72.36.131.98
deny from 85.10.202.240
deny from 69.197.137.2
deny from 196.207.243.58
deny from 78.46.88.202
deny from 212.116.219.190
deny from 41.208.132.150
deny from 60.240.249.194
deny from 10.210.209.91
deny from 217.12.16.54
deny from 121.142.118.50
deny from 89.149.253.214
deny from 89.122.29.82
deny from 85.10.206.147
deny from 74.53.100.34
deny from 81.202.102.198
deny from 64.191.25.37
deny from 74.52.125.130
deny from 213.154.91.46
deny from 196.207.195.95
deny from 92.48.122.144
deny from 213.46.223.17
deny from 216.240.136.125
deny from 121.174.76.83
deny from 94.178.59.124
deny from 216.143.82.245
deny from 67.19.130.218
deny from 213.239.198.104
deny from 10.112.0.153
deny from 195.128.18.18
deny from 195.149.228.99
deny from 89.161.130.200
deny from 84.244.189.99
deny from 114.30.47.1
deny from 91.121.203.53
deny from 163.28.32.100
deny from 200.226.137.11
deny from 67.69.254.245
deny from 66.198.41.11
deny from 94.102.60.151
deny from 79.135.167.26
deny from 201.68.111.224
deny from 220.33.204.83
deny from 65.28.240.175
deny from 71.235.86.254
deny from 94.23.17.159
deny from 64.66.192.62
deny from 189.20.202.89
deny from 59.90.133.57
deny from 12.110.109.201
deny from 218.225.183.104
deny from 85.120.220.27
deny from 69.1.118.22
deny from 64.66.192.61
deny from 194.176.176.82
deny from 61.64.56.42
deny from 24.67.168.96
deny from 203.194.104.157
deny from 172.191.36.85
deny from 194.8.74.235
deny from 75.63.148.195
deny from 62.23.5.170
deny from 222.36.12.42
deny from 61.8.74.242
deny from 219.103.10.47
deny from 201.37.230.154
deny from 81.80.246.54
deny from 24.185.37.200
deny from 88.104.102.53
deny from 77.97.36.35
deny from 201.34.16.21
deny from 67.223.234.160
deny from 80.90.160.194
deny from 70.119.146.106
deny from 202.109.110.2
deny from 170.35.208.23
deny from 87.101.244.9
deny from 71.59.148.180
deny from 123.130.112.17
deny from 209.94.64.70
deny from 70.64.75.137
deny from 212.44.61.185
deny from 96.57.154.179
deny from 202.158.150.174
deny from 212.62.97.23
deny from 41.205.111.8
deny from 192.28.2.6
deny from 80.93.90.96
deny from 69.72.144.34
deny from 66.90.85.60
deny from 173.8.136.81
deny from 65.208.70.115
deny from 212.116.219.81
deny from 68.180.184.229
deny from 69.119.218.16
deny from 218.118.14.98
deny from 202.231.110.58
deny from 124.125.100.55
deny from 59.94.114.144
deny from 217.199.217.100
deny from 122.252.228.202
deny from 216.32.71.251
deny from 85.214.81.233
</Files>

Oczywiście lista ciągle się powiększa...

[Erbit]

A co z blokadą całych klas - np. całej klasy firmy hostingowej ?

Blokowanie całej klasy jest o wiele korzystniejsze.

[EDDY]

To trzeba robić to w ten sposób:

deny from 72.3.

deny from 72.4.

deny from 72.5.

itd.

[gielo]

a da się to jakoś globalnie dla całego dedyka wsadzić aby nie kopiować do każdego .htaccess strony znajdującej się na serwerze ?

[Saint]

a da się to jakoś globalnie dla całego dedyka wsadzić aby nie kopiować do każdego .htaccess strony znajdującej się na serwerze ?

To by było dobre.

[Maximus Marius]

dodac do iptables i bedzie globalne dla serwera

[EDDY]

Najwydajniej jest korzystać z mod_rbl w apache.

[Maximus Marius]

Fajne fajne , dodane do ulubionych

[gielo]

myślałem by wyfiltrować poprzez iptables. Nic dodam adresy do listy bogon i będzie oki

eddy takie pytanko jescze do ciebie czy ta lista zawiera crawlery yahoo, msn czy jakieś inne będące czasem przydatne ? czy wszystko to adresy spambotów i można blokować jak leci wszystko ?

[EDDY]

Takich rzeczy nie blokowałem, bo też mam odwiedziny z tych wyszukiwarek.

[Erbit]

a da się to jakoś globalnie dla całego dedyka wsadzić aby nie kopiować do każdego .htaccess strony znajdującej się na serwerze ?

.htaccess to zewnętrzny plik konfiguracyjny apache. Wszystkie wpisy zawarte w .htaccess można użyć bezpośrednio w pliku konfiguracyjnym - choć to niezbyt wygodna forma.

To trzeba robić to w ten sposób:

deny from 72.3.

deny from 72.4.

deny from 72.5.

itd.

Hmm... sprawdzę - choć przyznam, że jestem mocno zdziwiony tą składnią.

[gielo]

właśnie mi erbit o coś takiego chodziło. Nic jednak wcześniej dodałem to do wyfiltrowania w firewallu. Obciązenie serwera spadło o kilka procent więc się chyba opłaciło.

[Erbit]

... wcześniej dodałem to do wyfiltrowania w firewallu.

osobiście stosuję jednak PHP - daje to szersze możliwości działania (np. mogę po "User Agent" filtrować).

Skrypt PHP podpinam w konfiguracji php.ini by działał dla każdego wywołania PHP. Wadą oczywiście jest, że działa to w przypadku gdy strona www wykorzystuje PHP - ale dziś to już chyba rzadkość by strona nie korzystała z php. Poza tym można zmusić serwer by HTML był także parsowany przez PHP.

Swego czasu gdy stosowałem hostingi z dużym powodzeniem ten sam skrypt podpinałem do poszczególnych serwisów. Dzięki temu (dzięki PHP) mogłem ten sam skrypt stosować tak na dedykach jak i na hostingach.

... Obciązenie serwera spadło o kilka procent więc się chyba opłaciło.

Oj tak! Znacznie spada!

Dlatego już kilka lat temu powstał "blokrob" a i chyba Jamesisko też stworzył swoją "zabawkę" do blokowania - bo warto blokować. Spada obciążenie ale spada też transfer (!) co ma spore znaczenie przy hostingach.

Blokuję też "dziwne przeszukiwania" nieistniejących adresów (najczęściej są to poszukiwania dziur) i wtedy wykorzystuję blokowanie całych klas - zazwyczaj są to klasy hostingów. Nie szkodzę tym userom a dodatkowo zabezpieczam serwer.

[EDDY]

Dodaję nowe IP do blokowania:

deny from 129.70.142.34
deny from 82.41.103.57
deny from 69.92.76.59
deny from 59.56.174.199
deny from 210.212.213.83
deny from 203.110.240.22
deny from 201.252.120.133
deny from 124.53.159.169

[Maximus Marius]

najlepiej by było jakbyś udostępniał adresy IP w postaci pliku txt pod jakims stalym adresem https://gdzies/twoj-plik.txt

wtedy można by sobie zrobić automatyczna aktualizację