hrefer

[jamesisko]

Witam,

SB używam i jest ok.. tylko czasami tych wyników znajduje 2-3 miliiony i jest lipa ;/

hrefer by się nadawał, tylko że za cholere nic nie może wyszukać (ani na prywatnych proxy ani na tych co on ma tam zdefiniowanych).

coś bliżej może ktos na szybko podać, w sensie ustawienia by cokolwiek szukał, bo mieli i mieli i nic ;/

[szfab]

Z publicznych ciezko cokolwiek wyharvestowac.

Jesli masz prywatne proxy (parenascie sztuk), wrzuc je do pliku. W hreferze ustaw zeby nie odswiezal.

Ilosc watkow <= liczba proxy.

Powinno dzialac.

[Mar_Dal]

A z jakich proxy korzystasz ?

[yokokeke]

z publicznych wyharvestowalem juz ponad 1m adresow

[ezomaniak]

z publicznych wyharvestowalem juz ponad 1m adresow

jakich publiczynych proxy używasz ?

[tonieja]

Potwierdzam. Z publicznych można ładnie zbierać.

Nie tylko fora ale i blogi.

Mam > 1000 publicznych proxy i jest ok.

M

[jamesisko]

to ja mam chyba cos nie tak z tym harvesterem.

na default additive words nic

pozniej wpisałem cos takiego:

"Powered by BlogEngine.Net"

"powered by b2evolution"

"name" + "email" + "powered by wordpress"

"Your email address will not be revealed on this site." + "Your URL will be displayed."

"Notify me when new comments are added" +"Powered by BlogEngine.NET"

"comment" "Powered By ExpressionEngine" -forum

też nic

publicznych poroxy mam okolo 600

prywatnych 50

searchengines ustawione na default

i nic ;/ zero nicht null ;/

...

zminiłem te additive na:

forum

phorum

add topic

new topic

phpbb

yabb

ipb

posting

add message

send message

post new topic

new thread

send thread

vbulletin

bbs

intext:"powered by vbulletin"

intext:"powered by yabb"

intext:"powered by ip.board"

intext:"powered by phpbb"

inanchor:vbulletin

inanchor:yabb

inanchor:ip.board

inanchor:phpbb

/board

/board/

/foren/

/forum/

/forum/?fnr=

/forums/

/sutra

act=reg

act=sf

act=st

bbs/ezboard.cgi

bbs1/ezboard.cgi

board

board-4you.de

board/ezboard.cgi

boardbook.de

bulletin

cgi-bin/ezboard.cgi

communityhost.de

exbb

ez2000/ezboard.cgi

ezboard

ezboard.cgi

foren-city.de

foro/

forum-extra.de

forum-gratis.com

forum.

forum.cgi?

forum.onetwomax.de

forumieren.de

forumprofi.de

forumromanum.de

forumservice.de

free-webmaster-service.de

gratis-forum.de

gratis-forum.de/

homepage-forum.de

homepagemodules.de

inet-forum.de

invision

kostenlose-foren.org

kostenloses-forum.com

list.php

lofiversion

modules.php

newbb

newbbs/ezboard.cgi

onlyfree.de/cgi-bin/forum/

phpbbx.de

plusboard.de

post.php

profile.php

showthread.php

siteboard.de

thread

topic

ubb

ultimatebb

unboard.de

webmart.de/f.cfm?id=

xtremeservers.at/board/

yooco.de

inurl:forum

inurl:phorum

inurl:add topic

inurl:new topic

inurl:phpbb

inurl:yabb

inurl:ipb

inurl:posting

inurl:add message

inurl:send message

inurl:post new topic

inurl:new thread

inurl:send thread

inurl:vbulletin

inurl:bbs

inurl: "powered by vbulletin"

inurl: "powered by yabb"

inurl: "powered by ip.board"

inurl: "powered by phpbb"

inurl: vbulletin

inurl: yabb

inurl: ip.board

inurl: phpbb

inurl:/board

inurl:/board/

inurl:/foren/

inurl:/forum/

inurl:/forum/?fnr=

inurl:/forums/

inurl:/sutra

inurl:act=reg

inurl:act=sf

inurl:act=st

inurl:bbs/ezboard.cgi

inurl:bbs1/ezboard.cgi

inurl:board

inurl:board-4you.de

inurl:board/ezboard.cgi

inurl:boardbook.de

inurl:bulletin

inurl:cgi-bin/ezboard.cgi

inurl:communityhost.de

inurl:exbb

inurl:ez2000/ezboard.cgi

inurl:ezboard

inurl:ezboard.cgi

inurl:foren-city.de

inurl:foro/

inurl:forum-extra.de

inurl:forum-gratis.com

inurl:forum.

inurl:forum.cgi?

inurl:forum.onetwomax.de

inurl:forumieren.de

inurl:forumprofi.de

inurl:forumromanum.de

inurl:forumservice.de

inurl:free-webmaster-service.de

inurl:gratis-forum.de

inurl:gratis-forum.de/

inurl:homepage-forum.de

inurl:homepagemodules.de

inurl:inet-forum.de

inurl:invision

inurl:kostenlose-foren.org

inurl:kostenloses-forum.com

inurl:list.php

inurl:lofiversion

inurl:modules.php

inurl:newbb

inurl:newbbs/ezboard.cgi

inurl:onlyfree.de/cgi-bin/forum/

inurl:phpbbx.de

inurl:plusboard.de

inurl:post.php

inurl:profile.php

inurl:showthread.php

inurl:siteboard.de

inurl:thread

inurl:topic

inurl:ubb

inurl:ultimatebb

inurl:unboard.de

inurl:webmart.de/f.cfm?id=

inurl:xtremeservers.at/board/

inurl:yooco.de

link:forum

link:phorum

link:add topic

link:new topic

link:phpbb

link:yabb

link:ipb

link:posting

link:add message

link:send message

link:post new topic

link:new thread

link:send thread

link:vbulletin

link:bbs

link:intext:"powered by vbulletin"

link:intext:"powered by yabb"

link:intext:"powered by ip.board"

link:intext:"powered by phpbb"

link:inanchor:vbulletin

link:inanchor:yabb

link:inanchor:ip.board

link:inanchor:phpbb

link:/board

link:/board/

link:/foren/

link:/forum/

link:/forum/?fnr=

link:/forums/

link:/sutra

link:act=reg

link:act=sf

link:act=st

link:bbs/ezboard.cgi

link:bbs1/ezboard.cgi

link:board

link:board-4you.de

link:board/ezboard.cgi

link:boardbook.de

link:bulletin

link:cgi-bin/ezboard.cgi

link:communityhost.de

link:exbb

link:ez2000/ezboard.cgi

link:ezboard

link:ezboard.cgi

link:foren-city.de

link:foro/

link:forum-extra.de

link:forum-gratis.com

link:forum.

link:forum.cgi?

link:forum.onetwomax.de

link:forumieren.de

link:forumprofi.de

link:forumromanum.de

link:forumservice.de

link:free-webmaster-service.de

link:gratis-forum.de

link:gratis-forum.de/

link:homepage-forum.de

link:homepagemodules.de

link:inet-forum.de

link:invision

link:kostenlose-foren.org

link:kostenloses-forum.com

link:list.php

link:lofiversion

link:modules.php

link:newbb

link:newbbs/ezboard.cgi

link:onlyfree.de/cgi-bin/forum/

link:phpbbx.de

link:plusboard.de

link:post.php

link:profile.php

link:showthread.php

link:siteboard.de

link:thread

link:topic

link:ubb

link:ultimatebb

link:unboard.de

link:webmart.de/f.cfm?id=

link:xtremeservers.at/board/

link:yooco.de

index.cgi

action=display&thread

index.php

index.php?fid

index.php?mid

index.php?act=

user_profile.php

messages.php?webtag

post.php?webtag

pm.php

beehive

/discussion/

/comment/reply/

cgi-bin/forum/

/cgi-bin/forum/blah.pl

"powered by e-blah forum software"

"powered by xmb"

/forumdisplay.php?

/misc.php?action=

member.php?action=

"powered by: fudforum"

index.php?t=usrinfo

/index.php?t=thread

/index.php?t=

index.php?t=post&frm_id=

"powered by fluxbb"

/profile.php?id=

viewforum.php?id

login.php

register.php

profile.forum?

posting.forum&mode=newtopic

post.forum?mode=reply

"powered by icebb"

index.php?s=

act=login&func=register

act=post&forum=19

forums/show/

module=posts&action=insert&forum_id

posts/list

/user/profile/

/posts/reply/

new_topic.jbb?

"powered by javabb 0.99"

login.jbb

new_member.jbb

reply.jbb

/cgi-bin/forum/

cgi-bin/forum.cgi

/registermember

listforums?

"forum mesdiscussions.net

version"

index.php?action=vtopic

"powered by forum software minibb"

index.php?action=registernew

member.php?action=register

forumdisplay.php

newthread.php?

newreply.php?

/phorum/

phorum/list.php

"this forum is powered by phorum"

phorum/posting.php

phorum/register.php

phpbb/viewforum.php?

/phpbb/

phpbb/profile.php?mode=register

phpbb/posting.php?mode=newtopic

phpbb/posting.php?mode=reply

/phpbb3/

phpbb3/ucp.php?mode=register

phpbb3/posting.php?mode=post

phpbb3/posting.php?mode=reply

/punbb/

punbb/register.php

"powered by phpbb"

"powered by punbb"

/quicksilver/

"powered by quicksilver forums"

index.php?a=forum

index.php?a=register

index.php?a=post&s=topic

/seoboard/

"powered by seo-board"

seoboard/index.php?a=vforum

index.php?a=vtopic

/index.php?a=register

"powered by smf 1.1.5"

"index.php?action=register"

/index.php?board

"powered by ubb.threads"

ubb=postlist

ubb=newpost&board=1

"ultrabb"

view_forum.php?id

new_topic.php?

login.php?register=1

"powered by vbulletin"

vbulletin/register.php

/forumdisplay.php?f=

newreply.php?do=newreply

newthread.php?do=newthread

"powered by bbpress"

bbpress/topic.php?id

bbpress/register.php

"powered by the unclassified newsboard"

forum.php?req

forum.php?req=register

/unb/

"powered by usebb forum software"

/usebb/

topic.php?id

panel.php?act=register

"a product of lussumo"

comments.php?discussionid=

/viscacha/

forum.php?s=

"powered by viscacha"

/viscacha/register.php

/post?id=

post/printadd?forum

community/index.php

community/forum.php?

community/register.php

"powered by xennobb"

"hosted for free by zetaboards"

"powered by yaf"

yaf_rules.aspx

yaf_topics

postmessage.aspx

register.aspx

post/?type

inurl:action=display&thread

inurl:index.php

inurl:index.php?fid

inurl:index.php?mid

inurl:index.php?act=

inurl:user_profile.php

inurl:messages.php?webtag

inurl:post.php?webtag

inurl:pm.php

inurl:beehive

inurl:/discussion/

inurl:/comment/reply/

inurl:cgi-bin/forum/

inurl:/cgi-bin/forum/blah.pl

inurl:"powered by e-blah forum software"

inurl:"powered by xmb"

inurl:/forumdisplay.php?

inurl:/misc.php?action=

inurl:member.php?action=

inurl:"powered by: fudforum"

inurl:index.php?t=usrinfo

inurl:/index.php?t=thread

inurl:/index.php?t=

inurl:index.php?t=post&frm_id=

inurl:"powered by fluxbb"

inurl:/profile.php?id=

inurl:viewforum.php?id

inurl:login.php

inurl:register.php

inurl:profile.forum?

inurl:posting.forum&mode=newtopic

inurl:post.forum?mode=reply

inurl:"powered by icebb"

inurl:index.php?s=

inurl:act=login&func=register

inurl:act=post&forum=19

inurl:forums/show/

inurl:module=posts&action=insert&forum_id

inurl:posts/list

inurl:/user/profile/

inurl:/posts/reply/

inurl:new_topic.jbb?

inurl:"powered by javabb 0.99"

inurl:login.jbb

inurl:new_member.jbb

inurl:reply.jbb

inurl:/cgi-bin/forum/

inurl:cgi-bin/forum.cgi

inurl:/registermember

inurl:listforums?

inurl:"forum mesdiscussions.net

inurl:index.php?action=vtopic

inurl:"powered by forum software minibb"

inurl:index.php?action=registernew

inurl:member.php?action=register

inurl:forumdisplay.php

inurl:newthread.php?

inurl:newreply.php?

inurl:/phorum/

inurl:phorum/list.php

inurl:"this forum is powered by phorum"

inurl:phorum/posting.php

inurl:phorum/register.php

inurl:phpbb/viewforum.php?

inurl:/phpbb/

inurl:phpbb/profile.php?mode=register

inurl:phpbb/posting.php?mode=newtopic

inurl:phpbb/posting.php?mode=reply

inurl:/phpbb3/

inurl:phpbb3/ucp.php?mode=register

inurl:phpbb3/posting.php?mode=post

inurl:phpbb3/posting.php?mode=reply

inurl:/punbb/

inurl:punbb/register.php

inurl:"powered by phpbb"

inurl:"powered by punbb"

inurl:/quicksilver/

inurl:"powered by quicksilver forums"

inurl:index.php?a=forum

inurl:index.php?a=register

inurl:index.php?a=post&s=topic

inurl:/seoboard/

inurl:"powered by seo-board"

inurl:seoboard/index.php?a=vforum

inurl:index.php?a=vtopic

inurl:/index.php?a=register

inurl:"powered by smf 1.1.5"

inurl:"index.php?action=register"

inurl:/index.php?board

inurl:"powered by ubb.threads"

inurl:ubb=postlist

inurl:ubb=newpost&board=1

inurl:"ultrabb"

inurl:view_forum.php?id

inurl:new_topic.php?

inurl:login.php?register=1

inurl:"powered by vbulletin"

inurl:vbulletin/register.php

inurl:/forumdisplay.php?f=

inurl:newreply.php?do=newreply

inurl:newthread.php?do=newthread

inurl:"powered by bbpress"

inurl:bbpress/topic.php?id

inurl:bbpress/register.php

inurl:"powered by the unclassified newsboard"

inurl:forum.php?req

inurl:forum.php?req=register

inurl:/unb/

inurl:"powered by usebb forum software"

inurl:/usebb/

inurl:topic.php?id

inurl:panel.php?act=register

inurl:"a product of lussumo"

inurl:comments.php?discussionid=

inurl:/viscacha/

inurl:forum.php?s=

inurl:"powered by viscacha"

inurl:/viscacha/register.php

inurl:/post?id=

inurl:post/printadd?forum

inurl:community/index.php

inurl:community/forum.php?

inurl:community/register.php

inurl:"powered by xennobb"

inurl:"hosted for free by zetaboards"

inurl:"powered by yaf"

inurl:yaf_rules.aspx

inurl:yaf_topics

inurl:postmessage.aspx

inurl:register.aspx

inurl:post/?type

link:action=display&thread

link:index.php

link:index.php?fid

link:index.php?mid

link:index.php?act=

link:user_profile.php

link:messages.php?webtag

link:post.php?webtag

link:pm.php

link:beehive

link:/discussion/

link:/comment/reply/

link:cgi-bin/forum/

link:/cgi-bin/forum/blah.pl

link:"powered by e-blah forum software"

link:"powered by xmb"

link:/forumdisplay.php?

link:/misc.php?action=

link:member.php?action=

link:"powered by: fudforum"

link:index.php?t=usrinfo

link:/index.php?t=thread

link:/index.php?t=

link:index.php?t=post&frm_id=

link:"powered by fluxbb"

link:/profile.php?id=

link:viewforum.php?id

link:login.php

link:register.php

link:profile.forum?

link:posting.forum&mode=newtopic

link:post.forum?mode=reply

link:"powered by icebb"

link:index.php?s=

link:act=login&func=register

link:act=post&forum=19

link:forums/show/

link:module=posts&action=insert&forum_id

link:posts/list

link:/user/profile/

link:/posts/reply/

link:new_topic.jbb?

link:"powered by javabb 0.99"

link:login.jbb

link:new_member.jbb

link:reply.jbb

link:/cgi-bin/forum/

link:cgi-bin/forum.cgi

link:/registermember

link:listforums?

link:"forum mesdiscussions.net

link:index.php?action=vtopic

link:"powered by forum software minibb"

link:index.php?action=registernew

link:member.php?action=register

link:forumdisplay.php

link:newthread.php?

link:newreply.php?

link:/phorum/

link:phorum/list.php

link:"this forum is powered by phorum"

link:phorum/posting.php

link:phorum/register.php

link:phpbb/viewforum.php?

link:/phpbb/

link:phpbb/profile.php?mode=register

link:phpbb/posting.php?mode=newtopic

link:phpbb/posting.php?mode=reply

link:/phpbb3/

link:phpbb3/ucp.php?mode=register

link:phpbb3/posting.php?mode=post

link:phpbb3/posting.php?mode=reply

link:/punbb/

link:punbb/register.php

link:"powered by phpbb"

link:"powered by punbb"

link:/quicksilver/

link:"powered by quicksilver forums"

link:index.php?a=forum

link:index.php?a=register

link:index.php?a=post&s=topic

link:/seoboard/

link:"powered by seo-board"

link:seoboard/index.php?a=vforum

link:index.php?a=vtopic

link:/index.php?a=register

link:"powered by smf 1.1.5"

link:"index.php?action=register"

link:/index.php?board

link:"powered by ubb.threads"

link:ubb=postlist

link:ubb=newpost&board=1

link:"ultrabb"

link:view_forum.php?id

link:new_topic.php?

link:login.php?register=1

link:"powered by vbulletin"

link:vbulletin/register.php

link:/forumdisplay.php?f=

link:newreply.php?do=newreply

link:newthread.php?do=newthread

link:"powered by bbpress"

link:bbpress/topic.php?id

link:bbpress/register.php

link:"powered by the unclassified newsboard"

link:forum.php?req

link:forum.php?req=register

link:/unb/

link:"powered by usebb forum software"

link:/usebb/

link:topic.php?id

link:panel.php?act=register

link:"a product of lussumo"

link:comments.php?discussionid=

link:/viscacha/

link:forum.php?s=

link:"powered by viscacha"

link:/viscacha/register.php

link:/post?id=

link:post/printadd?forum

link:community/index.php

link:community/forum.php?

link:community/register.php

link:"powered by xennobb"

link:"hosted for free by zetaboards"

link:"powered by yaf"

link:yaf_rules.aspx

link:yaf_topics

link:postmessage.aspx

link:register.aspx

link:post/?type

i też nic ;/ WTF ?

[yokokeke]

ezomaniak: zbieranka z neta. Jest kilka list, najlepiej napisz sobie bota ktory Ci je sparsuje .

[szfab]

inurl - tym footem w moment zarżniesz prywatne proxy.

Publiczne ok bo darmowe, ale przy 50 prywatnych mysle ze dokladniej objedziesz slowa.

[Rademenes]

@szfab, proponujesz inne metody keywordsów poza inurl ?

[mental]

Do tej pory na publicznych proxy sharvestowałem dziesiątki milionów adresów. Nie ma z nimi najmniejszego problemu. Nawet działają te ze Scrapeboxa.

Z publicznych ciezko cokolwiek wyharvestowac.

Jesli masz prywatne proxy (parenascie sztuk), wrzuc je do pliku. W hreferze ustaw zeby nie odswiezal.

Ilosc watkow <= liczba proxy.

Powinno dzialac.

[początkujący]

Bootmaster udostępnił hrefera 4.1. Ktoś już korzystał? Bo ja niestety nie miałem czasu sprawdzić, czy warto do tego wrócić po zmianach.... zapowiedzi były, ale rzeczywistość czasami idzie innymi drogami

Suma summarum: ktoś już ma jakieś spostrzeżenia?

[MaxPan]

jest jak najbardziej OK, parsuje Mail.com , ( clon Google) i lamie jego captcha mozna parswoac dowolnego "kolna", sporo zmian w samym algo wiele rzeczy uproszczonych w domyślnych ustawianiach zmienione algo dla Google, Googlemobile, ogólnie długo oczekiwany update w ru wyszedł trocha wcześniej i inny bullid ale ENG chyba to same . Jest to przedsmak dużego update samego XR.

[Katharsis]

Harwsetuje lepiej niż sb, utm. Szybciej zbiera proxy niż xpcp, ogólnie jest dobry. Nie trzeba harvestować goolga aby mieć 200 tys unik w ciągu doby

[początkujący]

cóż... z Waszą namową wróciłem do hrefera, przetestowałem i mogę polecić. Znów działa sympatycznie i wyciąga to, czego potrzebuję