It will be impossible to scan all possible directories or pages on a website, you can only spider the linked pages.
Lets say the web server has an account only protected by a long URL:
www.dumbsite.com/accounts/3na83ajfoen
If you only want to check for just eight-letter-long URLs, it will take 36^8 = 2821109907456 web requests. At 1000 URL checks per second that will take you over 32000 years.
Also, going to URLs and then making the web admin failure public can land you in jail: http://appleinsider.com/articles/13/03/18/hacker-involved-in-att-ipad-3g-e-mail-breach-sentenced-to-41-months-in-jail
Topic: [BOUNTY] 0.05 BTC to crawl a onion URL (Read 1259 times)
Due to the onion nature of this i'd suspect illegal/questionable content, so I'll have to decline my previous half-offer.
Ok, so a lot of response, thanks everyone. Now battle to the death!! Ah main question to answer I need to know what the site consists of for pages like .onion/forum and .onion/ *****. Trying to find files being hosted on the server. .onion URL's are accessed through TOR please be some what familiar. Here is what I have found maybe it can help
http://uscyberlabs.com/blog/2012/07/12/osx-tor-web-crawler-project/
http://stackoverflow.com/questions/18050416/easiest-way-to-crawl-a-site-with-an-onion-domain
http://stackoverflow.com/questions/9237477/tor-web-crawler
I want a list of indexed links all to the same site. I don't care what kind of script it is, but I do prefer python as it's what I know. Thanks to all, and let the battle begin.
http://uscyberlabs.com/blog/2012/07/12/osx-tor-web-crawler-project/
http://stackoverflow.com/questions/18050416/easiest-way-to-crawl-a-site-with-an-onion-domain
http://stackoverflow.com/questions/9237477/tor-web-crawler
I want a list of indexed links all to the same site. I don't care what kind of script it is, but I do prefer python as it's what I know. Thanks to all, and let the battle begin.
Are you going to need random URLs never linked to inside the site? And would Java be acceptable?
Hey guys, I'm offering a bounty for anyone who is good with PHP as that seems about the way around this. I'm not familiar with PHP and from my searches it appears that's the best way.
I just need a list of the pages URL's. I.E. after the .onion/ I would like to think I'm a good member, but I need some help from someone. Send me a PM and I'll give you the onion address. Thanks in advanced for the help guys, seems you can't know everything these days.
The 0.05 bounty will be paid up for a good list, If this doesn't seem like a fair amount let me know as well.
I just need a list of the pages URL's. I.E. after the .onion/ I would like to think I'm a good member, but I need some help from someone. Send me a PM and I'll give you the onion address. Thanks in advanced for the help guys, seems you can't know everything these days.
The 0.05 bounty will be paid up for a good list, If this doesn't seem like a fair amount let me know as well.
Jump to: