Author

Topic: How can I download all posts from a user? (Read 720 times)

sr. member
Activity: 437
Merit: 260
balance
July 15, 2013, 10:13:34 AM
#7
I am familiar with the terms Python, XML, and web scraping, but I have not actually used any of them. Any suggestions on where to start?
http://stackoverflow.com/questions/2190502/screen-scraping-with-python
http://www.crummy.com/software/BeautifulSoup/
http://scrapy.org/
hero member
Activity: 576
Merit: 514
I am familiar with the terms Python, XML, and web scraping, but I have not actually used any of them. Any suggestions on where to start?
There's a difference between being familiar with the terms and being able to do it.
Basically your options are to either use this as a project to learn a bit about programming, or pay someone else to do it for you.
newbie
Activity: 37
Merit: 0
I am familiar with the terms Python, XML, and web scraping, but I have not actually used any of them. Any suggestions on where to start?
legendary
Activity: 1176
Merit: 1280
May Bitcoin be touched by his Noodly Appendage
https://bitcointalksearch.org/user/tradefortress-67058
   +
Python
   =
Done with less than 20 lines
hero member
Activity: 576
Merit: 514
I could write a scraper and store the posts in e.g. a XML file.

PM me if you're interested.
vip
Activity: 1316
Merit: 1043
👻
You'll need to web scrap. Shouldn't be too hard, you can probably get by with file_get_contents and splitting strings
newbie
Activity: 37
Merit: 0
I'm interested in a way to download all posts from a user (not me). This way, I would like to search one large document by date of post or by keywords.
Jump to: