Pages:
Author

Topic: New web service: RSS feeds for topics and users' posts - page 2. (Read 205624 times)

legendary
Activity: 1498
Merit: 1000
Any chance you would release the source code on github?
donator
Activity: 1218
Merit: 1015
Oh fuck yeah! I'll be stalkin' like a boss, now!  Cool
newbie
Activity: 16
Merit: 0
Any guidelines on polling rates?

I have configured my reader to poll the feeds every 10 minutes. This means that the delay in the delivery of messages to my inbox does not exceed 20 minutes.

All the feeds are stored on the server as a static files and are served directly by web server, so performance issues are unlikely. If the service will gain in popularity, the distribution of the traffic across several servers will not be problematic.

V.
hero member
Activity: 784
Merit: 1000
0xFB0D8D1534241423
Any guidelines on polling rates?
newbie
Activity: 16
Merit: 0
This is single cron job. It is run every minute. It checks which channels have not been updated in the last 10 minutes and regenerates them. The script sends queries sequentially, never more than one at a time. It is a kind of a simple balancer.  It can be further improved in order not to update more than one or two channels at a time.

V.
hero member
Activity: 952
Merit: 1009
Is this a cron job per feed?

Or is one cron job for all of them at the same time and we will see the forums grind to a halt every ten minutes in the future?
newbie
Activity: 16
Merit: 0
= RSS feeds for topics and users' posts =

I would like to announce a new web service that allows you to watch topics and users' activities using an RSS reader.

== Quick guide ==

To subscribe to a specific topic, use following URL in RSS reader: http://100btc.pl/bitcointalk/rss/threads/TID, where TID is an ID of the topic. The ID can be found in url bar in the browser. For example, an URL for the topic "ASICMINER: Entering the Future of ASIC Mining by Inventing It" is https://bitcointalksearch.org/topic/asicminer-entering-the-future-of-asic-mining-by-inventing-it-99497 and its ID is 99497 (please note that ID of a topic always starts with a digit after "topic=" and ends with a digit before a dot). The RSS feed for this topic can be dowloaded from: http://100btc.pl/bitcointalk/rss/threads/99497.

Similary, to subscribe to posts from specific user, use following URL: http://100btc.pl/bitcointalk/rss/users/UID, where UID is an ID of the user. For example, profile of user 'friedcat' is available at https://bitcointalksearch.org/user/friedcat-49840 and his ID is 49840. The RSS feed for his posts is available at http://100btc.pl/bitcointalk/rss/users/49840.

== How the service works ==

Known feeds are updated every 10 minutes by cron job and are stored in site cache, so they can be served without interaction with bitcointalk.org server.

When a new topic is retrieved from the site for the first time, the service needs to check the topic existence and its title. To do that it sends a single request to the bitcointalk.org server. If everything is fine, empty feed is generated and is returned to the requestor. After that within a minute the newly generated feed is filled with a content and stored in cache.

==

This is an early version of the service. I am aware of a few things that should be done better. I will fix them in near future but first I would like to know what you think. Any comments and suggestions are welcome.

Just like donations (: 164iKDnK6Ri8HAGbtGMdhhs59FG1f4Vovz.

V.
Pages:
Jump to: