Need to obtain statistics from forum (new members and new posts)

Alex_Sr

hero member

Activity: 840

Merit: 962

HOLD BITCOIN! Fiat - SCAM!

Quote from: 1719EBDIHEC on February 07, 2019, 11:41:56 AM

Hi!

I am writing a master's thesis on bitcoin price formulation, and I need to obtain statistics from Bitcointalk.org from July 1, 2015, to December 31, 2018. I can only find data up until end of November 2017. Anyone know where to access the data I need?
Help is highly appreciated!

Monthly statistics:

Statistics of user registrations on Bitcointalk 2017-2019

1719EBDIHEC

newbie

Activity: 5

Merit: 0

DdmrDdmr, thank you! Very helpful

I´ll might have to stick to only new members, but anyways, thank you so much!

DdmrDdmr

legendary

Activity: 2338

Merit: 10802

There are lies, damned lies and statistics. MTwain

Quote from: 1719EBDIHEC on February 07, 2019, 12:24:23 PM

<...>

I can help you out quickly with the number of registered users per day: https://docs.google.com/spreadsheets/d/1tZ2a_bSEkbh0Qk-_QfX2WEhc0huRxAsg5hXfGIjI8RA/edit?usp=sharing

The period of time goes from the 17/11/2009 until the 05/12/2018.

Note that:
-   Data for the 05/12/2018 may be partial (incomplete day).

-   Data is derived from @piggy’s complete profile scrape, referenced on this thread.

-   The above referenced profile scrape is the latest I’m aware of, so there is no available external data from 05/12/2018 related to the number of accounts created per day.

-   Many accounts that are created on a daily basis are bot accounts (or just for viewing certain stuff), and actually never get any activity under their belly. See Analysis - Bitcointalk Accounts – Date of Register vs Last Active per Rank for a more comprehensive description.

Retrieving posts per day is a pain in the backside, so I can’t help you with that on a daily granular scale. You could try a per month rough vision like I’ve done in the past, checking some stats on different snapshots on archieve.is or WayBackMachine (see for example Analysis – Merit per post per Section/Subsection).

Page Views would require the same technique as above (although I’ve never been bothered with it).

1719EBDIHEC

newbie

Activity: 5

Merit: 0

Ok, I must be doing something wrong:

Date     Time Post # # new posts
13.des   3:01 am   2561205
14.des   3:34 am   2581018   19813
15.des   3:20 am   2588638   7620
16.des   3:27 am   2595235   6597
17.des   2:46 am   2595701   466

According to the statistics here on bitcointalk.org, there were 40668 new posts on December 13, 2017.

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: 1719EBDIHEC on February 11, 2019, 10:15:00 AM

Where do I find the # for each post?

Copy the URL, your post for example:
https://bitcointalksearch.org/topic/m.4969278549692785
The bold part is the post number.

1719EBDIHEC

newbie

Activity: 5

Merit: 0

Thank you, LoyceV!
Where do I find the # for each post?

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: 1719EBDIHEC on February 07, 2019, 12:24:23 PM

I need the daily number of new posts

You can get a pretty good estimate by finding a post around the same time each day, and subtracting post numbers. It's easiest to find them by date if you look in one of the many altcoin ANN (spam) threads. Kinda like I did here.

Quote

and daily number of new members.

See Open scraped data of all the users - SQL Lite DB - 2.481.270 users

1719EBDIHEC

newbie

Activity: 5

Merit: 0

Specifically, I need the daily number of new posts, and daily number of new members. (If its possible to get page views as well, that would be ideal.) I have all that data from July 1, 2015 - November 31., 2017. So I need from December 1., 2017, to December 31., 2018.

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

What data are you looking for? New registrations can be counted by checking profiles, and total number of posts can be counted by checking when a certain post number was made.

1719EBDIHEC

newbie

Activity: 5

Merit: 0

Hi!

I am writing a master's thesis on bitcoin price formulation, and I need to obtain statistics from Bitcointalk.org from July 1, 2015, to December 31, 2018. I can only find data up until end of November 2017. Anyone know where to access the data I need?
Help is highly appreciated!

Topic: Need to obtain statistics from forum (new members and new posts) (Read 244 times)