Pages:
Author

Topic: Request @theymos: Can you show userIDs instead of user names in trust.txt.xz? (Read 534 times)

legendary
Activity: 1624
Merit: 2481
I think the option for both, as requested by jackg a year ago, would be the best solutions.

For my own personal scripts, the current format is ideal. But i see the reasoning behind ID's instead of usernames.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I think I pulled it off. I've converted trust.txt into trust.userIDs.txt. As far as I can tell, I covered all usernames it without any mistakes.

My request still stands, as it makes things much easier, but for now it works for me. I'll publish weekly updates through LoyceV's Trust list viewer.
legendary
Activity: 2310
Merit: 10758
There are lies, damned lies and statistics. MTwain
<…> Peraphs is better to use this db in here https://bitcointalksearch.org/topic/m.47728970 even if it's not guaranteed either the will be all the id available.
That’s kind of what I do. I start try to retrieve the profile id from the merited profiles I download, and default to your December 2018 DB for those unmerited.
 
This month I got something like 15 to 20 profiles I had to retrieve manually (using the search profile option), since they were created from December 2018 onwards. Retrieving a few manually is fine, but if many new profiles enter the scene, then retrieving the info for drawing the trust relations becomes a bit cumbersome. User Ids in the trust.txt file would improve retrieval options (better as a separate file as has been suggested on this thread).
hero member
Activity: 784
Merit: 1416

ya it's strange, i checked those names and they are not there, i am not sure how piggy retrieve his data , does bpip has any database similar to piggy's format?

The users in there are only those which ever sent or received any merit, so for trust purposes is not complete.

Peraphs is better to use this db in here https://bitcointalksearch.org/topic/m.47728970 even if it's not guaranteed either the will be all the id available.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
does bpip has any database similar to piggy's format?
No, I scraped the usernames one by one from BPIP.
legendary
Activity: 2170
Merit: 6279
be constructive or S.T.F.U
I checked 2 of the usernames that gave me a hard time:
https://bitcointalksearch.org/user/--131122
https://bitcointalksearch.org/user/sakura-249929
They're not in there. There are only a few that give me a hard time.

ya it's strange, i checked those names and they are not there, i am not sure how piggy retrieve his data , does bpip has any database similar to piggy's format?
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
you can download the .txt file with complete list here > https://file.io/HIZ47N
I checked 2 of the usernames that gave me a hard time:
https://bitcointalksearch.org/user/--131122
https://bitcointalksearch.org/user/sakura-249929
They're not in there. There are only a few that give me a hard time.

Quote
1- copy paste new users from piggys tools using "desc" order.( done once at every update you make)
2- copy paste the trust.txt data to the excel file.
Thanks for the work you put in, but I'm looking for a more permanent solution with less manual work. I'm trying a different approach now, if it works I'll post a weekly "trust_id.txt.xz" (thanks Coin-1 for the name).
legendary
Activity: 2170
Merit: 6279
be constructive or S.T.F.U
just send me a an excel or text file with all usrename and ids
Getting the userIDs with the usernames is the problem.


it's not, it's very simple, using piggy's tool > https://albertoit.github.io/Merit-Explorer-SQL/  ( last update according to piggy is last friday 1 feb 2019)

use this query

Code:
select username,userid from  userdata 
order by userid

if you wish to see the last userid first in case so that you will only copy the new users that you don't have , use this query

Code:
select username,userid from  userdata 
order by userid desc

hit execute.

copy all users and ids, paste them in an excel file( or wherever you want them to be) and you will get 2 rows , userid and username

to speed things up , i copied everything (ctrl + A) pasted it in a text file and simply removed everything above the tables. and i got something like this

Code:
UserId	UserName
3 satoshi
4 sirius
11 madhatter
13 SmokeTooMuch
24 dwdollar
26 NewLibertyStandard
29 giik
30 BitcoinFX
33 m0mchil
35 theymos
40 xc

you can download the .txt file with complete list here > https://file.io/HIZ47N

last user id  = 2528400



i'll upload an excel file a bit later which will parse the format to this

Code:
35t203
35t3420
35t4171

you will still have to do a bit of manual work every time you want to update it.

1- copy paste new users from piggys tools using "desc" order.( done once at every update you make)
2- copy paste the trust.txt data to the excel file.

not a perfect approach but something you can work with.
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
just send me a an excel or text file with all usrename and ids
Getting the userIDs with the usernames is the problem.
legendary
Activity: 2170
Merit: 6279
be constructive or S.T.F.U
this is pretty easy to parse  using Excel.




you just need the 2 rows for username and id (M,N)
copy-paste the data frum trust.txt to (I,J)
use the function below on any 2 columns you want and it will parse the results for you

Code:
=IF(ISERROR(INDEX($N$3:$N$100,MATCH(I3,$M$3:$M$100,0))),"",INDEX($N$3:$N$100,MATCH(I3,$M$3:$M$100,0)))

*you need to replace I with J for the trustee column.

of course i assume you know how to put these in a single column if needed and how to add whatever separators you want.



if you having a trouble with it, just send me a an excel or text file with all usrename and ids, i'l upload an excel file where you just need to import the trust.txt and everything else will be automated.
copper member
Activity: 2870
Merit: 2298
Your proposal is good as the current system makes it difficult to keep track of changes in the trust network when VIPs and mods change their display name.

On the other hand, only providing UIDs makes it very difficult for anyone to analyze the information without automated tools.

Maybe a good solution would be to map the name to the UID if the name appears on trust.txt.xz
legendary
Activity: 2450
Merit: 2190
My recent example, and the reason for creating this topic:

Your tool is useful. Since I regularly update TOP-200 the most trusted members DT1, DT2, DT3, I'm also voting for the requested suggestion. In this case, it will be much easier to parse the dump of the Marketplace Trust Network for machine processing.

But maybe some people will want to download the file "trust.txt.xz" and manually check the relationship in a human readable format, so there is no need to change the structure of this file. In my opinion, the Marketplace Trust Network should be published in two files: "trust.txt.xz" and, for example, "trust_id.txt.xz".
legendary
Activity: 3290
Merit: 16489
Thick-Skinned Gang Leader and Golden Feather 2021
I'm not a big fan of LoyceV's format without separators
I used "t" and "d" as separators, but anything else is fine too.

A csv file of
userid, username, userid, username
It's an improvement, but since usernames can have "weird characters", it's still not that easy to separate.

Can we not just have an area dedicated to this whole file
That is the reason why I ask this Wink Theymos' data dumps make it possible for users to create their own data analysis, which means less work for Admin.
My recent example, and the reason for creating this topic:
legendary
Activity: 2383
Merit: 1551
dogs are cute.
Rather why not change the whole format of the file?

It needs to be easy to parse. JSON, XML, CSV...

I'm not a big fan of LoyceV's format without separators, it would require pre-processing or custom parsing to load into tools that I use.
Can we not just have an area dedicated to this whole file, as in when we go to the trust page, we could see the table content of who trusts/distrusts who?

Won't it make things easier? Im a dumbhead, ignore me if I am too stupid to understand things.
copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
Rather why not change the whole format of the file?

It needs to be easy to parse. JSON, XML, CSV...

I'm not a big fan of LoyceV's format without separators, it would require pre-processing or custom parsing to load into tools that I use.

Pugman might be onto something though.

A csv file of
userid, username, userid, username,
Like what we have now but having both details in the one file...
legendary
Activity: 3654
Merit: 8909
https://bpip.org
Rather why not change the whole format of the file?

It needs to be easy to parse. JSON, XML, CSV...

I'm not a big fan of LoyceV's format without separators, it would require pre-processing or custom parsing to load into tools that I use.
legendary
Activity: 2383
Merit: 1551
dogs are cute.
Rather why not change the whole format of the file?

Maybe a proper constructed table like this maybe? .


|
User_ID
hero member
Activity: 1643
Merit: 683
LoyceV on the road. Or couch.
I think both is probably better than just using one...
That would be even better indeed.
copper member
Activity: 2856
Merit: 3071
https://bit.ly/387FXHi lightning theory
I think both is probably better than just using one...

Theyre both quite hefty to have to keep using forum queries to work out the usernames. I think it's done like that for a reason but I wouldn't personally be against having both, I'd be against changing it to just be a userid entirely however...
Pages:
Jump to:
© 2020, Bitcointalksearch.org