Get Notified when quoted - on forum feature

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: Quickseller on April 20, 2021, 08:32:15 AM

If your code is structured in a way such that each function does a single task

That's a very big if Tongue

It's not

I usually copy/paste/edit something into something else. A modular approach (with a database!) from the start would have been much better, but it's slightly late for that now.

Quote from: Quickseller on April 21, 2021, 09:18:45 PM

The API allows someone to query posts by user and by thread.

An API instead of "manually" checking HTML would make my life easier again

DdmrDdmr

legendary

Activity: 2338

Merit: 10802

There are lies, damned lies and statistics. MTwain

Quote from: ChuckBuck on April 22, 2021, 12:11:53 AM

<…> will all the data on this forum be stored and used on the new forum? And more importantly, the current domain?

When you migrate a DB from one environment to another, the objective is normally to preserve all the historical data. There may be issues with some of the datatypes stored, or the actual exploitation of that data through the new interface, but generally, especially of the software is custom tailored software, one will be aiming at keeping it all. The domain should remain in place, unless someone decides to simply use it to redirect to a new branding domain.

Quote from: Quickseller on April 21, 2021, 09:18:45 PM

<…>

I hadn’t bothered to look for the API before, and It should probably be accompanied with an explanation on how identifiers are created/interpreted to get a clearer picture. The API’s documentation is from 2016 (last update), so I wonder just how up-to-date it is with all the evolutionary changed made since then.

ChuckBuck

hero member

Activity: 1372

Merit: 783

better everyday ♥

Quote from: LoyceV on April 20, 2021, 05:37:21 AM

Me too, I'd hate to see all user-scripts (my own and from other users) broken because of a forum upgrade. If would probably take me months to update everything, and I'd probably abandon several of my old projects.

All of your scripts are useful, it may take a long time for you, but I'm sure you will get a lot of help if you speak up on this forum. Your idea is there and updating will be easier, right?

Quote from: Quickseller on April 21, 2021, 09:35:03 PM

That is surprising. I guess that means those who want to avoid using JS will have to use the API, or a framework that leverages the API.

I am quite surprised that most of you have knowledge of this field.

I just have a dumb question, will all the data on this forum be stored and used on the new forum? And more importantly, the current domain?

Quickseller

copper member

Activity: 2996

Merit: 2374

Quote from: suchmoon on April 21, 2021, 09:32:03 PM

Quote from: Quickseller on April 21, 2021, 09:18:45 PM

I haven't looked at the new forum software in depth, but I can assure you that it does not use JS based frameworks on the front end. The new forum software ultimately will have a div that displays the post content, just as the current SMF forum software does.

False. It does not render shit without client-side JS.

That is surprising. I guess that means those who want to avoid using JS will have to use the API, or a framework that leverages the API.

suchmoon

legendary

Activity: 3654

Merit: 8909

https://bpip.org

Quote from: Quickseller on April 21, 2021, 09:18:45 PM

I haven't looked at the new forum software in depth, but I can assure you that it does not use JS based frameworks on the front end. The new forum software ultimately will have a div that displays the post content, just as the current SMF forum software does.

False. It does not render shit without client-side JS.

Quickseller

copper member

Activity: 2996

Merit: 2374

Quote from: NotATether on April 21, 2021, 04:50:03 AM

Quote from: Quickseller on April 20, 2021, 08:32:15 AM

Quote from: LoyceV on April 20, 2021, 05:37:21 AM

Quote from: hilariousandco on April 20, 2021, 05:20:31 AM

I kinda like this board as dated as it is. Change is always jarring when you've been used to something for so long.

Me too, I'd hate to see all user-scripts (my own and from other users) broken because of a forum upgrade. If would probably take me months to update everything, and I'd probably abandon several of my old projects.

If all the IDs in the HTML remain constant, moving to the new forum software shouldn’t break most scrapers.

If your code is structured in a way such that each function does a single task, it shouldn’t be terribly difficult to update scripts based on the new forum software.

Except new forum software rarely keeps IDs constant because each forum engine has a completely different way of rendering things.

Imagine if this forum moves to some JavaScript based framework like Invision, where the pages and content is loaded dynamically. Then we (yes we, I also have scripts) have to somehow patch our scripts to call the JS functions that return the items we want to scrape and it's too much legwork when all you had to do before was search for HTML tags.

I haven't looked at the new forum software in depth, but I can assure you that it does not use JS based frameworks on the front end. The new forum software ultimately will have a div that displays the post content, just as the current SMF forum software does.

Quote from: DdmrDdmr on April 21, 2021, 08:58:47 AM

I know there are a set of intended APIs for those that want to retrieve information from the site. Wondering if that will be the mandatory path, as opposed to scraping, due to things as the above.

The API allows someone to query posts by user and by thread. The API documentation is somewhat confusing, but it appears both the username and thread are strings, as opposed to both being ints currently. I haven't looked deeply at the code to see how a thread ID is created.

DdmrDdmr

legendary

Activity: 2338

Merit: 10802

There are lies, damned lies and statistics. MTwain

Quote from: NotATether on April 21, 2021, 04:50:03 AM

<...>

I don’t know if these things still stand, as last time I took a quick-peak into it was a couple of years ago, but at the time, at least on Cryptos-Currencies test site, I seemed to encounter the following:

Quote from: DdmrDdmr on March 01, 2019, 04:59:59 AM

<…> In addition, without it being bug related:

- Since profiles are not by ID but by username, a priori, you cannot create a process to download say all forum profiles, amongst other things. It could also bring on some difficulties related to mapped character tables on those names with “weird” characters in them.

- To gain access to the content of all posts from his history, you need to click each thread header from the list. Scraper can do that conceptually, but it may deem a complication.

- PostId is a weird looking string, but the current one was not much use either if you wanted to retrieve all posts from a thread for example. You still need to scrape the hard way instead of through a correlative set of IDs.

I know there are a set of intended APIs for those that want to retrieve information from the site. Wondering if that will be the mandatory path, as opposed to scraping, due to things as the above.

NotATether

legendary

Activity: 1568

Merit: 6660

bitcoincleanup.com / bitmixlist.org

Quote from: Quickseller on April 20, 2021, 08:32:15 AM

Quote from: LoyceV on April 20, 2021, 05:37:21 AM

Quote from: hilariousandco on April 20, 2021, 05:20:31 AM

I kinda like this board as dated as it is. Change is always jarring when you've been used to something for so long.

Me too, I'd hate to see all user-scripts (my own and from other users) broken because of a forum upgrade. If would probably take me months to update everything, and I'd probably abandon several of my old projects.

If all the IDs in the HTML remain constant, moving to the new forum software shouldn’t break most scrapers.

If your code is structured in a way such that each function does a single task, it shouldn’t be terribly difficult to update scripts based on the new forum software.

Except new forum software rarely keeps IDs constant because each forum engine has a completely different way of rendering things.

Imagine if this forum moves to some JavaScript based framework like Invision, where the pages and content is loaded dynamically. Then we (yes we, I also have scripts) have to somehow patch our scripts to call the JS functions that return the items we want to scrape and it's too much legwork when all you had to do before was search for HTML tags.

Quickseller

copper member

Activity: 2996

Merit: 2374

Quote from: LoyceV on April 20, 2021, 05:37:21 AM

Quote from: hilariousandco on April 20, 2021, 05:20:31 AM

I kinda like this board as dated as it is. Change is always jarring when you've been used to something for so long.

Me too, I'd hate to see all user-scripts (my own and from other users) broken because of a forum upgrade. If would probably take me months to update everything, and I'd probably abandon several of my old projects.

If all the IDs in the HTML remain constant, moving to the new forum software shouldn’t break most scrapers.

If your code is structured in a way such that each function does a single task, it shouldn’t be terribly difficult to update scripts based on the new forum software.

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: hilariousandco on April 20, 2021, 05:20:31 AM

I kinda like this board as dated as it is. Change is always jarring when you've been used to something for so long.

Me too, I'd hate to see all user-scripts (my own and from other users) broken because of a forum upgrade. If would probably take me months to update everything, and I'd probably abandon several of my old projects.

hilariousandco

global moderator

Activity: 3990

Merit: 2717

Join the world-leading crypto sportsbook NOW!

Quote from: Poker Player on April 17, 2021, 08:39:10 AM

Quote from: hilariousandco on April 17, 2021, 06:10:17 AM

Yeah, it would be helpful, though I believe it was one of the features being worked on for the new forum software.

Any idea when the new software will be implemented? I don't go almost for that section but I see that the threads there started 7 years ago.

It's not that I'm too expectant about the new software either as some things could be improved, like what is talked about in this thread, but I've seen software changes in other forums that I didn't like.

Nope. I have no idea what stage it's at but I'm sure theymos is busy working on it. I guess it's been a bit of a running joke that it's 'coming soon' though haha. Probably not a good idea releasing it until it's watertight though. To be honest, I kinda like this board as dated as it is. Change is always jarring when you've been used to something for so long.

Pmalek

legendary

Activity: 2730

Merit: 7065

I signed up for it yesterday to see how it works. I am just glad I don't have to mess with Telegram just to get notified when someone quotes or mentions me on the forum.

Quote

I'm satisfied, because it also show notification when my username is mentioned. However, it doesn't work if the poster intentionally remove xxx from the quote.

You mean a manual quote like the one above without pressing the quote button? I removed your name from the quoted text to not trigger the scrapper. I assume a quote like that wont be picked up. Very few people quote posts like that, so I don't consider it an issue.

Quickseller

copper member

Activity: 2996

Merit: 2374

Quote from: Poker Player on April 17, 2021, 01:39:58 AM

Quote from: mediaBuzz on April 16, 2021, 04:07:32 PM

Wouldn't that be helpful?

Yes, I totally agree with that. Most forums have a similar system and I am surprised that this one does not have one. I'm surprised it's for a security issue as @Quickseller comments but I suppose there is some reason like that.

Anytime you introduce new functionality, there is the possibility it will be exploited. Years ago, the ability to upload an avatar was exploited and said exploit was used to hack the forum. There are many forum members who have the ability to and are willing to create user scripts that will give the functionality that forum users want, and these user scripts will not present the same potential security risks.

Quote from: mediaBuzz on April 17, 2021, 04:35:54 AM

Quote from: Quickseller on April 16, 2021, 09:40:38 PM

Implementing additional features directly on the forum means there is the potential for additional security risks.

Can't you afford high-end software security engineers when you hold hundreds of bitcoins :/

See my above comment.

LoyceV

legendary

Activity: 3290

Merit: 16489

Thick-Skinned Gang Leader and Golden Feather 2021

Quote from: Pmalek on April 18, 2021, 02:17:58 AM

Are you happy with how LoyceV's bot works?
Do all quotes and mentions get recorded or does it miss the occasional one or two?

I checked 10,000 posts yesterday, and I missed 1 (0.01%). I'm troubleshooting

dkbit98

legendary

Activity: 2212

Merit: 7064

I don't think anyone will work on this old forum software with making any changes like notifications and alerts, but we may see this in new Epochtalk forum if it ever comes out.

Meanwhile you can use only one telegram bot for all notifications Yet Another BitcoinTalk Notification BOT, made by TryNinja, and you will get all notifications about mentions, merits, topics, etc.
@BTTSuperNotifier_bot

Pmalek

legendary

Activity: 2730

Merit: 7065

Quote from: ?? on ??

For now, i use LoyceV's notification feature, [WORKING] LoyceV's alternative for Piggy's @mention notification bot.

Thanks for reminding me that I was planning on activating LoyceV's bot a long time ago but forgot to bookmark the thread so I forgot about it. I don't use Telegram and ever since Piggy's bot stopped working I have been without a notification service.

Are you happy with how LoyceV's bot works?
Do all quotes and mentions get recorded or does it miss the occasional one or two?

Poker Player

legendary

Activity: 1372

Merit: 2017

Quote from: mediaBuzz on April 17, 2021, 04:35:54 AM

Hopefully, Epoch talk will have it. I will go for LoyceV's creation in this case. Thanks for the feedbacks and suggestions ya'll.

Quote from: hilariousandco on April 17, 2021, 06:10:17 AM

Yeah, it would be helpful, though I believe it was one of the features being worked on for the new forum software.

Any idea when the new software will be implemented? I don't go almost for that section but I see that the threads there started 7 years ago.

It's not that I'm too expectant about the new software either as some things could be improved, like what is talked about in this thread, but I've seen software changes in other forums that I didn't like.

hilariousandco

global moderator

Activity: 3990

Merit: 2717

Join the world-leading crypto sportsbook NOW!

Yeah, it would be helpful, though I believe it was one of the features being worked on for the new forum software.

mediaBuzz

full member

Activity: 379

Merit: 168

Quote from: Quickseller on April 16, 2021, 09:40:38 PM

Implementing additional features directly on the forum means there is the potential for additional security risks.

Can't you afford high-end software security engineers when you hold hundreds of bitcoins :/

Quote from: ?? on ??

Yes, but it's more likely such feature will be implemented on epoch talk (the new forum). For now, i use LoyceV's notification feature, [WORKING] LoyceV's alternative for Piggy's @mention notification bot.

Hopefully, Epoch talk will have it. I will go for LoyceV's creation in this case. Thanks for the feedbacks and suggestions ya'll.

crwth

copper member

Activity: 2940

Merit: 1280

https://linktr.ee/crwthopia

This thread can be considered similar to yours so I'm mentioning it for you.

https://bitcointalksearch.org/topic/is-there-any-forum-based-mention-bot-around-5264374

Basically, the thread is about not using telegram anymore and the OP there resulted in using the LoyceV notification bot, which is ideal as well.
Maybe after every notification, use a bot to message you directly using a bot account in the forum or something? To let you see a Message.

Topic: Get Notified when quoted - on forum feature (Read 401 times)