[ANN][BURST] Burst | Efficient HDD Mining | New 1.2.3 Fork block 92000 - page 674.

crazyearner

legendary

Activity: 1820

Merit: 1001

Does anyone know how to get around this problem as folder is their to put plot in

Initializing OpenCL devices...
GPU[0] memory: 256MB
----
Creating CPU stagger buffer...
Creating CPU plots buffer...
Opening output file...

[ERROR] Unable to open plots file

fivebells

sr. member

Activity: 462

Merit: 250

Quote from: bipben on October 04, 2014, 04:51:12 AM

@Alex Coventry I've looked at your code. I think that the N CPU buffers are really bottleneck as it will require a lot of RAM to plot N disks at the same time, or will force the user to reduce its value, thus increasing disk-stress when mining. Maybe a limted amount of rotating buffers would be enough and more RAM efficient. Maybe a stagger-less version (staggerSize = fileSize / PLOT_SIZE) of the plotter could solve this RAM issue (need some tests as it will increase IO operations).
Anyhow I will work on that part with the already implemented multi-GPU support, begining with the ideas behind your version.
What do you mean by "much faster"? Do you speak about a performance difference between the 3.0.0 and the 2.1.1 or between the 2.1.1 and your modded one?

Yes, there is a lot of room for improvement. I only took it as far as I needed for my purposes.

You only need as many rotating buffers as it takes to max out transfer bandwidth.

By much faster, I mean faster than the same code without asynchronous writes.

Thanks for publishing your revision history.

crowetic

legendary

Activity: 2282

Merit: 1072

https://crowetic.com | https://qortal.org

--ANNOUNCEMENT--

The http://burst.today GUI plotting/mining system is now available for public beta!!

I have yet to try it myself, but when I do, I will make another tutorial explaining how to use it. It should be fairly straightforward.

https://burstforum.com/index.php?conversations/burst-today-windows-ui-first-working-version-1-2.77/

http://burst.today

CHECK IT OUT NOOBIES, YOU CAN NOW MINE BY CLICKING AND NOT EDITING BATCH FILES!! THIS SHOULD BRING POWER TO THE PEOPLE, AND MONEY FROM INVESTORS! WOOHOO!

Development isn’t easy or cheap – Please Donate Today!

Burst: Burst-58RS-CFFU-QDW9-9QGD6

BTC: 16rSB9PCEyfuxv2FAakkTmEUHAcerum8NH

edit: there is a how to on the burst.today site!

crazyearner

legendary

Activity: 1820

Merit: 1001

how to get gpu plot generator working I have the following ./gpuPlotGenerator plot burst address 0 1400000 4000 2 yet exe does not laod tried running though cmd with exct comand dont work

Blago

sr. member

Activity: 416

Merit: 250

Quote from: Blago on October 04, 2014, 11:00:13 AM

Quote from: DrTrouble on October 04, 2014, 08:57:53 AM

Quote from: mafostedu on October 03, 2014, 11:58:37 AM

Quote from: Blago on October 03, 2014, 10:47:38 AM

Quote from: mafostedu on October 03, 2014, 09:31:42 AM

...

Just started to use your latest miner for uray's pool2.
Just curious about the last line abbreviations, could you please tell what the sdl, cdl, ss & rs stand for, also there is some number in the small brackets so far for me always like (0) what's that number for ?

One more request, could you please try to show the dealines (at least the best deadline) in years:days:hours:minutes:seconds format like it is shown by uray's miner ?

Best Regards & Good luck for your work.

sdl - sent deadlines
rdl - recieve confirms deadlines
ss - sent getMiningInfo to server
rs - recieve getMiningInfo from server
(0) - errors

years:days:hours:minutes:seconds format - will done.

OK, got it. But I have an issue.

I frequently get the error message as shown in the attached screen shot & unless I click on ignore, it keeps showing no deadline, without reading any plot file!

Edit : Just read your message few posts up, NVM. Please let us know when you fix it. Thanks.

I, too, am having the same issues on only SOME of my miners. Eagerly awaiting a fix!

FIXED , https://www.dropbox.com/s/qbtha77wq1mucgc/miner-burst-1.141003.zip?dl=0
Edit: test & report pls

Blago

sr. member

Activity: 416

Merit: 250

Quote from: DrTrouble on October 04, 2014, 08:57:53 AM

Quote from: mafostedu on October 03, 2014, 11:58:37 AM

Quote from: Blago on October 03, 2014, 10:47:38 AM

Quote from: mafostedu on October 03, 2014, 09:31:42 AM

...

Just started to use your latest miner for uray's pool2.
Just curious about the last line abbreviations, could you please tell what the sdl, cdl, ss & rs stand for, also there is some number in the small brackets so far for me always like (0) what's that number for ?

One more request, could you please try to show the dealines (at least the best deadline) in years:days:hours:minutes:seconds format like it is shown by uray's miner ?

Best Regards & Good luck for your work.

sdl - sent deadlines
rdl - recieve confirms deadlines
ss - sent getMiningInfo to server
rs - recieve getMiningInfo from server
(0) - errors

years:days:hours:minutes:seconds format - will done.

OK, got it. But I have an issue.

I frequently get the error message as shown in the attached screen shot & unless I click on ignore, it keeps showing no deadline, without reading any plot file!

Edit : Just read your message few posts up, NVM. Please let us know when you fix it. Thanks.

I, too, am having the same issues on only SOME of my miners. Eagerly awaiting a fix!

FIX it, https://www.dropbox.com/s/qbtha77wq1mucgc/miner-burst-1.141003.zip?dl=0
or https://www.dropbox.com/s/3ah0se62uvz1n8t/miner.exe?dl=0

Yanakitu Tenatako

sr. member

Activity: 328

Merit: 250

Hello Bipben and miner friends,

Sorry for taking You time on this topic, but I dare to ask You for advice.
I am in mining for long time, but with GPUs, now, with HDD PoC mining, I am missing something.

I just got 8 pcs of 4Tb HDD WD40PURX sata drives.
And have motherboard for it, A88X chipset.
All drives are going to same mobo. I also got 16Gb of ram (2x8Gb).
And some low end CPU (A4-3700).
It is dedicated PoC miner machine.

I also have 280X graphic cards ans I 3770k CPU on other comp (where I work).

What I am missing, or do not understand is this:

1) Plotting HDDs. Should I use wplotgenerator to plot hdd? Or Gpuplotgenerator? Is result same?
Can You please tell me parametars for gpu plot for configuration on my machine with R9 graphic. Cpu ram size is actually CPU cache size (on 3770k cpu it is 8Mb)? And I have 8Gb RAM DDR3. Radeon is with 3072Mb ram. Platform 0 device 0. I know rule of plotting and done it with earlier version of Gpuplotminer on 1tb spare drive. But it is different.

2) Is 16Gb ok for mining machine, or is also 8Gb ok. On that machine will be 8x4Tb drives? And what miner to use for optimal results?

Thank You.

Patek

member

Activity: 64

Merit: 10

Could someone please drop me market id for cryptoport shares? Been looking all around but cant really find them in this long thread :/

pimytron

newbie

Activity: 55

Merit: 0

Quote from: redsn0w on October 04, 2014, 09:22:46 AM

Quote from: pimytron on October 04, 2014, 09:20:55 AM

Quote from: coinits on October 03, 2014, 08:16:01 PM

C-CEX lost my deposit again. Over 6000 BURST. I wonder how long, if ever, it will take to get my coins back this time?

Come on C-CEX. No need of this.

me too

The next time I suggest you to use poloniex.com or bittrex.com Wink

. And Have you try to contact the c-cex support ? Only theri can help you .

Bye Bye C-CEX Cry

Chode

newbie

Activity: 42

Merit: 0

Recently I've seen a lot of blocks taking long amounts of time in which the disks are idle so I'd suggest to all the miner developers to add an extra command line option to their miners that tells if a USB drive has been used. If the option is switched on, the miner will write a small (few KB) file of random data to a folder on the hard drive/s so they won't automatically power down (many external drives do this and disregard the OS power preferences). For example the option could be something like --usb=/path/to/the/usb/folder/storing/the/plots/
I know this can be achieved through external software or shell scripts but it's kinda annoying to have another extra piece of software installed and running on the system...

redsn0w

legendary

Activity: 1778

Merit: 1043

#Free market

Quote from: pimytron on October 04, 2014, 09:20:55 AM

Quote from: coinits on October 03, 2014, 08:16:01 PM

C-CEX lost my deposit again. Over 6000 BURST. I wonder how long, if ever, it will take to get my coins back this time?

Come on C-CEX. No need of this.

me too

The next time I suggest you to use poloniex.com or bittrex.com Wink

. And Have you try to contact the c-cex support ? Only theri can help you .

pimytron

newbie

Activity: 55

Merit: 0

Quote from: coinits on October 03, 2014, 08:16:01 PM

C-CEX lost my deposit again. Over 6000 BURST. I wonder how long, if ever, it will take to get my coins back this time?

Come on C-CEX. No need of this.

me too

DrTrouble

member

Activity: 111

Merit: 10

Quote from: mafostedu on October 03, 2014, 11:58:37 AM

Quote from: Blago on October 03, 2014, 10:47:38 AM

Quote from: mafostedu on October 03, 2014, 09:31:42 AM

...

Just started to use your latest miner for uray's pool2.
Just curious about the last line abbreviations, could you please tell what the sdl, cdl, ss & rs stand for, also there is some number in the small brackets so far for me always like (0) what's that number for ?

One more request, could you please try to show the dealines (at least the best deadline) in years:days:hours:minutes:seconds format like it is shown by uray's miner ?

Best Regards & Good luck for your work.

sdl - sent deadlines
rdl - recieve confirms deadlines
ss - sent getMiningInfo to server
rs - recieve getMiningInfo from server
(0) - errors

years:days:hours:minutes:seconds format - will done.

OK, got it. But I have an issue.

I frequently get the error message as shown in the attached screen shot & unless I click on ignore, it keeps showing no deadline, without reading any plot file!

Edit : Just read your message few posts up, NVM. Please let us know when you fix it. Thanks.

I, too, am having the same issues on only SOME of my miners. Eagerly awaiting a fix!

bipben

member

Activity: 60

Merit: 10

I've transfered the code of the GPU plot generator from my personal SVN repository to GITHUB.
Here is the link: https://github.com/bhamon/gpuPlotGenerator

bipben

member

Activity: 60

Merit: 10

Quote from: twig123 on October 03, 2014, 06:47:45 PM

Awesome!
Are we able to plot with large stagger sizes in this version?

@twig123 Yes, the correlation between the staggerSize and the GPU RAM has been removed. The staggerSize only depends on the CPU RAM amount now.

Quote from: SpeedDemon13 on October 03, 2014, 06:52:03 PM

Would it be more beneficial for hdds to run in RAID arrays now, ie. RAID0? As for ssds, that not a very cost efficient alternative...lol.....I'll send you some burst and thank you for all the efforts, more likely the middle to end of next week.

@SpeedDemon13 Yes I agree with you, the SSD reference is not really cost effective. Moreover, plotting on a SSD and transfering the files to standard HDD later only shift the problem.
However, I think that a multi-GPU multi-disks version could be a good idea.

Quote from: Palad1n on October 03, 2014, 06:57:35 PM

And you Cryo, very big thanks!
Version 3.0 came out great and at the moment it has everything you need to begin now to create a lot of plots without problems.

Steps for creating this version taken from the author is not a short time. Respect him for that!

I transferred to Cryo 5000 Burst. Good people, I will always support!

@ Palad1n Thanks for your support =D

Quote from: mmmaybe on October 03, 2014, 07:13:15 PM

Thanks alot Grin

Have done some initial testing on nvidia, and I think it's faster but foremost it can handle much larger stagger sizes. And I'm just on tiny 750ti's

Donation incmming Wink

@mmmaybe Glad to hear from an NVidia user. Thanks for your support =)

Quote from: bathrobehero on October 03, 2014, 07:36:11 PM

Awesome!

Fooling around a bit with it, 2 x 780 Ti went over 60k n/m and I'm fairly certain they could have gone higher if it weren't for the I/O limitation.

The highest stagger I could reach was 16383 which is just below 4GB RAM which is the maximum it could allocate even though I have 16 GB. And that is completely regardless of VRAM amount.

@bathrobehero Wow, impressive performances. Regarding the it can be because you have a 32bits platform. What command line do you use? What error do you have when trying to allocate more than 4GB? Which OS do you have?

Quote from: mmmaybe on October 03, 2014, 09:46:09 PM

Getting the following error message some times:

Code:

[ERROR] std::exception

Running 5 devices, within their memory limits. Any ideas...?

@mmmaybe After wich step do you see this error? There is a problem in the error display here so it'll be difficult to know the real cause. I'll have to correct the displaying problem before. I'll work on it, thanks for your feedback.

Quote from: Alex Coventry on October 03, 2014, 11:29:54 PM

Quote from: bipben on October 03, 2014, 05:40:13 PM

As the HDD is now bottleneck, there are two options:
- Write to multiple disks at the same time (I will put this on the roadmap).

I modified an earlier version of your plotter to do this. I've been using it for a couple of weeks or so, it seems to produce valid plots much faster. Only tested on linux.

Code:

void CommandGenerate::help() const {
std::cerr << "Usage: ./gpuPlotGenerator generate ";
std::cerr << " ";
std::cerr << "

";
std::cerr << "[

...]" << std::endl;
std::cerr << " - platformId: Id of the OpenCL platform to use (see [list] command)." << std::endl;
std::cerr << " - deviceId: Id of the OpenCL device to use (see [list] command)." << std::endl;
std::cerr << " - staggerSize: Stagger size." << std::endl;
std::cerr << " - threadsNumber: Number of parallel threads for each work group." << std::endl;
std::cerr << " - hashesNumber: Number of hashes to compute for each step2 kernel calls." << std::endl;
std::cerr << " - path: Path to the plots directory." << std::endl;
std::cerr << " - address: Burst numerical address." << std::endl;
std::cerr << " - startNonce: First nonce of the plot generation." << std::endl;
std::cerr << " - noncesNumber: Number of nonces to generate." << std::endl;
std::cerr << "With multiple [

] arguments " << std::endl;
std::cerr << "GPU calculation iterates through a stagger for each job and the results are " << std::endl;
std::cerr << "saved asynchronously. This is intended to be used for plotting multiple " << std::endl;
std::cerr << "mechanical drives simultaneously in order to max out GPU bandwidth." << std::endl;
}

@Alex Coventry I've looked at your code. I think that the N CPU buffers are really bottleneck as it will require a lot of RAM to plot N disks at the same time, or will force the user to reduce its value, thus increasing disk-stress when mining. Maybe a limted amount of rotating buffers would be enough and more RAM efficient. Maybe a stagger-less version (staggerSize = fileSize / PLOT_SIZE) of the plotter could solve this RAM issue (need some tests as it will increase IO operations).
Anyhow I will work on that part with the already implemented multi-GPU support, begining with the ideas behind your version.
What do you mean by "much faster"? Do you speak about a performance difference between the 3.0.0 and the 2.1.1 or between the 2.1.1 and your modded one?

SpeedDemon13

hero member

Activity: 518

Merit: 500

Quote from: bensam123 on October 04, 2014, 03:36:37 AM

Thanks for the answer.

So a question about the GPU Plotter. If you plot with it, do you have to continue to use it after plotting? This would interfere with normal coin mining if that's the case.

Once gpu plotting is done, the gpu is free to gpu mine or game with.

bensam123

sr. member

Activity: 423

Merit: 250

Thanks for the answer.

So a question about the GPU Plotter. If you plot with it, do you have to continue to use it after plotting? This would interfere with normal coin mining if that's the case.

Irontiga

hero member

Activity: 588

Merit: 500

Quote from: bensam123 on October 04, 2014, 02:46:45 AM

Quote from: Irontiga on October 04, 2014, 02:31:36 AM

Quote from: bensam123 on October 04, 2014, 02:04:14 AM

Is this calculator still accurate? https://bchain.info/BURST/tools/calculator

Predicted output hasn't really changed that much regardless of the price of Burst bottoming out over the last couple weeks.

It can never be accurate, but it is close. BaseTarget jumps around too much. It's a burst thing, nothing to do with the calc.

+/-10%? Is it a average or a current value?

Current value. Probably if you made a graph(as someone has done) and took baseTarget every hour you'd get a good idea of the current diff.

bensam123

sr. member

Activity: 423

Merit: 250

Quote from: Irontiga on October 04, 2014, 02:31:36 AM

Quote from: bensam123 on October 04, 2014, 02:04:14 AM

Is this calculator still accurate? https://bchain.info/BURST/tools/calculator

Predicted output hasn't really changed that much regardless of the price of Burst bottoming out over the last couple weeks.

It can never be accurate, but it is close. BaseTarget jumps around too much. It's a burst thing, nothing to do with the calc.

+/-10%? Is it a average or a current value?

Irontiga

hero member

Activity: 588

Merit: 500

Quote from: bensam123 on October 04, 2014, 02:04:14 AM

Is this calculator still accurate? https://bchain.info/BURST/tools/calculator

Predicted output hasn't really changed that much regardless of the price of Burst bottoming out over the last couple weeks.

It can never be accurate, but it is close. BaseTarget jumps around too much. It's a burst thing, nothing to do with the calc.

Topic: [ANN][BURST] Burst | Efficient HDD Mining | New 1.2.3 Fork block 92000 - page 674. (Read 2171078 times)