I'm uploading my first file to the SiaNet ( I guess that's what you could call it). The file is .7z file 725MB in size. So far I am at roughly 10 minutes and it is about 12% finished.
Is there any specific CPU type that can handle the erasure encoding better? I don't see Sia using anymore than 10-20% of my CPU and the drive IO doesn't appear to be maxed out. Mainly I'm just curious about what could be taking it so long.
I'm not complaining, just making some observations. I'm sure upload rates will improve as we move forward. Or maybe its just my old Pentium E5800 (Kubuntu 14.04)
It's mostly a network bottleneck. The erasure coding library is very fast, especially on 64bit systems. Uploading on the other hand... Sia currently uses 5x redundancy, which means you're uploading 3.6GB, something that will take several hours on most home connections.
Makes sense now, thank you.
I just assumed that the redundancy was done by the network, not all from the source location.
X = transferred amount per participant
SOURCE --> 1 (X)
SOURCE, 1 --> 2 (0.5X)
SOURCE, 1, 2 --> 3 (0.3X)
SOURCE, 1, 2, 3 --> 4 (0.25X)
SOURCE, 1, 2, 3, 4 --> 5 (0.2x)
Is it possible to use multi location uploads, just like the downloads are done from multiple locations to improve download rate? A shared upload would speed up the process for everyone involved, and reduce the uploaded by the host.
A few more questions & Comments UI vs 0.4.4
- When I uploaded this file I was never presented with an option to choose how much I wanted to pay, or for how long, is that normal?
- Were can I find the .sia file to share. The share button gives me the ASCII file information, but not the .sia file.
- Having the contract cost listed next to the file in the files tab could be useful. Right now I had to go into transactions and add up the 10 payments that I assume are part of the contract deal.
- Under the Files Tab it says 1458 S/GB (estimated), but under the Hosting tab is says the competitive price is 21.05 S/GB per month. Thats a pretty large estimate window on how much it could cost to store files.
Keep up the good work
It is possible to do uploads in parallel, but most of the time you home connection is the bottleneck anyway - parallel uploads wouldn't help at all. For downloads, your home connection is typically faster than the host connection (because they are uploading, and that's the slow part), so parallel downloads improve speed substantially.
For uploading files, we will be adding a feature soon that will allow you to set a maximum price. Other than setting a maximum price, you have no control over how much you are spending. The client will automatically pick the cheapest and most reliable hosts (the api will eventually support a wide range of customization, including manual host selection)
You can't currently get the .sia file from the GUI, only from the command line tools. I believe it's 'siac renter share [nickname] [filepath]', use the '-h' flag to verify.
For hosting you need to multiply by 5 because there's 5 redundancy. But yeah, not sure why it's 14x on top of that. The price estimation algorithms are unstable because the hosts all have dramatically different prices. (some are 1SC/GB/Mo, some are 99SC/GB/Mo). The most expensive hosts are ignored, but there are few enough cheap hosts that some expensive hosts still remain.
We will consider adding some way to view how much money has been spent on a file, but I don't think we'll be adding that feature this month. (maybe next month - there's just too much to do right now)