Pages:
Author

Topic: [PRE-ANN][ZEN][Pre-sale] Zennet: Decentralized Supercomputer - Official Thread - page 21. (Read 57076 times)

newbie
Activity: 28
Merit: 0
I was just wondering what are the security measures that would be set to prevent abuse? DDos attacks for example?

The provider will able to block (or limit) any network connections outside the publisher's box (we might block it by default to avoid such concerns). Providers may block data persistence as well. They will also be able to work with specific trusted publishers (such as a University). That's where the beauty lies - it's an open and free market. It's all up to participant's decisions and preferences, including the pricing.

As for security on the provider's PC itself, it all runs in a restricted VM and the publisher does not gain elevated access even inside the Docker box, not to mention elevated or non-elevated access to the VM containing the boxes, not to mention access to the OS running the VM.

If a client is looking for say 1000 computers worth of computational power, would the client and each "Seller" have to follow these steps:

Yes, each step is required for any single pair of publisher and provider, and this points to why we need a dedicated coin.

Do the 1000 computers form a cluster acting like one supercomputer?

Yes.

Let us tell something about supercomputers: the fastest one in the world does 33 Petaflops. Like 8000 AMD 280X GPU, which exist maybe in every average western city. They hired 1300 engineers to build this giant computer. And still, not every researcher gets instant access to it..
hero member
Activity: 952
Merit: 500
I was just wondering what are the security measures that would be set to prevent abuse? DDos attacks for example?

If a client is looking for say 1000 computers worth of computational power, would the client and each "Seller" have to follow these steps:
Quote


-Publisher Alice puts her announcement into the blockchain, that she's seeking a defined hardware capacity.
-Provider Bob polls the blockchain looking for announcements within his capacity. Seeing Alice's announcement, Bob connects to Alice's IP address.
-Alice and Bob challenge each others' keys – the key pair of their blockchain addresses – to verify each others' identity.
-Bob tells Alice what hardware he has available, the two negotiate a price, and after payment is made Bob creates a virtual machine that Alice accesses over SSH.

Do the 1000 computers form a cluster acting like one supercomputer?
hero member
Activity: 897
Merit: 1000
http://idni.org
if we had good internet connection at our homes
we could give up centralized hosting

it seems like most of the world isn't far from there in terms of internet connection speed
legendary
Activity: 924
Merit: 1000
can't wait to use my computers as a part of the cloud

if we had good internet connection at our homes
we could give up centralized hosting
hero member
Activity: 897
Merit: 1000
http://idni.org
legendary
Activity: 1106
Merit: 1026
Ah, thanks for the answers!

The numbers you used in your example ("rents 10k hosts") hint that this is about a much larger scale than I initially assumed.

The magical number of 6 confirmations has actually not all that much meaning in reality and is derived from the fact that a miner with 10 % hashing power has a chance of less than 0.1 % to double-spend a transaction with 6 confirmations, if I recall correctly. Anyway, this number was probably mentioned once and has been repeated since. Meni Rosenfeld wrote an interesting paper about this topic and came up with the conclusion that one should rather look at the transacted amounts in relation to the probability that a malicious party might attempt to double-spend a payment instead of sticking to some fixed numbers ("it's no gain to double-spend 20 BTC, if this comes at the cost of losing one block reward of 25 BTC").

A delay based on channel initialization is given at the very beginning, but can be hidden, if leaving clients are replaced early enough. Furthermore there might not be the need of closing a channel between honest parties right after the work contract ended at all, since both parties seem to benefit from a faster setup. At best a network with many nodes and many open channels is established over time. This of course doesn't imply each channel must be active, in the sense of transacting value.

This likely holds true for whatever underlying payment network is used and I think it's probably best to seperate as you already did: there is the service layer (Xennet) and a payment layer (XenCoin, Bitcoin, ...), as well as another layer for the applications (such as XenTube).

My main question sort of remains, but I can phrase it with different words now: do you want to focus on building another payment layer or a service? Do you intend to do both?


So 5 min are too much time. In addition, POW is pretty obsolete. It's also centralized, de-facto. I tend to find DPOS much better. What is your opinion?

Actually I'm not sure. I'm heavily biased in favor of Bitcoin, but I have a high level knowledge about other approaches and acknowledge the potenial of alternatives, still I feel like this is not enough to answer this question properly. One of the main difficulties I see in the whole context is that you can be certain that a system failed, once it failed, but you can only guess that it won't fail in the future, based on assumptions derived from the information that is available at the very moment. Calling POW obsolete seems a bit premature, given it's track record of more than 5 years and a pretty solid understanding that has been established during this time. Simply put, it works. And without a doubt I consider Bitcoin as the most solid basis to build upon.

A different topic however is the context and which properties you need or consider as valuable, whether that is network security, transaction cost, block confirmation delay, the user base, ...
hero member
Activity: 897
Merit: 1000
http://idni.org
If the "usual work" done in HPC environments has similar properties, then I see a golden future. If this is not the case and if results may not even be verifiable at all, then this could be a significant problem.

Some more words about it: as mentioned, risk can be controlled. Also verifications can take place, when verifiable algorithms are in question. Many of the common algorithms are efficiently verifiable, such as root finding, matrix inversion, eigenvalue problems, all NP-Complete problems and so on, all cover many many applications.
If the work is totally unprovable, then do it twice and square the risk.
Yet, Xennet cannot help you on proving your specific algorithm. This is task-dependant. Xennet assumes that you already have a software that manages endless hosts, some more stable than others. It just gives you the hosts.

EDIT
Another point which I think worth mentioning is that the pricing units are much more noise-resistant than common.
Explanation:
Naturally one would suggest negotiating a price for a unit of time of usage, as in all server hosting services. But this is not very fair: what if I used only 20% of the CPU overall? On Xennet, we measure how many CPU instructions were made, how many sequential RAM reads, how many random disk writes and so on. Hence, even if the computer was loaded and did the job several times slower, on our scope of distributed computing which doesn't matter about the speed of each specific node, it will still get paid for a single job like everyone else.
This way we allow to reduce the risk to both sides by serving many publishers in parallel, yet the billing remains accurate, and even more accurate (and fair) than AWS for example.
Now since the publisher has all the information from all nodes, like the expected CPU instructions for a work item to complete and its variance, it can easily identify outliers.
hero member
Activity: 897
Merit: 1000
http://idni.org
legendary
Activity: 1106
Merit: 1026
The idea is simply brilliant. The question how unused resources could be used in a (semi-) trustless and distributed way was asked many times, but using micropayment channels might be the missing piece and part of the solution.

After a quick read I have a few questions and excuse me, if I missed the general concept:

xennet.io describes the idea of decrentralized supercomputing where access via SSH to VMs can be rented or sold. Contracts are negotiated over a P2P network and payments are done via payment channels for actual work which, according to the description, can be measured. This seems pretty straight forward.

xennetdocs in contrast mentiones elements like XenFS and XenTube, proof of storage and much more. So what's the plan? Distributed HPC or MaidSafe 2.0?

This particular statement made me wonder:

Quote
1. Publisher A broadcasts an announcement (ann) to the blockchain, saying it is seeking providers. The ann contains information about the required systems in terms of hardware capabilities, and the publisher's IP address.

2. Provider B polls on the blockchain. Once an ann that matches its filter is found, it connects to A's IP address.

I'd like to quote Satoshi:

Quote
We define an electronic coin as a chain of digital signatures. (...) The problem of course is the payee can't verify that one of the owners did not double-spend the coin.

We need a way for the payee to know that the previous owners did not sign any earlier transactions. For our purposes, the earliest transaction is the one that counts, so we don't care about later attempts to double-spend.

In this paper, we propose a solution to the double-spending problem using a peer-to-peer distributed timestamp server to generate computational proof of the chronological order of transactions.

The solution we propose begins with a timestamp server. A timestamp server works by taking a hash of a block of items to be timestamped and widely publishing the hash, such as in a newspaper or Usenet post [2-5]. The timestamp proves that the data must have existed at the time, ...

The blockchain is basically a ledger where data is published in an ordered structure and it provides an answer to the question which piece of data came in first.

Peer discovery and contract negotiation doesn't seem like something that requires such properties and might as well be satisfied by other communication networks. Once two peers are matched, they can furthermore communicate in an isolated channel. I don't really see the benefit of using a blockchain here and the BitTorrent Mainline DHT with likely over 25 million participants is probably a prime example how it could be done, too -- without any delay based on "block confirmations" or whatsoever. You may take a look at the colored coins projects or bitsquare (to name a another concrete example), as well, which intend to use an overlay network for order publishing.

I assume this is directly linked to my third note or question:

Why do you want to create a new coin at all? Despite that this would be a huge and complex task on it's own, not even looking at all the implications and security risks, I seem to miss the underlying need in the first place.

To quote:

Quote
One would naturally ask: why isn't Xennet planned to be implemented over Bitcoin? The answer is mainly the following: in order to initiate a micropayment channel, it is necessary to deposit money in a multisig address, and the other party has to wait for confirmations of this deposit. This can make the waiting time for the beginning of work to last 30-90 minutes, which is definitely unacceptable.

I'm not sure, if this is indeed linked to my previous comment (with something like: tx with "announcement" -> block confirmation -> tx with "accept" -> confirmation -> tx to "open channel" -> ...), but let's assume for a moment this is only about opening the payment channel: I would humbly disagree here and wonder: how do you come up with a delay of 30-90 minutes? When I look at Gavin's chart which shows the relation between fees and delay of a and inclusion within a block it seems that you can be pretty sure a transaction can be confirmed within one block at a cost of 0.0005-0.0007 BTC/1000 byte or two blocks at a cost of about 0.00045 BTC/1000 byte transaction size. Given that opening the micropayment channel equals funding the multisig wallet via a standard pay-to-hash transaction with a size of usually about 230 byte, then it comes down to a cost of about 0.0001-0.0002 BTC to ensure at a high probability the channel is opened within one or two blocks.

With a block confirmation time of usually 10 minutes, but due to the increasing total computation power of the network, of usually even less then 10 minutes, this is far away from 30-90 minutes.

This timeframe, depending on the level of trust in the other party, could be used to begin with the work (probably not wise), but also to setup everything that's needed in general and especially to run the benchmark (let's call this proof-of-benchmark Wink to measure the system's capabilities. The inceives during this periode seem sort of balanced, given that one party at least pays the transaction fee to open the channel and the other party which spends computitional resources to run the benchmark.

Another question I'd like to throw in: is an almost instant start even required here? I'm not familiar with HPC and what is usually computed at all, but I would assume tasks that require heavy resources usually run over longer periods of time and say (totally out of thin air) there is a lab which wants to run some kind of simulation over the next 7 days, then I'd say it doesn't really matter, if the work begins within 5 or 30 minutes.

My last question derives from my lack of knowledge in this field, too, but would it be possible to game the system or even produce bogus data? Related to Bitcoin mining it's pretty simple: there is a heavy task of finding a nonce which produces a hash with some specific properties. The task can easily take quite some time to be solved, but the solution can be verified almost instantaneously.

If the "usual work" done in HPC environments has similar properties, then I see a golden future. If this is not the case and if results may not even be verifiable at all, then this could be a significant problem.

Looking forward for your answers. Cheers! Smiley
hero member
Activity: 1218
Merit: 500
BintexFutures
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?

Dude,

please

stop posting this on every single thread.

Too many new coins, threads, posts to track. These are discussion threads to discuss the coins, no?
No interest in informing newcomers about the coin?

Just read the info available and make up your own mind.  Every thread I go.on you copy and paste the same thing. Even if it's only 1 or 2 pages
full member
Activity: 224
Merit: 100
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?

Dude,

please

stop posting this on every single thread.

Too many new coins, threads, posts to track. These are discussion threads to discuss the coins, no?
No interest in informing newcomers about the coin?
hero member
Activity: 1218
Merit: 500
BintexFutures
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?

Dude,

please

stop posting this on every single thread.
hero member
Activity: 966
Merit: 501
newbie
Activity: 28
Merit: 0
This looks to me much like the Cloak story: promise a 'holistic' idea but not deliver.
That's the difference with Bitcoin, when it was introduced it was already there only to develop further upon. Todays new coin launches are more like a businessplan or ideas that need to be developed but if it ever comes to full launch remains uncertain. A very risky investment that is mainly driven by new investors entering the market with  the same high hopes.
In the real world only 1 out of 1,000 ideas will be successfully developed if at all.

Note that we published a detailed software design document which explains how to implement the product. We haven't published the current code yet.
We also have the right personnel.
Using the funds from the crowdsale we will be able to finish the development and deliver the product.
legendary
Activity: 1960
Merit: 1010
This looks to me much like the Cloak story: promise a 'holistic' idea but not deliver.
That's the difference with Bitcoin, when it was introduced it was already there only to develop further upon. Todays new coin launches are more like a businessplan or ideas that need to be developed but if it ever comes to full launch remains uncertain. A very risky investment that is mainly driven by new investors entering the market with  the same high hopes.
In the real world only 1 out of 1,000 ideas will be successfully developed if at all.

That being said I'm not saying this coin can't be that 1 successfull launch. So goodluck if you're serious in achieving the goal.
newbie
Activity: 6
Merit: 0
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?

I will try to answer your questions:

Strengths - (1) XenCoins have real intrinsic value (fully backed by the right to use a certain amount of computation power)  (2) the project aims to solve an actual problem, there is a very big demand in the High-Performance Computing (HPC) for computation power. (3) The HPC is hundreds billions market with rapid growth.
            
Weaknesses - very innovative project, there will be hurdles along the way.

Promises made? kept? any FUD? - I don't know of any yet, this thread is just a PRE-ANN to get the community involved.

Original code/feature? - they are using industry's most solid technologies. The originality will be to bring everything together to achieve the xennet goal - Creating a public decentralized Supercomputer with frictionless reward mechanism using blockchain technology.

Are the devs here real developers? you can check Ohad Asor linkedin here: https://www.linkedin.com/in/ohadasor

newbie
Activity: 28
Merit: 0
an article about Xennet Supercomputer that was publish in the insideHPC:
http://insidehpc.com/2014/08/new-xennet-hpc-cloud-free-market-alternative-aws
"Today we caught wind of something coming out of stealth mode called the Xennet initiative, a “public, distributed, and decentralized Supercomputer.” As the brainchild of Israeli computer scientist Ohad Asor, Xennet is essentially a free-market alternative to AWS that sounds a lot like the marriage of BitCoin and SETI@Home."
newbie
Activity: 28
Merit: 0
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?

That's so much more than just a coin. It's not even meant to be a coin. Please read some more here and on the links. The devs are from the top industry of software, as can be seen in our documents.
legendary
Activity: 1148
Merit: 1000
will watch what happens later.
full member
Activity: 224
Merit: 100
ould appreciate it if someone could briefly summarise:
1) the strengths of this coin?
2) the weaknesses of this coin?
3) promises made? kept? any FUD?

To the dev(s), what will be the key original code/feature(s) in this coin? And are you going to provide "Proof of Developer" certification from cryptoasian:
http://cryptoasian.com/

And are the devs here real developers, or copy-paste devs or middlemen, like the SYS guys?
Pages:
Jump to: