Topic: Exploring Tensor-Based Proof-of-Work: Aligning Mining with AI/ML Workloads (Read 158 times)

Agree that utilizing AI to mine PoW of existing crypto currencies doesn't make any sense.
(for ex sha256 used in btc is designed so that it's computationally irreducible and so can't use ai to find a nonce faster than a miner that is just randomly trying out nonces).

But the thing I am experimenting is not using AI to mine existing PoWs.
It's to design a new PoW so that the forward pass (the hash, equivalent to sha256 in btc) is similar to a forward pass (inference) in a deep neural network.
Afaik not obvious that this is not technically feasible (let me know why if that's wrong).
The point of making the forward pass similar to inference in a neural net is so that miners that are optimized for that pow are also optimized at dnn inference.
Afaik such a pass can be deterministic, not approximate or probabilistic.
Mining is then finding inputs to the neural net such that the output satisfies some target difficulty.
Afaik, it should be possible to make the layers of the net so that it satisfies the same properties as a hash (evenly spread out etc).
In fact many existing hashes and ciphers are also based on rounds of diffusion (can be linear and permutations) and confusion (for ex s-boxes).

At the moment the way it works is model weights are generated randomly from the block header (256x256*64 weights). And then miners can search for nonces such that the output of the network satisfies target (for example by building a pytorch model initialized with random weights derived from the block header and then doing batched inference in the mining loop until find the right output).
The non-linearities (activation layers) between rounds are such that rounds are not easily reversible, evenly spread out etc. (same properties as a one way hash)

So the PoW doesn't involve any approximations or probalistic solutions, but just in experimenting with new pow such that computing the forward pass (hash) involves the same kind of operations as those needed for deep learning inference (so that optimized miners are also useful for that task).
The hash used in that PoW won't be any better than sha256, but should have similar properties and difference is that would require miners to be good at work that looks like deep learning inference. (matmults, accessing weights etc).

Mining is not ML-centric

Mining in most cryptocurrencies involves doing some hard computation many times over a given period to try to find a soution.

It is not trying to approximate the solution to an input problem using neurons or anything like that.

So it is fundamentally out of scope for a crypto mining project to attempt to utilize AI.

The results are evenly spread out, so using probability theory is futile.

Agree there are already plenty of incentives to produce more efficient and powerful ai hardware.
With this project, experimenting to design a pow that "forces" miners to also be capable of the same kind of "useful" computation. (and keeping the pow as simple as possible, not specific to particular type of gpu etc, so that future type of hardware good at matmul rounds will even be better at mining, for ex future photonic or analog chips etc specialized for this type of ai compute. in other words trying to make the pow specific to type of computation needed for ai, but not tied to specific hardware that is currently best for it)

Afaik previously litecoin attempted to prevent asics by using scrypt for pow and being memory bound, to try to keep mining more decentralized, but asics were still developed for it that also serve no other purpose than mining and this contributes to centralization.
Here, trying to make it so that if miners are optimized for this pow, they are necessarily also capable of useful "ai" computation, regardless if using custom asic developed for that pow or not. (in fact if make better asics for it all the better, their utility should favor their wider dissemination)

In order to achieve this, the pow is computing rounds of (ternary) mat mults, and trying to adjust biases and non-linerarity such that computation is both hard to reverse (trying to ensure hash properties similar to LWE using error biases) and useful for ai.
By making it necessary for miners to also be capable of useful work (though not at same time as mining), maybe this can also help prevent decentralization of mining power (like LTC aimed to achieve).

If what you're looking to accomplish is create an incentive for developing a better chip for AI, then that is already existent. As we speak, the big tech companies like Nvidia have employed top engineers for improving this particular kind of efficiency. The incentive does not have to come from a process like bitcoin mining.

"Miners" in the AI era are people with GPUs that can rent them. The "currency" they mine is compute tokens.

Yes agree that mining hardware that is optimized for this pow won't replace completely nvidia gpus which are much more versatile etc.
Also the pow is kept deliberately very simple (conceptually), just deep rounds of ternary matmuls (same kind of computation used for inference of 1.58bit llms, another reason use ternary weights is that the accumulator in matmuls fits within fp16/bf16 mantissa bc weight matrices in the pow are only 256x256 and bf16 has 7-bit mantissa, so it's convenient to run on existing hardware, most of existing don't support ternary weights).
Also activation layers are different (ai usually uses multiples types like relu/gelu/softmax etc, here the pow is just using a relu layer).
Intention is to make the type of computation similar enough that optimized miners would be ai-capable and vice versa. (for ex non-gpu hardware like groq would also be very efficient at mining this pow, due to the type of computation it's good for: heavy matmuls, high bandwidth data streams, and lot of on-chip memory)

GitHub is being weird here, when obviously fake/shady repo about Bitcoin wallet rarely removed.


I think i get your point now. Price of old mining ASIC (which have lower efficient) is much lower than it's initial price, but i see people willing to buy/rent older generation of CPU/GPU. But in practice, hardware which can be re-purposed for AI/ML operation alone isn't enough. People want good software support, which is reason Nvidia GPU is extremely popular when hardware dedicated for AI/ML exists.

"The idea behind POW consensus in Bitcoin and similar systems is that if you expend energy to create a block and that block doesn't end up in the eventual consensus chain (because you were mining off a fork or making a consensus invalid blocks-- e.g. attacking) then the energy (and the cost of that energy) is wasted."

=> think I understand this important point, however with the pow i'm experimenting, miners don't produce useful work while mining. however, the pow implies that miners optimized for mining (chips etc) are also optimized for deep learning workloads. i mean, for any given period of time they have to choose between mining and doing useful (ai) work, the same energy is not used for both. imo, think might still be useful, bc incentivizes development of chips, memory etc for mining that can also have some other use (for ex when the chip gets replaced by newer generation and is no longer profitable for mining). so what i mean is that if miners decide to mine using that pow, the energy during that period of time will still be "wasted" and so doesn't hinder consensus afaik (let me know if i'm wrong). distinction is that usage of that pow could potentially help development and dissemination of chips that can also be used for ai etc. (energy saved is not the one spent mining, but external one spent optimizing miners such as custom hw, infra etc and allowing reuse when non profitable mining)

not related to previous point, but technically the pow is implemented using multiple of rounds of mat mults (using ternary weights for simplicity, same kind of computation used in 1.58bit llms for ex) and noise bias derived from nonces and security relies on the LWE problem.

There are many important properties of POW that need to be maintained that make it extremely hard to use some other 'useful' work for it.  POW generally needs to be progress free, optimization free, approximation free, trivial to generate problem instances, and trivial to validate.  Virtually all 'useful' functions violate one or more of these criteria.

But much more significantly making proof of work have value outside of the system undermines its purpose for consensus.

The idea behind POW consensus in Bitcoin and similar systems is that if you expend energy to create a block and that block doesn't end up in the eventual consensus chain (because you were mining off a fork or making a consensus invalid blocks-- e.g. attacking) then the energy (and the cost of that energy) is wasted.

If the POW is independently valuable work then an attacker can still gain that value while producing blocks that won't end up in the ultimate chain.  So the security provided by mining is only proportional to the cost of the energy *above* whatever side-effect value the mining has.

Perhaps you could say that some side effect value would be neutral if the mining was otherwise just as good, but inevitably other important properties (like optimization freeness and/or approximation freeness... or just validation cost) get compromised making it a loss.
 

sorry, github blocked the account just now. guess they think trying to pump a scam coin or smth like that. (to be clear, this is an experimental repo, coins are not for sale etc)
I reuploaded to this different account:
https://github.com/nf-dj/tenscoin

Yes I researched proof of useful work before.
Here it's a bit different and simpler imo, just trying to make a proof of work based on the LWE problem. (meaning A.x+e mod q is hard to invert, not aware of any similar pow).
Trying to design the pow such that if miners are optimized for that pow, they are also optimized for the type of computation needed for AI workloads. (rounds of matmults+nonlinerarity, with big weight matrices)
So mining doesn't produce useful work directly in itself. It's just that if someone optimizes the hw and infra to mine this pow (designs custom chip, memory etc), it aligns with the same type of computation needed for AI (bc deep learning etc is based on same type of deep rounds of matmults).
Meaning the same hw/infra can be reused (but not at the same time as mining, bc the pow uses random weight matrices seeded from the block header). Imo still a benefit compared to all the effort and energy going into sha256 mining, and should be relatively simple to implement, but any feedback welcome.

Some thought and comment,
1. I saw this page when tried visiting link you shared.



2. Have you done research about Proof of Useful Work?
3. Since there are already hardware dedicated for AI/ML task, people who can mine the coin profitably is the creator and owner of those hardware.

I’m experimenting with a proof-of-work design that leverages tensor operations. The goal is to create a PoW algorithm where mining hardware could also be effective for AI/ML tasks. In theory, this could allow mining equipment to be repurposed for AI workloads when not mining—and might help decentralize AI compute resources.

I’m particularly interested in feedback on:

The technical feasibility of designing a PoW that benefits from tensor operations
Potential challenges in aligning performance between mining and AI/ML tasks
Any ideas on how to further ensure that hardware used for mining has real utility outside of cryptocurrency mining
I’ve published some early-stage code and documentation on GitHub here: https://github.com/tenscoin/tenscoin https://github.com/nf-dj/tenscoin. I’d really appreciate any constructive feedback or thoughts on the approach.

Thanks in advance!