I only meant that if we didn't have something that we call 'I', then presumably we could be modelled like a computer. But, as you pointed out we can do something special that Turing machines can't: we can alter our own programming.
Any Turing Machine can alter its own programming. Lisp is an example. Also, a program which simulates biologically plausible neural networks (such as the Integrate and Fire method), and uses STDP (Spiked-Timing-Dependent-Plasticity) is a Turing Machine compatible program which is perpetually modifying its own behavior.
Another example is a program which employs a population of genetic programs which undergo constant evolution. See Karl Sims' genetic art. The proof lies in the utter lack of a procedural style among the program's output. It's behavior is modified by interaction with the environment. See here:
http://www.karlsims.com/genetic-images.htmlOK OK, I was wrong about the reprogramming part. However, intelligent machines still need to deal with things like the "Halting problem".
Why do they need to deal with the "Halting Problem"?
AFAIK it takes a life-form to overcome that.
Why does a life-form even need to deal with it, and how does it deal with it?
Nice link! I've only skimmed it but I think I get the general idea. The observers are basically "playing god" and arbitrarily deciding which GA's make the fittest (or prettiest) pictures.
I'd say the observers are simply environmental factors. Word it how you wish though.
The algorithms evolve, but the initial programming still has to come from somewhere. The determination of fitness also has to come from somewhere.
True, but in theory, the initial programming can be made to be as generic as possible, but then we'd wait around forever to produce something that starts to behave in such a way that allows us to see meaningful results.
A few things puzzle me:
By programming computers, we create the framework for artificial evolution, but where does our programming come from?
See the last thing I just said. It started with very simple organic compounds, which behave according to the laws of physics. Where those laws came from, of course, is of course, what science is all about: don't impose an answer to early, rather admit it's an interesting problem deserving to be researched.